Skip to main content
Erschienen in: Quality of Life Research 3/2020

09.11.2019

Optimizing measurement of vision-related quality of life: a computerized adaptive test for the impact of vision impairment questionnaire (IVI-CAT)

verfasst von: Eva K. Fenwick, Bao Sheng Loe, Jyoti Khadka, Ryan E. K. Man, Gwyn Rees, Ecosse L. Lamoureux

Erschienen in: Quality of Life Research | Ausgabe 3/2020

Einloggen, um Zugang zu erhalten

Abstract

Purpose

To compare the results from a simulated computerized adaptive test (CAT) for the 28-item Impact of Vision Impairment (IVI) questionnaire and the original paper–pencil version in terms of efficiency (main outcome), defined as percentage item reduction.

Methods

Using paper–pencil IVI data from 832 participants across the spectrum of vision impairment, item calibrations of the 28-item IVI instrument and its associated 20-item vision-specific functioning (VSF) and 8-item emotional well-being (EWB) subscales were generated with Rasch analysis. Based on these calibrations, CAT simulations were conducted on 1000 cases, with ‘high’ and ‘moderate’ precision stopping rules (standard error of measurement [SEM] 0.387 and 0.521, respectively). We examined the average number of items needed to satisfy the stopping rules and the corresponding percentage item reduction, level of agreement between person measures estimated from the full IVI item bank and from the CAT simulations, and item exposure rates (IER).

Results

For the overall IVI-CAT, 5 or 9.7 items were required, on average, to obtain moderate or high precision estimates of vision-related quality of life, corresponding to 82.1 and 65.4% item reductions compared to the paper–pencil IVI. Agreement was high between the person measures generated from the full IVI item bank and the IVI-CAT for both the high precision simulation (mean bias, − 0.004 logits; 95% LOA − 0.594 to 0.587) and moderate precision simulation (mean bias, 0.014 logits; 95% LOA − 0.828 to 0.855). The IER for the IVI-CAT in the moderate precision simulation was skewed, with six EWB items used > 40% of the time.

Conclusion

Compared to the paper–pencil IVI instrument, the IVI-CATs required fewer items without loss of measurement precision, making them potentially attractive outcome instruments for implementation into clinical trials, healthcare, and research. Final versions of the IVI-CATs are available.
Anhänge
Nur mit Berechtigung zugänglich
Literatur
1.
Zurück zum Zitat Fenwick, E. K., Man, R. E., Ong, P. G., Sabanayagam, C., Gupta, P., Cheng, C. Y., et al. (2016). Association of changes in visual acuity with vision-specific functioning in the Singapore Malay Eye Study. JAMA Ophthalmology,134(11), 1299–1305.CrossRef Fenwick, E. K., Man, R. E., Ong, P. G., Sabanayagam, C., Gupta, P., Cheng, C. Y., et al. (2016). Association of changes in visual acuity with vision-specific functioning in the Singapore Malay Eye Study. JAMA Ophthalmology,134(11), 1299–1305.CrossRef
2.
Zurück zum Zitat Fenwick, E., Ong, P., Man, R., Cheng, C.-Y., Sabanayagam, C., Wong, T., et al. (2016). Association of vision impairment and major eye diseases with mobility and independence in a Chinese population. JAMA Ophthalmology,134(10), 1087–1093.CrossRef Fenwick, E., Ong, P., Man, R., Cheng, C.-Y., Sabanayagam, C., Wong, T., et al. (2016). Association of vision impairment and major eye diseases with mobility and independence in a Chinese population. JAMA Ophthalmology,134(10), 1087–1093.CrossRef
3.
Zurück zum Zitat Rees, G., Tee, H. W., Marella, M., Fenwick, E., Dirani, M., & Lamoureux, E. L. (2010). Vision-specific distress and depressive symptoms in people with vision impairment. Investigative Ophthalmology & Visual Science,51(6), 2891–2896.CrossRef Rees, G., Tee, H. W., Marella, M., Fenwick, E., Dirani, M., & Lamoureux, E. L. (2010). Vision-specific distress and depressive symptoms in people with vision impairment. Investigative Ophthalmology & Visual Science,51(6), 2891–2896.CrossRef
4.
Zurück zum Zitat Snyder, C. F., Jensen, R. E., Segal, J. B., & Wu, A. W. (2013). Patient-reported outcomes (PROs): Putting the patient perspective in patient-centered outcomes research. Medical Care,51(8 Suppl 3), S73–S79.CrossRef Snyder, C. F., Jensen, R. E., Segal, J. B., & Wu, A. W. (2013). Patient-reported outcomes (PROs): Putting the patient perspective in patient-centered outcomes research. Medical Care,51(8 Suppl 3), S73–S79.CrossRef
5.
Zurück zum Zitat Snyder, C. F., Aaronson, N. K., Choucair, A. K., Elliott, T. E., Greenhalgh, J., Halyard, M. Y., et al. (2012). Implementing patient-reported outcomes assessment in clinical practice: A review of the options and considerations. Quality of Life Research,21(8), 1305–1314.CrossRef Snyder, C. F., Aaronson, N. K., Choucair, A. K., Elliott, T. E., Greenhalgh, J., Halyard, M. Y., et al. (2012). Implementing patient-reported outcomes assessment in clinical practice: A review of the options and considerations. Quality of Life Research,21(8), 1305–1314.CrossRef
6.
Zurück zum Zitat Greenhalgh, J. (2009). The applications of PROs in clinical practice: What are they, do they work, and why? Quality of Life Research,18(1), 115–123.CrossRef Greenhalgh, J. (2009). The applications of PROs in clinical practice: What are they, do they work, and why? Quality of Life Research,18(1), 115–123.CrossRef
7.
Zurück zum Zitat Lamoureux, E., Pallant, J. F., Pesudovs, K., Hassell, J. B., & Keeffe, J. E. (2006). The impact of vision impairment questionnaire: An evaluation of its measurement properties using Rasch analysis. Investigative Ophthalmology & Visual Science,47, 4732–4741.CrossRef Lamoureux, E., Pallant, J. F., Pesudovs, K., Hassell, J. B., & Keeffe, J. E. (2006). The impact of vision impairment questionnaire: An evaluation of its measurement properties using Rasch analysis. Investigative Ophthalmology & Visual Science,47, 4732–4741.CrossRef
8.
Zurück zum Zitat Lamoureux, E., Pallant, J. F., Pesudovs, K., Rees, G., Hassell, J. B., & Keeffe, J. E. (2007). The impact of vision impairment questionnaire: An assessment of its domain structure using confirmatory factor analysis and Rasch analysis. Investigative Ophthalmology & Visual Science,48, 1001–1006.CrossRef Lamoureux, E., Pallant, J. F., Pesudovs, K., Rees, G., Hassell, J. B., & Keeffe, J. E. (2007). The impact of vision impairment questionnaire: An assessment of its domain structure using confirmatory factor analysis and Rasch analysis. Investigative Ophthalmology & Visual Science,48, 1001–1006.CrossRef
9.
Zurück zum Zitat Fenwick, E. K., Man, R. E., Rees, G., Keeffe, J., Wong, T. Y., & Lamoureux, E. L. (2017). Reducing respondent burden: Validation of the brief impact of vision impairment questionnaire. Quality of Life Research,26(2), 479–488.CrossRef Fenwick, E. K., Man, R. E., Rees, G., Keeffe, J., Wong, T. Y., & Lamoureux, E. L. (2017). Reducing respondent burden: Validation of the brief impact of vision impairment questionnaire. Quality of Life Research,26(2), 479–488.CrossRef
10.
Zurück zum Zitat Khadka, J., McAlinden, C., & Pesudovs, K. (2013). Quality assessment of ophthalmic questionnaires: Review and recommendations. Optometry and Vision Science,90(8), 720–744.CrossRef Khadka, J., McAlinden, C., & Pesudovs, K. (2013). Quality assessment of ophthalmic questionnaires: Review and recommendations. Optometry and Vision Science,90(8), 720–744.CrossRef
11.
Zurück zum Zitat Gibbons, R. D., Weiss, D. J., Kupfer, D. J., Frank, E., Fagiolini, A., Grochocinski, V. J., et al. (2008). Using computerized adaptive testing to reduce the burden of mental health assessment. Psychiatric Services (Washington, D. C.),59(4), 361–368.CrossRef Gibbons, R. D., Weiss, D. J., Kupfer, D. J., Frank, E., Fagiolini, A., Grochocinski, V. J., et al. (2008). Using computerized adaptive testing to reduce the burden of mental health assessment. Psychiatric Services (Washington, D. C.),59(4), 361–368.CrossRef
12.
Zurück zum Zitat Cella, D., Gershon, R., Lai, J. S., & Choi, S. (2007). The future of outcomes measurement: Item banking, tailored short-forms, and computerized adaptive assessment. Quality of Life Research,16(Suppl), 1133–1141. Cella, D., Gershon, R., Lai, J. S., & Choi, S. (2007). The future of outcomes measurement: Item banking, tailored short-forms, and computerized adaptive assessment. Quality of Life Research,16(Suppl), 1133–1141.
13.
Zurück zum Zitat Forkmann, T., Boecker, M., Norra, C., Eberle, N., Kircher, T., Schauerte, P., et al. (2009). Development of an item bank for the assessment of depression in persons with mental illnesses and physical diseases using Rasch analysis. Rehabilitation Psychology,54(2), 186–197.CrossRef Forkmann, T., Boecker, M., Norra, C., Eberle, N., Kircher, T., Schauerte, P., et al. (2009). Development of an item bank for the assessment of depression in persons with mental illnesses and physical diseases using Rasch analysis. Rehabilitation Psychology,54(2), 186–197.CrossRef
14.
Zurück zum Zitat Revicki, D. A., & Cella, D. F. (1997). Health status assessment for the twenty-first century: Item response theory, item banking and computer adaptive testing. Quality of Life Research,6(6), 595–600.CrossRef Revicki, D. A., & Cella, D. F. (1997). Health status assessment for the twenty-first century: Item response theory, item banking and computer adaptive testing. Quality of Life Research,6(6), 595–600.CrossRef
15.
Zurück zum Zitat Reeve, B. B., Hays, R. D., Bjorner, J. B., Cook, K. F., Crane, P. K., Teresi, J. A., et al. (2007). Psychometric evaluation and calibration of health-related quality of life item banks: Plans for the patient-reported outcomes measurement information system (PROMIS). Medical Care,45(5 Suppl 1), S22–S31.CrossRef Reeve, B. B., Hays, R. D., Bjorner, J. B., Cook, K. F., Crane, P. K., Teresi, J. A., et al. (2007). Psychometric evaluation and calibration of health-related quality of life item banks: Plans for the patient-reported outcomes measurement information system (PROMIS). Medical Care,45(5 Suppl 1), S22–S31.CrossRef
16.
Zurück zum Zitat Lamoureux, E. L., Pallant, J. F., Pesudovs, K., Rees, G., Hassell, J. B., & Keeffe, J. E. (2007). The effectiveness of low-vision rehabilitation on participation in daily living and quality of life. Investigative Ophthalmology & Visual Science,48(4), 1476–1482.CrossRef Lamoureux, E. L., Pallant, J. F., Pesudovs, K., Rees, G., Hassell, J. B., & Keeffe, J. E. (2007). The effectiveness of low-vision rehabilitation on participation in daily living and quality of life. Investigative Ophthalmology & Visual Science,48(4), 1476–1482.CrossRef
17.
Zurück zum Zitat Goldstein, J., E. Fenwick, R. Finger, V.K. Gothwal, M.L. Jackson, E. Lamoureux, G. Rees, and R.W. Massof. (2018). Calibrating the impact of vision impairment (IVI): Creation of a sample-independent visual function measure for patient-centered outcomes research. Translational Vision Science & Technology, In press Goldstein, J., E. Fenwick, R. Finger, V.K. Gothwal, M.L. Jackson, E. Lamoureux, G. Rees, and R.W. Massof. (2018). Calibrating the impact of vision impairment (IVI): Creation of a sample-independent visual function measure for patient-centered outcomes research. Translational Vision Science & Technology, In press
18.
Zurück zum Zitat Weih, L. M., Hassell, J. B., & Keeffe, J. (2002). Assessment of the impact of vision impairment. Investigative Ophthalmology & Visual Science,43(4), 927–935. Weih, L. M., Hassell, J. B., & Keeffe, J. (2002). Assessment of the impact of vision impairment. Investigative Ophthalmology & Visual Science,43(4), 927–935.
19.
Zurück zum Zitat Rees, G., Xie, J., Chiang, P. P., Larizza, M. F., Marella, M., Hassell, J. B., et al. (2015). A randomised controlled trial of a self-management programme for low vision implemented in low vision rehabilitation services. Patient Education and Counseling,98(2), 174–181.CrossRef Rees, G., Xie, J., Chiang, P. P., Larizza, M. F., Marella, M., Hassell, J. B., et al. (2015). A randomised controlled trial of a self-management programme for low vision implemented in low vision rehabilitation services. Patient Education and Counseling,98(2), 174–181.CrossRef
20.
Zurück zum Zitat Rees, G., Xie, J., Holloway, E. E., Sturrock, B. A., Fenwick, E. K., Keeffe, J. E., et al. (2013). Identifying distinct risk factors for vision-specific distress and depressive symptoms in people with vision impairment. Investigative Ophthalmology & Visual Science,54(12), 7431–7438.CrossRef Rees, G., Xie, J., Holloway, E. E., Sturrock, B. A., Fenwick, E. K., Keeffe, J. E., et al. (2013). Identifying distinct risk factors for vision-specific distress and depressive symptoms in people with vision impairment. Investigative Ophthalmology & Visual Science,54(12), 7431–7438.CrossRef
21.
Zurück zum Zitat Linacre, J. (1994). Sample size and item calibration stability. Rasch Measurement Transactions,7(4), 328. Linacre, J. (1994). Sample size and item calibration stability. Rasch Measurement Transactions,7(4), 328.
22.
Zurück zum Zitat Linacre, J. M. (2005). A user’s guide to Winsteps/Ministeps Rasch-model programs. Chicago: MESA Press. Linacre, J. M. (2005). A user’s guide to Winsteps/Ministeps Rasch-model programs. Chicago: MESA Press.
23.
Zurück zum Zitat Andrich, D. (1978). Rating formulation for ordered response categories. Psychometrica,43, 561–573.CrossRef Andrich, D. (1978). Rating formulation for ordered response categories. Psychometrica,43, 561–573.CrossRef
24.
Zurück zum Zitat Chen, S. K., & Cook, K. F. (2009). simpolycat: An SAS program for conducting CAT simulation based on polytomous IRT models. Behavior Research Methods,41(2), 499–506.CrossRef Chen, S. K., & Cook, K. F. (2009). simpolycat: An SAS program for conducting CAT simulation based on polytomous IRT models. Behavior Research Methods,41(2), 499–506.CrossRef
25.
Zurück zum Zitat Choi, S. W. (2009). Firestar: computerized adaptive testing simulation program for polytomous item response theory models. Applied Psychological Measurement,33(8), 644–645.CrossRef Choi, S. W. (2009). Firestar: computerized adaptive testing simulation program for polytomous item response theory models. Applied Psychological Measurement,33(8), 644–645.CrossRef
26.
Zurück zum Zitat Latimer, S., Meade, T., & Tennant, A. (2014). Development of item bank to measure deliberate self-harm behaviours: Facilitating tailored scales and computer adaptive testing for specific research and clinical purposes. Psychiatry Research,217(3), 240–247.CrossRef Latimer, S., Meade, T., & Tennant, A. (2014). Development of item bank to measure deliberate self-harm behaviours: Facilitating tailored scales and computer adaptive testing for specific research and clinical purposes. Psychiatry Research,217(3), 240–247.CrossRef
27.
Zurück zum Zitat Revuelta, J., & Ponsoda, V. (1998). A comparison of item exposure control methods in computerized adaptive testing. Journal of Educational Measurement,35, 311–327.CrossRef Revuelta, J., & Ponsoda, V. (1998). A comparison of item exposure control methods in computerized adaptive testing. Journal of Educational Measurement,35, 311–327.CrossRef
28.
Zurück zum Zitat Embretson, S., & Reise, S. P. (2000). Item response theory for psychologists. New Jersey London: Lawrence Erlbaun Associates. Embretson, S., & Reise, S. P. (2000). Item response theory for psychologists. New Jersey London: Lawrence Erlbaun Associates.
29.
Zurück zum Zitat Scalise, K., & Allen, D. (2015). Use of open-source software for adaptive measurement: Concerto as an R-based computer adaptive development and delivery platform. British Journal of Mathematical and Statistical Psychology,68, 478–496.CrossRef Scalise, K., & Allen, D. (2015). Use of open-source software for adaptive measurement: Concerto as an R-based computer adaptive development and delivery platform. British Journal of Mathematical and Statistical Psychology,68, 478–496.CrossRef
30.
Zurück zum Zitat Kingsbury, G., & Zara, A. (1989). Procedures for selecting items for computerized adaptive tests. Applied Measurement in Education,2(4), 359–375.CrossRef Kingsbury, G., & Zara, A. (1989). Procedures for selecting items for computerized adaptive tests. Applied Measurement in Education,2(4), 359–375.CrossRef
31.
Zurück zum Zitat Fenwick, E., Barnard, J., Gan, A., Loe, B. S., Khadka, J., Pesudovs, K., Man, R. E . K., Lee, S. Y., Tan, G., Wong, T., & Lamoureux, E. L. (2019). Computerized adaptive tests: an innovative, efficient, and precise method to assess the patient-centred impact of diabetic retinopathy. Under review. Fenwick, E., Barnard, J., Gan, A., Loe, B. S., Khadka, J., Pesudovs, K., Man, R. E . K., Lee, S. Y., Tan, G., Wong, T., & Lamoureux, E. L. (2019). Computerized adaptive tests: an innovative, efficient, and precise method to assess the patient-centred impact of diabetic retinopathy. Under review.
32.
Zurück zum Zitat Gershon, R. C. (2005). Computer adaptive testing. Journal of Applied Measurement,6(1), 109–127.PubMed Gershon, R. C. (2005). Computer adaptive testing. Journal of Applied Measurement,6(1), 109–127.PubMed
33.
Zurück zum Zitat Haley, S. M., Ni, P., Jette, A. M., Tao, W., Moed, R., Meyers, D., et al. (2009). Replenishing a computerized adaptive test of patient-reported daily activity functioning. Quality of Life Research,18(4), 461–471.CrossRef Haley, S. M., Ni, P., Jette, A. M., Tao, W., Moed, R., Meyers, D., et al. (2009). Replenishing a computerized adaptive test of patient-reported daily activity functioning. Quality of Life Research,18(4), 461–471.CrossRef
34.
Zurück zum Zitat Finger, R., Tellis, B., Crewe, J., Keeffe, J., Ayton, L., & Guymer, R. (2014). Developing the impact of vision impairment-very low vision (IVI-VLV) questionnaire as part of the LoVADA protocol. Investigative Ophthalmology & Visual Science,55(10), 6150–6158.CrossRef Finger, R., Tellis, B., Crewe, J., Keeffe, J., Ayton, L., & Guymer, R. (2014). Developing the impact of vision impairment-very low vision (IVI-VLV) questionnaire as part of the LoVADA protocol. Investigative Ophthalmology & Visual Science,55(10), 6150–6158.CrossRef
35.
Zurück zum Zitat Bradley, S., Rumsfeld, J., & Ho, P. (2016). Incorporating health status in routine care to improve health care value: The VA patient reported health status assessment (PROST) system. JAMA,316(5), 487–488.CrossRef Bradley, S., Rumsfeld, J., & Ho, P. (2016). Incorporating health status in routine care to improve health care value: The VA patient reported health status assessment (PROST) system. JAMA,316(5), 487–488.CrossRef
36.
Zurück zum Zitat Wu, A.W., R.E. Jensen, C. Salzberg, and C.F. Snyder, Advances in the use of patient reported outcome measures in electronic health records including case studies. 2013, In support of the PCORI National Workshop to Advance the Use of PRO measures in Electronic Health Records: Atlanta, USA. Wu, A.W., R.E. Jensen, C. Salzberg, and C.F. Snyder, Advances in the use of patient reported outcome measures in electronic health records including case studies. 2013, In support of the PCORI National Workshop to Advance the Use of PRO measures in Electronic Health Records: Atlanta, USA.
37.
Zurück zum Zitat Lim, A. S., & Bishop, G. D. (2000). The role of attitudes and beliefs in differential health care utilisation among Chinese in Singapore. Psychology and Health,14(6), 965–977.CrossRef Lim, A. S., & Bishop, G. D. (2000). The role of attitudes and beliefs in differential health care utilisation among Chinese in Singapore. Psychology and Health,14(6), 965–977.CrossRef
38.
Zurück zum Zitat Fenwick, E., Man, R., Cheung, C., Sabanayagam, C., Cheng, C.-Y., Neelam, K., et al. (2017). Ethnic differences in the association between age-related macular degeneration and vision-specific functioning. JAMA Ophthalmology,135(5), 469–476.CrossRef Fenwick, E., Man, R., Cheung, C., Sabanayagam, C., Cheng, C.-Y., Neelam, K., et al. (2017). Ethnic differences in the association between age-related macular degeneration and vision-specific functioning. JAMA Ophthalmology,135(5), 469–476.CrossRef
Metadaten
Titel
Optimizing measurement of vision-related quality of life: a computerized adaptive test for the impact of vision impairment questionnaire (IVI-CAT)
verfasst von
Eva K. Fenwick
Bao Sheng Loe
Jyoti Khadka
Ryan E. K. Man
Gwyn Rees
Ecosse L. Lamoureux
Publikationsdatum
09.11.2019
Verlag
Springer International Publishing
Erschienen in
Quality of Life Research / Ausgabe 3/2020
Print ISSN: 0962-9343
Elektronische ISSN: 1573-2649
DOI
https://doi.org/10.1007/s11136-019-02354-y

Weitere Artikel der Ausgabe 3/2020

Quality of Life Research 3/2020 Zur Ausgabe