Skip to main content
Erschienen in: Quality of Life Research 9/2016

05.04.2016

Assessment of the psychometrics of a PROMIS item bank: self-efficacy for managing daily activities

verfasst von: Ickpyo Hong, Craig A. Velozo, Chih-Ying Li, Sergio Romero, Ann L. Gruber-Baldini, Lisa M. Shulman

Erschienen in: Quality of Life Research | Ausgabe 9/2016

Einloggen, um Zugang zu erhalten

Abstract

Purpose

The aim of this study is to investigate the psychometrics of the Patient-Reported Outcomes Measurement Information System self-efficacy for managing daily activities item bank.

Methods

The item pool was field tested on a sample of 1087 participants via internet (n = 250) and in-clinic (n = 837) surveys. All participants reported having at least one chronic health condition. The 35 item pool was investigated for dimensionality (confirmatory factor analyses, CFA and exploratory factor analysis, EFA), item-total correlations, local independence, precision, and differential item functioning (DIF) across gender, race, ethnicity, age groups, data collection modes, and neurological chronic conditions (McFadden Pseudo R 2 less than 10 %).

Results

The item pool met two of the four CFA fit criteria (CFI = 0.952 and SRMR = 0.07). EFA analysis found a dominant first factor (eigenvalue = 24.34) and the ratio of first to second eigenvalue was 12.4. The item pool demonstrated good item-total correlations (0.59–0.85) and acceptable internal consistency (Cronbach’s alpha = 0.97). The item pool maintained its precision (reliability over 0.90) across a wide range of theta (3.70), and there was no significant DIF.

Conclusion

The findings indicated the item pool has sound psychometric properties and the test items are eligible for development of computerized adaptive testing and short forms.
Anhänge
Nur mit Berechtigung zugänglich
Literatur
2.
Zurück zum Zitat Bodenheimer, T., Lorig, K., Holman, H., & Grumbach, K. (2002). Patient self-management of chronic disease in primary care. Journal of the American Medical Association, 288(19), 2469–2475.CrossRefPubMed Bodenheimer, T., Lorig, K., Holman, H., & Grumbach, K. (2002). Patient self-management of chronic disease in primary care. Journal of the American Medical Association, 288(19), 2469–2475.CrossRefPubMed
5.
Zurück zum Zitat Gramstad, A., Iversen, E., & Engelsen, B. A. (2001). The impact of affectivity dispositions, self-efficacy and locus of control on psychosocial adjustment in patients with epilepsy. Epilepsy Research, 46(1), 53–61.CrossRefPubMed Gramstad, A., Iversen, E., & Engelsen, B. A. (2001). The impact of affectivity dispositions, self-efficacy and locus of control on psychosocial adjustment in patients with epilepsy. Epilepsy Research, 46(1), 53–61.CrossRefPubMed
6.
Zurück zum Zitat Schwartz, C. E., Coulthard-Morris, L., Zeng, Q., & Retzlaff, P. (1996). Measuring self-efficacy in people with multiple sclerosis: A validation study. Archives of Physical Medicine and Rehabilitation, 77(4), 394–398.CrossRefPubMed Schwartz, C. E., Coulthard-Morris, L., Zeng, Q., & Retzlaff, P. (1996). Measuring self-efficacy in people with multiple sclerosis: A validation study. Archives of Physical Medicine and Rehabilitation, 77(4), 394–398.CrossRefPubMed
7.
9.
Zurück zum Zitat Edwards, R., Telfair, J., Cecil, H., & Lenoci, J. (2001). Self-efficacy as a predictor of adult adjustment to sickle cell disease: One-year outcomes. Psychosomatic Medicine, 63(5), 850–858.CrossRefPubMed Edwards, R., Telfair, J., Cecil, H., & Lenoci, J. (2001). Self-efficacy as a predictor of adult adjustment to sickle cell disease: One-year outcomes. Psychosomatic Medicine, 63(5), 850–858.CrossRefPubMed
10.
Zurück zum Zitat Lorig, K., Chastain, R. L., Ung, E., Shoor, S., & Holman, H. R. (1989). Development and evaluation of a scale to measure perceived self-efficacy in people with arthritis. Arthritis and Rheumatism, 32(1), 37–44.CrossRefPubMed Lorig, K., Chastain, R. L., Ung, E., Shoor, S., & Holman, H. R. (1989). Development and evaluation of a scale to measure perceived self-efficacy in people with arthritis. Arthritis and Rheumatism, 32(1), 37–44.CrossRefPubMed
11.
Zurück zum Zitat Lorig, K. R., Sobel, D. S., Ritter, P. L., Laurent, D., & Hobbs, M. (2001). Effect of a self-management program on patients with chronic disease. Effective Clinical Practice, 4(6), 256–262.PubMed Lorig, K. R., Sobel, D. S., Ritter, P. L., Laurent, D., & Hobbs, M. (2001). Effect of a self-management program on patients with chronic disease. Effective Clinical Practice, 4(6), 256–262.PubMed
12.
Zurück zum Zitat Reeve, B. B., Hays, R. D., Bjorner, J. B., Cook, K. F., Crane, P. K., Teresi, J. A., et al. (2007). Psychometric evaluation and calibration of health-related quality of life item banks: Plans for the Patient-Reported Outcomes Measurement Information System (PROMIS). Medical Care, 45(5 Suppl 1), S22–S31. doi:10.1097/01.mlr.0000250483.85507.04.CrossRefPubMed Reeve, B. B., Hays, R. D., Bjorner, J. B., Cook, K. F., Crane, P. K., Teresi, J. A., et al. (2007). Psychometric evaluation and calibration of health-related quality of life item banks: Plans for the Patient-Reported Outcomes Measurement Information System (PROMIS). Medical Care, 45(5 Suppl 1), S22–S31. doi:10.​1097/​01.​mlr.​0000250483.​85507.​04.CrossRefPubMed
13.
Zurück zum Zitat van der Linden, W. J., & Hambleton, R. K. (1997). Handbook of modern item response theory. New York: Springer.CrossRef van der Linden, W. J., & Hambleton, R. K. (1997). Handbook of modern item response theory. New York: Springer.CrossRef
15.
Zurück zum Zitat Cella, D., Riley, W., Stone, A., Rothrock, N., Reeve, B., Yount, S., et al. (2010). The Patient-Reported Outcomes Measurement Information System (PROMIS) developed and tested its first wave of adult self-reported health outcome item banks: 2005–2008. Journal of Clinical Epidemiology, 63(11), 1179–1194. doi:10.1016/j.jclinepi.2010.04.011.CrossRefPubMedPubMedCentral Cella, D., Riley, W., Stone, A., Rothrock, N., Reeve, B., Yount, S., et al. (2010). The Patient-Reported Outcomes Measurement Information System (PROMIS) developed and tested its first wave of adult self-reported health outcome item banks: 2005–2008. Journal of Clinical Epidemiology, 63(11), 1179–1194. doi:10.​1016/​j.​jclinepi.​2010.​04.​011.CrossRefPubMedPubMedCentral
17.
Zurück zum Zitat IBM SPSS Statistics for Windows. (2013). (22.0 ed.). Armonk, NY: IBM Corp. IBM SPSS Statistics for Windows. (2013). (22.0 ed.). Armonk, NY: IBM Corp.
18.
Zurück zum Zitat Hair, J. F., Anderson, R. E., Tatham, R. I., & Black, W. C. (1998). Multivariate data analysis with readings. Prentice Hall: NY. Hair, J. F., Anderson, R. E., Tatham, R. I., & Black, W. C. (1998). Multivariate data analysis with readings. Prentice Hall: NY.
20.
Zurück zum Zitat McHorney, C. A., & Tarlov, A. R. (1995). Individual-patient monitoring in clinical practice: Are available health status surveys adequate? Quality of Life Research: An International Journal of Quality of Life Aspects of Treatment, Care and Rehabilitation, 4(4), 293–307.CrossRef McHorney, C. A., & Tarlov, A. R. (1995). Individual-patient monitoring in clinical practice: Are available health status surveys adequate? Quality of Life Research: An International Journal of Quality of Life Aspects of Treatment, Care and Rehabilitation, 4(4), 293–307.CrossRef
21.
Zurück zum Zitat Muthén, L. K., & Muthén, B. O. (2012). Mplus (7.11th ed.). CA: Los Angeles. Muthén, L. K., & Muthén, B. O. (2012). Mplus (7.11th ed.). CA: Los Angeles.
22.
Zurück zum Zitat Revicki, D. A., Cook, K. F., Amtmann, D., Harnam, N., Chen, W. H., & Keefe, F. J. (2014). Exploratory and confirmatory factor analysis of the PROMIS pain quality item bank. Quality of Life Research, 23(1), 245–255. doi:10.1007/s11136-013-0467-9.CrossRefPubMed Revicki, D. A., Cook, K. F., Amtmann, D., Harnam, N., Chen, W. H., & Keefe, F. J. (2014). Exploratory and confirmatory factor analysis of the PROMIS pain quality item bank. Quality of Life Research, 23(1), 245–255. doi:10.​1007/​s11136-013-0467-9.CrossRefPubMed
23.
Zurück zum Zitat Cai, L., Thissen, D., & du Toit, S. H. C. (2011). IRTPRO for Windows (2.1st ed.). Lincolnwood, IL: Scientific Software International. Cai, L., Thissen, D., & du Toit, S. H. C. (2011). IRTPRO for Windows (2.1st ed.). Lincolnwood, IL: Scientific Software International.
24.
Zurück zum Zitat Orlando, M., & Thissen, D. (2000). Likelihood-based item-fit indices for dichotomous item response theory models. Applied Psychological Measurement, 24(1), 50–64.CrossRef Orlando, M., & Thissen, D. (2000). Likelihood-based item-fit indices for dichotomous item response theory models. Applied Psychological Measurement, 24(1), 50–64.CrossRef
25.
Zurück zum Zitat Orlando, M., & Thissen, D. (2003). Further investigation of the performance of S − χ2: An item fit index for use with dichotomous item response theory models. Applied Psychological Measurement, 27(4), 289–298. doi:10.1177/0146621603027004004.CrossRef Orlando, M., & Thissen, D. (2003). Further investigation of the performance of S − χ2: An item fit index for use with dichotomous item response theory models. Applied Psychological Measurement, 27(4), 289–298. doi:10.​1177/​0146621603027004​004.CrossRef
26.
Zurück zum Zitat Dodd, B., Koch, W., & De Ayala, R. (1989). Operational characteristics of adaptive testing procedures using the graded response model. Applied Psychological Measurement, 13(2), 129–143.CrossRef Dodd, B., Koch, W., & De Ayala, R. (1989). Operational characteristics of adaptive testing procedures using the graded response model. Applied Psychological Measurement, 13(2), 129–143.CrossRef
27.
Zurück zum Zitat Choi, S. W., Gibbons, L. E., & Crane, P. K. (2011). Lordif: An R Package for detecting differential item functioning using iterative hybrid ordinal logistic regression/item response theory and Monte Carlo simulations. Journal of Statistical Software, 39(8), 1–30.CrossRefPubMedPubMedCentral Choi, S. W., Gibbons, L. E., & Crane, P. K. (2011). Lordif: An R Package for detecting differential item functioning using iterative hybrid ordinal logistic regression/item response theory and Monte Carlo simulations. Journal of Statistical Software, 39(8), 1–30.CrossRefPubMedPubMedCentral
28.
29.
Zurück zum Zitat Irwin, D. E., Stucky, B., Langer, M. M., Thissen, D., DeWitt, E. M., Lai, J.-S., et al. (2010). An item response analysis of the pediatric PROMIS anxiety and depressive symptoms scales. Quality of Life Research: An International Journal of Quality of Life Aspects of Treatment, Care and Rehabilitation, 19(4), 595–607. doi:10.1007/s11136-010-9619-3.CrossRef Irwin, D. E., Stucky, B., Langer, M. M., Thissen, D., DeWitt, E. M., Lai, J.-S., et al. (2010). An item response analysis of the pediatric PROMIS anxiety and depressive symptoms scales. Quality of Life Research: An International Journal of Quality of Life Aspects of Treatment, Care and Rehabilitation, 19(4), 595–607. doi:10.​1007/​s11136-010-9619-3.CrossRef
30.
Zurück zum Zitat Lai, J.-S., Cella, D., Choi, S., Junghaenel, D. U., Christodoulou, C., Gershon, R., et al. (2011). How item banks and their application can influence measurement practice in rehabilitation medicine: A PROMIS fatigue item bank example. Archives of Physical Medicine and Rehabilitation, 92(10), S20–S27.CrossRefPubMedPubMedCentral Lai, J.-S., Cella, D., Choi, S., Junghaenel, D. U., Christodoulou, C., Gershon, R., et al. (2011). How item banks and their application can influence measurement practice in rehabilitation medicine: A PROMIS fatigue item bank example. Archives of Physical Medicine and Rehabilitation, 92(10), S20–S27.CrossRefPubMedPubMedCentral
31.
Zurück zum Zitat Pilkonis, P. A., Choi, S. W., Reise, S. P., Stover, A. M., Riley, W. T., & Cella, D. (2011). Item banks for measuring emotional distress from the Patient-Reported Outcomes Measurement Information System (PROMIS®): Depression, anxiety, and anger. Assessment, 18(3), 263–283. doi:10.1177/1073191111411667.CrossRefPubMedPubMedCentral Pilkonis, P. A., Choi, S. W., Reise, S. P., Stover, A. M., Riley, W. T., & Cella, D. (2011). Item banks for measuring emotional distress from the Patient-Reported Outcomes Measurement Information System (PROMIS®): Depression, anxiety, and anger. Assessment, 18(3), 263–283. doi:10.​1177/​1073191111411667​.CrossRefPubMedPubMedCentral
32.
Zurück zum Zitat Hays, R. D., Morales, L. S., & Reise, S. P. (2000). Item response theory and health outcomes measurement in the 21st century. Medical Care, 38(9 Suppl), 28–42. Hays, R. D., Morales, L. S., & Reise, S. P. (2000). Item response theory and health outcomes measurement in the 21st century. Medical Care, 38(9 Suppl), 28–42.
33.
Zurück zum Zitat Rose, M., Bjorner, J. B., Becker, J., Fries, J. F., & Ware, J. E. (2008). Evaluation of a preliminary physical function item bank supported the expected advantages of the Patient-Reported Outcomes Measurement Information System (PROMIS). Journal of Clinical Epidemiology, 61(1), 17–33. doi:10.1016/j.jclinepi.2006.06.025.CrossRefPubMed Rose, M., Bjorner, J. B., Becker, J., Fries, J. F., & Ware, J. E. (2008). Evaluation of a preliminary physical function item bank supported the expected advantages of the Patient-Reported Outcomes Measurement Information System (PROMIS). Journal of Clinical Epidemiology, 61(1), 17–33. doi:10.​1016/​j.​jclinepi.​2006.​06.​025.CrossRefPubMed
34.
Zurück zum Zitat Scott, N. W., Fayers, P. M., Aaronson, N. K., Bottomley, A., de Graeff, A., Groenvold, M., et al. (2009). A simulation study provided sample size guidance for differential item functioning (DIF) studies using short scales. Journal of Clinical Epidemiology, 62(3), 288–295. doi:10.1016/j.jclinepi.2008.06.003.CrossRefPubMed Scott, N. W., Fayers, P. M., Aaronson, N. K., Bottomley, A., de Graeff, A., Groenvold, M., et al. (2009). A simulation study provided sample size guidance for differential item functioning (DIF) studies using short scales. Journal of Clinical Epidemiology, 62(3), 288–295. doi:10.​1016/​j.​jclinepi.​2008.​06.​003.CrossRefPubMed
Metadaten
Titel
Assessment of the psychometrics of a PROMIS item bank: self-efficacy for managing daily activities
verfasst von
Ickpyo Hong
Craig A. Velozo
Chih-Ying Li
Sergio Romero
Ann L. Gruber-Baldini
Lisa M. Shulman
Publikationsdatum
05.04.2016
Verlag
Springer International Publishing
Erschienen in
Quality of Life Research / Ausgabe 9/2016
Print ISSN: 0962-9343
Elektronische ISSN: 1573-2649
DOI
https://doi.org/10.1007/s11136-016-1270-1

Weitere Artikel der Ausgabe 9/2016

Quality of Life Research 9/2016 Zur Ausgabe