Skip to main content
Erschienen in: Quality of Life Research 4/2014

01.05.2014

Psychometric properties of the PROMIS® pediatric scales: precision, stability, and comparison of different scoring and administration options

verfasst von: James W. Varni, Brooke Magnus, Brian D. Stucky, Yang Liu, Hally Quinn, David Thissen, Heather E. Gross, I-Chan Huang, Darren A. DeWalt

Erschienen in: Quality of Life Research | Ausgabe 4/2014

Einloggen, um Zugang zu erhalten

Abstract

Objectives

The objectives of the present study are to investigate the precision of static (fixed-length) short forms versus computerized adaptive testing (CAT) administration, response pattern scoring versus summed score conversion, and test–retest reliability (stability) of the Patient-Reported Outcomes Measurement Information System (PROMIS®) pediatric self-report scales measuring the latent constructs of depressive symptoms, anxiety, anger, pain interference, peer relationships, fatigue, mobility, upper extremity functioning, and asthma impact with polytomous items.

Methods

Participants (N = 331) between the ages of 8 and 17 were recruited from outpatient general pediatrics and subspecialty clinics. Of the 331 participants, 137 were diagnosed with asthma. Three scores based on item response theory (IRT) were computed for each respondent: CAT response pattern expected a posteriori estimates, short-form response pattern expected a posteriori estimates, and short-form summed score expected a posteriori estimates. Scores were also compared between participants with and without asthma. To examine test–retest reliability, 54 children were selected for retesting approximately 2 weeks after the first assessment.

Results

A short CAT (maximum 12 items with a standard error of 0.4) was found, on average, to be less precise than the static short forms. The CAT appears to have limited usefulness over and above what can be accomplished with the existing static short forms (8–10 items). Stability of the scale scores over a 2-week period was generally supported.

Conclusion

The study provides further information on the psychometric properties of the PROMIS pediatric scales and extends the previous IRT analyses to include precision estimates of dynamic versus static administration, test–retest reliability, and validity of administration across groups. Both the positive and negative aspects of using CAT versus short forms are highlighted.
Literatur
1.
Zurück zum Zitat Ader, D. N. (2007). Developing the Patient-Reported Outcomes Measurement Information System (PROMIS). Medical Care, 45(Suppl 1), S1–S2.CrossRef Ader, D. N. (2007). Developing the Patient-Reported Outcomes Measurement Information System (PROMIS). Medical Care, 45(Suppl 1), S1–S2.CrossRef
2.
Zurück zum Zitat Reeve, B. B., Hays, R. D., Bjorner, J. B., Cook, K. F., Crane, P. K., Teresi, J. A., et al. (2007). Psychometric evaluation and calibration of health-related quality of life item banks: Plans for the Patient-Report Outcomes Measurement Information System (PROMIS). Medical Care, 45(Suppl 1), S22–S31.PubMedCrossRef Reeve, B. B., Hays, R. D., Bjorner, J. B., Cook, K. F., Crane, P. K., Teresi, J. A., et al. (2007). Psychometric evaluation and calibration of health-related quality of life item banks: Plans for the Patient-Report Outcomes Measurement Information System (PROMIS). Medical Care, 45(Suppl 1), S22–S31.PubMedCrossRef
3.
Zurück zum Zitat Cella, D., Yount, S., Rothrock, N., Gershon, R., Cook, K., Reeve, B., et al. (2007). The Patient-Reported Outcomes Measurement Information System (PROMIS): Progress of an NIH roadmap cooperative group during its first 2 years. Medical Care, 45(Suppl 1), S3–S11.PubMedCentralPubMedCrossRef Cella, D., Yount, S., Rothrock, N., Gershon, R., Cook, K., Reeve, B., et al. (2007). The Patient-Reported Outcomes Measurement Information System (PROMIS): Progress of an NIH roadmap cooperative group during its first 2 years. Medical Care, 45(Suppl 1), S3–S11.PubMedCentralPubMedCrossRef
4.
Zurück zum Zitat Irwin, D. E., Stucky, B. D., Thissen, D., DeWitt, E. M., Lai, J. S., Yeatts, K., et al. (2010). Sampling plan and patient characteristics of the PROMIS pediatrics large-scale survey. Quality of Life Research, 19, 585–594.PubMedCentralPubMedCrossRef Irwin, D. E., Stucky, B. D., Thissen, D., DeWitt, E. M., Lai, J. S., Yeatts, K., et al. (2010). Sampling plan and patient characteristics of the PROMIS pediatrics large-scale survey. Quality of Life Research, 19, 585–594.PubMedCentralPubMedCrossRef
5.
Zurück zum Zitat Irwin, D. E., Stucky, B. D., Langer, M. M., Thissen, D., DeWitt, E. M., Lai, J. S., et al. (2010). An item response analysis of the pediatric PROMIS anxiety and depressive symptoms scales. Quality of Life Research, 19, 595–607.PubMedCentralPubMedCrossRef Irwin, D. E., Stucky, B. D., Langer, M. M., Thissen, D., DeWitt, E. M., Lai, J. S., et al. (2010). An item response analysis of the pediatric PROMIS anxiety and depressive symptoms scales. Quality of Life Research, 19, 595–607.PubMedCentralPubMedCrossRef
6.
Zurück zum Zitat Varni, J. W., Stucky, B. D., Thissen, D., DeWitt, E. M., Irwin, D. E., Lai, J. S., et al. (2010). PROMIS Pediatric Pain Interference Scale: An item response theory analysis of the pediatric pain item bank. Journal of Pain, 11, 1109–1119.PubMedCentralPubMedCrossRef Varni, J. W., Stucky, B. D., Thissen, D., DeWitt, E. M., Irwin, D. E., Lai, J. S., et al. (2010). PROMIS Pediatric Pain Interference Scale: An item response theory analysis of the pediatric pain item bank. Journal of Pain, 11, 1109–1119.PubMedCentralPubMedCrossRef
7.
Zurück zum Zitat DeWitt, E. M., Stucky, B. D., Thissen, D., Irwin, D. E., Langer, M., Varni, J. W., et al. (2011). Construction of the eight-item patient-reported outcomes measurement information system pediatric physical function scales: Built using item response theory. Journal of Clinical Epidemiology, 64, 794–804.PubMedCentralPubMedCrossRef DeWitt, E. M., Stucky, B. D., Thissen, D., Irwin, D. E., Langer, M., Varni, J. W., et al. (2011). Construction of the eight-item patient-reported outcomes measurement information system pediatric physical function scales: Built using item response theory. Journal of Clinical Epidemiology, 64, 794–804.PubMedCentralPubMedCrossRef
8.
Zurück zum Zitat Irwin, D. E., Stucky, B. D., Langer, M. M., Thissen, D., DeWitt, E. M., Lai, J. S., et al. (2012). PROMIS Pediatric Anger Scale: An item response theory analysis. Quality of Life Research, 21, 697–706.PubMedCentralPubMedCrossRef Irwin, D. E., Stucky, B. D., Langer, M. M., Thissen, D., DeWitt, E. M., Lai, J. S., et al. (2012). PROMIS Pediatric Anger Scale: An item response theory analysis. Quality of Life Research, 21, 697–706.PubMedCentralPubMedCrossRef
9.
Zurück zum Zitat DeWalt, D. A., Thissen, D., Stucky, B. D., Langer, M. M., DeWitt, E. M., Irwin, D. E., Lai, J. S., Yeatts, K. B., Gross, H. E., Taylor, O., & Varni, J. W. PROMIS pediatric peer relationships scale: Development of a peer relationships item bank as part of social health measurement. Health Psychology (in press). DeWalt, D. A., Thissen, D., Stucky, B. D., Langer, M. M., DeWitt, E. M., Irwin, D. E., Lai, J. S., Yeatts, K. B., Gross, H. E., Taylor, O., & Varni, J. W. PROMIS pediatric peer relationships scale: Development of a peer relationships item bank as part of social health measurement. Health Psychology (in press).
10.
Zurück zum Zitat Lai, J.-S., Stucky, B. D., Thissen, D., Varni, J. W., DeWitt, E. M., Irwin, D. E., Yeatts, K. B., & Dewalt, D. A. Development and psychometric properties of the PROMIS® pediatric fatigue item banks. Quality of Life Research. doi:10.1007/s11136-013-0357-1. Lai, J.-S., Stucky, B. D., Thissen, D., Varni, J. W., DeWitt, E. M., Irwin, D. E., Yeatts, K. B., & Dewalt, D. A. Development and psychometric properties of the PROMIS® pediatric fatigue item banks. Quality of Life Research. doi:10.​1007/​s11136-013-0357-1.
11.
Zurück zum Zitat Yeatts, K., Stucky, B. D., Thissen, D., Irwin, D. E., Varni, J. W., DeWitt, E. M., et al. (2010). Construction of the Pediatric Asthma Impact Scale (PAIS) for the Patient-Reported Outcomes Measurement Information System (PROMIS). Journal of Asthma, 47, 295–302.PubMedCentralPubMedCrossRef Yeatts, K., Stucky, B. D., Thissen, D., Irwin, D. E., Varni, J. W., DeWitt, E. M., et al. (2010). Construction of the Pediatric Asthma Impact Scale (PAIS) for the Patient-Reported Outcomes Measurement Information System (PROMIS). Journal of Asthma, 47, 295–302.PubMedCentralPubMedCrossRef
12.
Zurück zum Zitat Thissen, D., Varni, J. W., Stucky, B. D., Liu, Y., Irwin, D. E., & DeWalt, D. A. (2011). Using the PedsQL™ 3.0 Asthma Module to obtain scores comparable with those of the PROMIS Pediatric Asthma Impact Scale (PAIS). Quality of Life Research, 20, 1497–1505.PubMedCentralPubMedCrossRef Thissen, D., Varni, J. W., Stucky, B. D., Liu, Y., Irwin, D. E., & DeWalt, D. A. (2011). Using the PedsQL™ 3.0 Asthma Module to obtain scores comparable with those of the PROMIS Pediatric Asthma Impact Scale (PAIS). Quality of Life Research, 20, 1497–1505.PubMedCentralPubMedCrossRef
13.
Zurück zum Zitat Walsh, T. R., Irwin, D. E., Meier, A., Varni, J. W., & DeWalt, D. A. (2008). The use of focus groups in the development of the PROMIS pediatrics item bank. Quality of Life Research, 17, 725–735.PubMedCentralPubMedCrossRef Walsh, T. R., Irwin, D. E., Meier, A., Varni, J. W., & DeWalt, D. A. (2008). The use of focus groups in the development of the PROMIS pediatrics item bank. Quality of Life Research, 17, 725–735.PubMedCentralPubMedCrossRef
14.
Zurück zum Zitat Irwin, D. E., Varni, J. W., Yeatts, K., & DeWalt, D. A. (2009). Cognitive interviewing methodology in the development of a pediatric item bank: a patient reported outcomes measurement information system (PROMIS) study. Health and Quality of Life Outcomes, 7(3), 1–10. Irwin, D. E., Varni, J. W., Yeatts, K., & DeWalt, D. A. (2009). Cognitive interviewing methodology in the development of a pediatric item bank: a patient reported outcomes measurement information system (PROMIS) study. Health and Quality of Life Outcomes, 7(3), 1–10.
15.
Zurück zum Zitat Nathan, R. A., Sorkness, C. A., Kosinski, M., Schatz, M., Li, J. T., Marcus, P., et al. (2004). Development of the asthma control test: A survey for assessing asthma control. Journal of Allergy and Clinical Immunology, 113, 59–65.PubMedCrossRef Nathan, R. A., Sorkness, C. A., Kosinski, M., Schatz, M., Li, J. T., Marcus, P., et al. (2004). Development of the asthma control test: A survey for assessing asthma control. Journal of Allergy and Clinical Immunology, 113, 59–65.PubMedCrossRef
16.
Zurück zum Zitat Liu, A. H., Zeiger, R., Sorkness, C., Mahr, T., Ostrom, N., Burgess, S., et al. (2007). Development and cross-sectional validation of the childhood asthma control test. Journal of Allergy and Clinical Immunology, 119, 817–825.PubMedCrossRef Liu, A. H., Zeiger, R., Sorkness, C., Mahr, T., Ostrom, N., Burgess, S., et al. (2007). Development and cross-sectional validation of the childhood asthma control test. Journal of Allergy and Clinical Immunology, 119, 817–825.PubMedCrossRef
17.
Zurück zum Zitat Juniper, E. F., Guyatt, G. H., Feeny, D. H., Ferrie, P. J., Griffith, L. E., & Townsend, M. (1996). Measuring quality of life in children with asthma. Quality of Life Research, 5, 35–46.PubMedCrossRef Juniper, E. F., Guyatt, G. H., Feeny, D. H., Ferrie, P. J., Griffith, L. E., & Townsend, M. (1996). Measuring quality of life in children with asthma. Quality of Life Research, 5, 35–46.PubMedCrossRef
18.
Zurück zum Zitat Cella, D., Gershon, R., Bass, M., & Rothrock, N. (2012). Assessment center user manual, version 8.7. Chicago, IL: Northwestern University, Department of Medical Social Sciences. Cella, D., Gershon, R., Bass, M., & Rothrock, N. (2012). Assessment center user manual, version 8.7. Chicago, IL: Northwestern University, Department of Medical Social Sciences.
19.
Zurück zum Zitat Thissen, D., Nelson, L., Rosa, K., & McLeod, L. D. (2001). Item response theory for items scored in more than two categories. In D. Thissen & H. Wainer (Eds.), Test scoring (pp. 141–186). Mahwah, NJ: Lawrence Erlbaum Associates. Thissen, D., Nelson, L., Rosa, K., & McLeod, L. D. (2001). Item response theory for items scored in more than two categories. In D. Thissen & H. Wainer (Eds.), Test scoring (pp. 141–186). Mahwah, NJ: Lawrence Erlbaum Associates.
20.
Zurück zum Zitat Kim, S. (2012). A note on the reliability coefficients for item response model-based ability estimates. Psychometrika, 77, 153–162.CrossRef Kim, S. (2012). A note on the reliability coefficients for item response model-based ability estimates. Psychometrika, 77, 153–162.CrossRef
21.
Zurück zum Zitat Choi, S. W., & Swartz, R. J. (2009). Comparison of CAT item selection criteria for polytomous items. Applied Psychological Measurement, 33, 419–440.PubMedCentralPubMedCrossRef Choi, S. W., & Swartz, R. J. (2009). Comparison of CAT item selection criteria for polytomous items. Applied Psychological Measurement, 33, 419–440.PubMedCentralPubMedCrossRef
22.
Zurück zum Zitat Choi, S. W., Reise, S. P., Pilkonis, P. A., Hays, R. D., & Cella, D. (2010). Efficiency of static and computer adaptive short forms compared to full-length measures of depressive symptoms. Quality of Life Research, 19, 125–136.PubMedCentralPubMedCrossRef Choi, S. W., Reise, S. P., Pilkonis, P. A., Hays, R. D., & Cella, D. (2010). Efficiency of static and computer adaptive short forms compared to full-length measures of depressive symptoms. Quality of Life Research, 19, 125–136.PubMedCentralPubMedCrossRef
23.
Zurück zum Zitat Lai, J. S., Cella, D., Choi, S. W., Junghaenel, D. U., Christodoulou, C., Gershon, R., et al. (2011). How item banks and their application can influence measurement practice in rehabilitation medicine: A PROMIS fatigue item bank example. Archives of Physical Medicine and Rehabilitation, 92(1 Suppl), S20–S27.PubMedCentralPubMedCrossRef Lai, J. S., Cella, D., Choi, S. W., Junghaenel, D. U., Christodoulou, C., Gershon, R., et al. (2011). How item banks and their application can influence measurement practice in rehabilitation medicine: A PROMIS fatigue item bank example. Archives of Physical Medicine and Rehabilitation, 92(1 Suppl), S20–S27.PubMedCentralPubMedCrossRef
24.
Zurück zum Zitat Varni, J. W., Limbers, C. A., Burwinkle, T. M., Bryant, W. P., & Wilson, D. P. (2008). The ePedsQL™ in Type 1 and Type 2 diabetes: Feasibility, reliability and validity of the Pediatric Quality of Life Inventory™ internet administration. Diabetes Care, 31, 672–677.PubMedCrossRef Varni, J. W., Limbers, C. A., Burwinkle, T. M., Bryant, W. P., & Wilson, D. P. (2008). The ePedsQL™ in Type 1 and Type 2 diabetes: Feasibility, reliability and validity of the Pediatric Quality of Life Inventory™ internet administration. Diabetes Care, 31, 672–677.PubMedCrossRef
Metadaten
Titel
Psychometric properties of the PROMIS® pediatric scales: precision, stability, and comparison of different scoring and administration options
verfasst von
James W. Varni
Brooke Magnus
Brian D. Stucky
Yang Liu
Hally Quinn
David Thissen
Heather E. Gross
I-Chan Huang
Darren A. DeWalt
Publikationsdatum
01.05.2014
Verlag
Springer International Publishing
Erschienen in
Quality of Life Research / Ausgabe 4/2014
Print ISSN: 0962-9343
Elektronische ISSN: 1573-2649
DOI
https://doi.org/10.1007/s11136-013-0544-0

Weitere Artikel der Ausgabe 4/2014

Quality of Life Research 4/2014 Zur Ausgabe