Skip to main content
Erschienen in: Quality of Life Research 12/2016

25.06.2016

Applying generalizability theory methods to assess continuity and change on the Adolescent Quality of Life-Mental Health Scale (AQOL-MHS)

verfasst von: Ligia M. Chavez, Pedro Garcia, Nyrma Ortiz, Patrick E. Shrout

Erschienen in: Quality of Life Research | Ausgabe 12/2016

Einloggen, um Zugang zu erhalten

Abstract

Purpose

The Adolescent Quality of Life-Mental Health Scale (AQOL-MHS) is designed to measure quality of life in clinical samples of Latino adolescents aged 12–18 years. Initial findings support its reliability, validity and conceptual model for use of its three domains (emotional regulation, self-concept and social context). Our current study tests the usefulness of the AQOL-MHS for tracking changes in HRQOL during the course of service use.

Methods

Three waves of data were collected from 59 participants who were recruited from mental health clinics, where waves were spaced 4 months apart. Participants were receiving services at baseline assessment and were tracked for follow-up appointments regardless of treatment status. We analyze conventional reliability statistics for individual differences (e.g., Cronbach’s alpha and test–retest correlations), and to estimate the reliability of change, we carried out a variance decomposition analysis.

Results

The psychometric analyses from Chavez et al. (Qual Life Res 23(4):1327–1335, 2014) were replicated with comparable results. A generalizability theory (GT) analysis revealed that the AQOL-MHS domains can measure change reliably. The reliability estimates varied from .65 to .78. Although there was reliable change at the individual level, on the average the AQOL-MHS means improved only slightly over time.

Conclusions

The reliability of change for all three scales in the AQOL-MHS was acceptable, but consistently lower than the Cronbach’s alpha values for each wave. Future work will use this approach to adapt our current measure to provide a better reliability of within-person change and thus broaden its applicability for prospective use.
Literatur
1.
Zurück zum Zitat Chen, H., Cohen, P., Kasen, S., Johnson, J. G., Berenson, K., & Gordon, K. (2006). Impact of adolescent mental disorders and physical illnesses on quality of life 17 years later. Archives of Pediatrics and Adolescent Medicine, 160(1), 93–99.CrossRefPubMed Chen, H., Cohen, P., Kasen, S., Johnson, J. G., Berenson, K., & Gordon, K. (2006). Impact of adolescent mental disorders and physical illnesses on quality of life 17 years later. Archives of Pediatrics and Adolescent Medicine, 160(1), 93–99.CrossRefPubMed
2.
Zurück zum Zitat Patrick, D. L., Edwards, T. C., & Topolski, T. D. (2002). Adolescent quality of life, part II: Initial validation of a new instrument. Journal of Adolescence, 25(3), 287–300.CrossRefPubMed Patrick, D. L., Edwards, T. C., & Topolski, T. D. (2002). Adolescent quality of life, part II: Initial validation of a new instrument. Journal of Adolescence, 25(3), 287–300.CrossRefPubMed
3.
Zurück zum Zitat Rabkin, J., Wagner, G., & Griffin, K. W. (2000). Quality of life measures. In J.A. Rush, H.A. Pincus & M.B. First et al., (Eds.), Handbook of psychiatric measures. Task force for the handbood of psychiatric measures (pp. 135-150). Washington, DC: American Psychiatric Association. Rabkin, J., Wagner, G., & Griffin, K. W. (2000). Quality of life measures. In J.A. Rush, H.A. Pincus & M.B. First et al., (Eds.), Handbook of psychiatric measures. Task force for the handbood of psychiatric measures (pp. 135-150). Washington, DC: American Psychiatric Association.
4.
Zurück zum Zitat Osman, L., & Silverman, M. (1996). Measuring quality of life for young children with asthma and their families. European Respiratory Journal Supplement, 21, 35s–41s. Osman, L., & Silverman, M. (1996). Measuring quality of life for young children with asthma and their families. European Respiratory Journal Supplement, 21, 35s–41s.
5.
Zurück zum Zitat Cataudella, D., Morley, T. E., Nesin, A., Fernandez, C. V., Johnston, D. L., Sung, L., et al. (2014). Development of a quality of life instrument for children with advanced cancer: The pediatric advanced care quality of life scale (PAC-QoL). Pediatric Blood Cancer, 61(10), 1840–1845.CrossRefPubMed Cataudella, D., Morley, T. E., Nesin, A., Fernandez, C. V., Johnston, D. L., Sung, L., et al. (2014). Development of a quality of life instrument for children with advanced cancer: The pediatric advanced care quality of life scale (PAC-QoL). Pediatric Blood Cancer, 61(10), 1840–1845.CrossRefPubMed
6.
Zurück zum Zitat Varni, J. W., Limbers, C. A., & Newman, D. A. (2009). Using factor analysis to confirm the validity of children’s self-reported health-related quality of life across different modes of administration. Clinical Trials, 6(2), 185–195.CrossRefPubMed Varni, J. W., Limbers, C. A., & Newman, D. A. (2009). Using factor analysis to confirm the validity of children’s self-reported health-related quality of life across different modes of administration. Clinical Trials, 6(2), 185–195.CrossRefPubMed
7.
Zurück zum Zitat Edwards, T. C., Patrick, D. L., Topolski, T. D., Aspinall, C. L., Mouradian, W. E., & Speltz, M. L. (2005). Approaches to craniofacial-specific quality of life assessment in adolescents. Cleft Palate Craniofac Journal, 42(1), 19–24.CrossRef Edwards, T. C., Patrick, D. L., Topolski, T. D., Aspinall, C. L., Mouradian, W. E., & Speltz, M. L. (2005). Approaches to craniofacial-specific quality of life assessment in adolescents. Cleft Palate Craniofac Journal, 42(1), 19–24.CrossRef
8.
Zurück zum Zitat Chavez, L. M., Ramírez, R., Garcia, P., Canino, G., Mir, K., Ortiz, N., et al. (2014). Measurement properties of the Adolescent Quality of Life Mental Health Scale (AQOL-MHS). Quality of Life Research, 23(4), 1327–1335.CrossRefPubMed Chavez, L. M., Ramírez, R., Garcia, P., Canino, G., Mir, K., Ortiz, N., et al. (2014). Measurement properties of the Adolescent Quality of Life Mental Health Scale (AQOL-MHS). Quality of Life Research, 23(4), 1327–1335.CrossRefPubMed
9.
Zurück zum Zitat Chavez, L., Mir, K., & Canino, G. (2012). Starting from scratch: The development of the Adolescent Quality of Life-Mental Health Scale (AQOL-MHS) (Research Support, N.I.H., Extramural Research Support, Non-U.S. Gov’t). Culture, Medicine and Psychiatry, 36(3), 465–479.CrossRefPubMedPubMedCentral Chavez, L., Mir, K., & Canino, G. (2012). Starting from scratch: The development of the Adolescent Quality of Life-Mental Health Scale (AQOL-MHS) (Research Support, N.I.H., Extramural Research Support, Non-U.S. Gov’t). Culture, Medicine and Psychiatry, 36(3), 465–479.CrossRefPubMedPubMedCentral
10.
Zurück zum Zitat KIDSCREEN Group. (2006). The KIDSCREEN questionnaires—Quality of life questionnaires for children and adolescents—Handbook. Lengerich: Papst Science Publisher. KIDSCREEN Group. (2006). The KIDSCREEN questionnaires—Quality of life questionnaires for children and adolescents—Handbook. Lengerich: Papst Science Publisher.
11.
Zurück zum Zitat Varni, J. W., Seid, M., & Kurtin, P. S. (2001). PedsQL 4.0: Reliability and validity of the Pediatric Quality of Life Inventory version 4.0 generic core scales in healthy and patient populations. Medical Care, 39(8), 800–812.CrossRefPubMed Varni, J. W., Seid, M., & Kurtin, P. S. (2001). PedsQL 4.0: Reliability and validity of the Pediatric Quality of Life Inventory version 4.0 generic core scales in healthy and patient populations. Medical Care, 39(8), 800–812.CrossRefPubMed
12.
Zurück zum Zitat Cranford, J. A., Shrout, P. E., Iida, M., Rafaeli, E., Yip, T., & Bolger, N. (2006). A procedure for evaluating sensitivity to within-person change: Can mood measures in diary studies detect change reliably? Personality and Social Psychology Bulletin, 32(7), 917–929.CrossRefPubMedPubMedCentral Cranford, J. A., Shrout, P. E., Iida, M., Rafaeli, E., Yip, T., & Bolger, N. (2006). A procedure for evaluating sensitivity to within-person change: Can mood measures in diary studies detect change reliably? Personality and Social Psychology Bulletin, 32(7), 917–929.CrossRefPubMedPubMedCentral
13.
Zurück zum Zitat Cronbach, L., & Furby, L. (1970). How we should measure ‘change’—Or should we? Psychological Bulletin, 74, 68–80.CrossRef Cronbach, L., & Furby, L. (1970). How we should measure ‘change’—Or should we? Psychological Bulletin, 74, 68–80.CrossRef
14.
Zurück zum Zitat Shrout, P. E., & Lane, S. P. (2012). Psychometrics. In M. R. Mehl & T. S. Conner (Eds.), Handbook of research methods for studying daily life (pp. 302–320). New York: Guilford. Shrout, P. E., & Lane, S. P. (2012). Psychometrics. In M. R. Mehl & T. S. Conner (Eds.), Handbook of research methods for studying daily life (pp. 302–320). New York: Guilford.
15.
Zurück zum Zitat Cronbach, L. J., Gleser, G. C., Nanda, H., & Rajaratnam, N. (1972). The dependability of behavioral measurements. New York: Wiley. Cronbach, L. J., Gleser, G. C., Nanda, H., & Rajaratnam, N. (1972). The dependability of behavioral measurements. New York: Wiley.
16.
Zurück zum Zitat Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). New Jersey: Lawrence Erlbaum Associates. (ISBN 0-8058-0283-5, retrieved 20 April, 2016). Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). New Jersey: Lawrence Erlbaum Associates. (ISBN 0-8058-0283-5, retrieved 20 April, 2016).
17.
Zurück zum Zitat Brennan, R. L. (2001). Generalizability theory. New York: Springer-Verlag.CrossRef Brennan, R. L. (2001). Generalizability theory. New York: Springer-Verlag.CrossRef
18.
Zurück zum Zitat Shavelson, R. J., & Webb, N. M. (2005). Generalizability theory. In J. L. Green, G. Camilli, & P. B. Elmore (Eds.), Complementary methods for research in education (3rd ed.). Washington, DC: AERA. Shavelson, R. J., & Webb, N. M. (2005). Generalizability theory. In J. L. Green, G. Camilli, & P. B. Elmore (Eds.), Complementary methods for research in education (3rd ed.). Washington, DC: AERA.
Metadaten
Titel
Applying generalizability theory methods to assess continuity and change on the Adolescent Quality of Life-Mental Health Scale (AQOL-MHS)
verfasst von
Ligia M. Chavez
Pedro Garcia
Nyrma Ortiz
Patrick E. Shrout
Publikationsdatum
25.06.2016
Verlag
Springer International Publishing
Erschienen in
Quality of Life Research / Ausgabe 12/2016
Print ISSN: 0962-9343
Elektronische ISSN: 1573-2649
DOI
https://doi.org/10.1007/s11136-016-1344-0

Weitere Artikel der Ausgabe 12/2016

Quality of Life Research 12/2016 Zur Ausgabe