Skip to main content
Erschienen in: Quality of Life Research 6/2016

19.03.2016 | Special Section: Response Shift Effects at Item Level (by invitation only)

The Guttman errors as a tool for response shift detection at subgroup and item levels

verfasst von: Myriam Blanchin, Véronique Sébille, Alice Guilleux, Jean-Benoit Hardouin

Erschienen in: Quality of Life Research | Ausgabe 6/2016

Einloggen, um Zugang zu erhalten

Abstract

Purpose

Statistical methods for identifying response shift (RS) at the individual level could be of great practical value in interpreting change in PRO data. Guttman errors (GE) may help to identify discrepancies in respondent’s answers to items compared to an expected response pattern and to identify subgroups of patients that are more likely to present response shift. This study explores the benefits of using a GE-based method for RS detection at the subgroup and item levels.

Methods

The analysis was performed on the SatisQoL study. The number of GE was determined for each individual at each time of measurement (at baseline T0 and 6 months after discharge M6). Individuals showing discrepancies (with many GE) were suspected to interpret the items differently from the majority of the sample. Patients having a large number of GE at M6 only and not at T0 were assumed to present RS. Patients having a small number of GE at T0 and M6 were assumed to present no RS. The RespOnse Shift ALgorithm in Item response theory (ROSALI) was then applied on the whole sample and on both groups.

Results

Different types of RS (non-uniform recalibration, reprioritization) were more prevalent in the group composed of patients assumed to present RS based on GE. On the opposite, no RS was detected on patients having few GE.

Conclusions

Guttman errors and item response theory models seem to be relevant tools to discriminate individuals affected by RS from the others at the item level.
Literatur
1.
Zurück zum Zitat Schwartz, C. E., & Sprangers, M. A. (1999). Methodological approaches for assessing response shift in longitudinal health related quality-of-life research. Social Science and Medicine, 48(11), 1531–1548.CrossRefPubMed Schwartz, C. E., & Sprangers, M. A. (1999). Methodological approaches for assessing response shift in longitudinal health related quality-of-life research. Social Science and Medicine, 48(11), 1531–1548.CrossRefPubMed
2.
Zurück zum Zitat Oort, F. J. (2005). Using structural equation modeling to detect response shifts and true change. Quality of Life Research, 14(3), 587–598.CrossRefPubMed Oort, F. J. (2005). Using structural equation modeling to detect response shifts and true change. Quality of Life Research, 14(3), 587–598.CrossRefPubMed
3.
Zurück zum Zitat Guilleux, A., Blanchin, M., Vanier, A., Guillemin, F., Falissard, B., Hardouin, J. B., & Sébille, V. (2015). RespOnse shift algorithm in item response theory (ROSALI) for response shift detection with missing data in longitudinal patient-reported outcome studies. Quality of Life Research, 24(3), 553–564.CrossRefPubMed Guilleux, A., Blanchin, M., Vanier, A., Guillemin, F., Falissard, B., Hardouin, J. B., & Sébille, V. (2015). RespOnse shift algorithm in item response theory (ROSALI) for response shift detection with missing data in longitudinal patient-reported outcome studies. Quality of Life Research, 24(3), 553–564.CrossRefPubMed
4.
5.
Zurück zum Zitat Sijtsma, K., & Molenaar, I. W. (2002). Introduction to nonparametric item response theory (1st ed., Vol. 5). Thousand Oaks: Sage. Sijtsma, K., & Molenaar, I. W. (2002). Introduction to nonparametric item response theory (1st ed., Vol. 5). Thousand Oaks: Sage.
6.
Zurück zum Zitat Kepka, S., Baumann, C., Anota, A., Buron, G., Spitz, E., Auquier, P., & Mercier, M. (2013). The relationship between traits optimism and anxiety and health-related quality of life in patients hospitalized for chronic diseases: Data from the SATISQOL study. Health and Quality of Life Outcomes, 11(1), 134. doi:10.1186/1477-7525-11-134.CrossRefPubMedPubMedCentral Kepka, S., Baumann, C., Anota, A., Buron, G., Spitz, E., Auquier, P., & Mercier, M. (2013). The relationship between traits optimism and anxiety and health-related quality of life in patients hospitalized for chronic diseases: Data from the SATISQOL study. Health and Quality of Life Outcomes, 11(1), 134. doi:10.​1186/​1477-7525-11-134.CrossRefPubMedPubMedCentral
7.
Zurück zum Zitat Ware, J. E., & Sherbourne, C. D. (1992). The MOS 36-item short-form health survey (SF-36). I. Conceptual framework and item selection. Medical Care, 30(6), 473–483.CrossRefPubMed Ware, J. E., & Sherbourne, C. D. (1992). The MOS 36-item short-form health survey (SF-36). I. Conceptual framework and item selection. Medical Care, 30(6), 473–483.CrossRefPubMed
8.
Zurück zum Zitat Leplège, A., Ecosse, E., Verdier, A. & Perneger, T. V. (1998). The French SF-36 health survey: Translation, cultural adaptation and preliminary psychometric evaluation. Journal of Clinical Epidemiology, 51(11), 1013–1023. doi:10.1016/S0895-4356(98)00093-6. Leplège, A., Ecosse, E., Verdier, A. & Perneger, T. V. (1998). The French SF-36 health survey: Translation, cultural adaptation and preliminary psychometric evaluation. Journal of Clinical Epidemiology, 51(11), 1013–1023. doi:10.​1016/​S0895-4356(98)00093-6.
10.
Zurück zum Zitat Meijer, R. R. (1994). The number of Guttman errors as a simple and powerful person-fit statistic. Applied Psychological Measurement, 18(4), 311–314.CrossRef Meijer, R. R. (1994). The number of Guttman errors as a simple and powerful person-fit statistic. Applied Psychological Measurement, 18(4), 311–314.CrossRef
11.
Zurück zum Zitat Tendeiro, J. N., & Meijer, R. R. (2014). Detection of invalid test scores: The usefulness of simple nonparametric statistics. Journal of Educational Measurement, 51(3), 239–259.CrossRef Tendeiro, J. N., & Meijer, R. R. (2014). Detection of invalid test scores: The usefulness of simple nonparametric statistics. Journal of Educational Measurement, 51(3), 239–259.CrossRef
12.
Zurück zum Zitat Lanza, S. T., & Rhoades, B. L. (2013). Latent class analysis: An alternative perspective on subgroup analysis in prevention and treatment. Prevention Science, 14(2), 157–168.CrossRefPubMedPubMedCentral Lanza, S. T., & Rhoades, B. L. (2013). Latent class analysis: An alternative perspective on subgroup analysis in prevention and treatment. Prevention Science, 14(2), 157–168.CrossRefPubMedPubMedCentral
13.
Zurück zum Zitat Clogg, C. C. (1995). Latent class models. In G. Arminger, C. C. Clogg, & M. E. Sobel (Eds.), Handbook of statistical modeling for the social and behavioral sciences (pp. 311–359). New York: Springer.CrossRef Clogg, C. C. (1995). Latent class models. In G. Arminger, C. C. Clogg, & M. E. Sobel (Eds.), Handbook of statistical modeling for the social and behavioral sciences (pp. 311–359). New York: Springer.CrossRef
14.
Zurück zum Zitat van Leeuwen, C. M. C., Post, M. W. M., van der Woude, L. H. V., de Groot, S., Smit, C., van Kuppevelt, D., & Lindeman, E. (2012). Changes in life satisfaction in persons with spinal cord injury during and after inpatient rehabilitation: Adaptation or measurement bias? Quality of Life Research, 21(9), 1499–1508.CrossRefPubMedPubMedCentral van Leeuwen, C. M. C., Post, M. W. M., van der Woude, L. H. V., de Groot, S., Smit, C., van Kuppevelt, D., & Lindeman, E. (2012). Changes in life satisfaction in persons with spinal cord injury during and after inpatient rehabilitation: Adaptation or measurement bias? Quality of Life Research, 21(9), 1499–1508.CrossRefPubMedPubMedCentral
15.
Zurück zum Zitat McIntosh, C. N. (2013). Pitfalls in subgroup analysis based on growth mixture models: A commentary on Van Leeuwen et al. (2012). Quality of Life Research, 22(9), 2625–2629.CrossRefPubMed McIntosh, C. N. (2013). Pitfalls in subgroup analysis based on growth mixture models: A commentary on Van Leeuwen et al. (2012). Quality of Life Research, 22(9), 2625–2629.CrossRefPubMed
16.
Zurück zum Zitat Bolck, A., Croon, M., & Hagenaars, J. (2004). Estimating latent structure models with categorical variables: One-step versus three-step estimators. Political Analysis, 12(1), 3–27.CrossRef Bolck, A., Croon, M., & Hagenaars, J. (2004). Estimating latent structure models with categorical variables: One-step versus three-step estimators. Political Analysis, 12(1), 3–27.CrossRef
17.
Zurück zum Zitat Vermunt, J. K. (2010). Latent class modeling with covariates: Two improved three-step approaches. Political Analysis, 18(4), 450–469.CrossRef Vermunt, J. K. (2010). Latent class modeling with covariates: Two improved three-step approaches. Political Analysis, 18(4), 450–469.CrossRef
18.
Zurück zum Zitat Kadengye, D. T., Ceulemans, E., & Van den Noortgate, W. (2014). A generalized longitudinal mixture IRT model for measuring differential growth in learning environments. Behavior Research Methods, 46(3), 823–840.PubMed Kadengye, D. T., Ceulemans, E., & Van den Noortgate, W. (2014). A generalized longitudinal mixture IRT model for measuring differential growth in learning environments. Behavior Research Methods, 46(3), 823–840.PubMed
19.
Zurück zum Zitat Boom, J. (2015). A new visualization and conceptualization of categorical longitudinal development: Measurement invariance and change. Frontiers in Psychology, 6, 289.CrossRefPubMedPubMedCentral Boom, J. (2015). A new visualization and conceptualization of categorical longitudinal development: Measurement invariance and change. Frontiers in Psychology, 6, 289.CrossRefPubMedPubMedCentral
20.
Zurück zum Zitat Lu, Z. L., Zhang, Z., & Lubke, G. (2011). Bayesian inference for growth mixture models with latent class dependent missing data. Multivariate Behavioral Research, 46(4), 567–597.CrossRefPubMedPubMedCentral Lu, Z. L., Zhang, Z., & Lubke, G. (2011). Bayesian inference for growth mixture models with latent class dependent missing data. Multivariate Behavioral Research, 46(4), 567–597.CrossRefPubMedPubMedCentral
21.
Zurück zum Zitat Verhagen, J., & Fox, J.-P. (2013). Longitudinal measurement in health-related surveys. A Bayesian joint growth model for multivariate ordinal responses. Statistics in Medicine, 32(17), 2988–3005.CrossRefPubMed Verhagen, J., & Fox, J.-P. (2013). Longitudinal measurement in health-related surveys. A Bayesian joint growth model for multivariate ordinal responses. Statistics in Medicine, 32(17), 2988–3005.CrossRefPubMed
22.
Zurück zum Zitat Sprangers, M. A. G., & Schwartz, C. E. (1999). Integrating response shift into health-related quality of life research: A theoretical model. Social Science and Medicine, 48(11), 1507–1515.CrossRefPubMed Sprangers, M. A. G., & Schwartz, C. E. (1999). Integrating response shift into health-related quality of life research: A theoretical model. Social Science and Medicine, 48(11), 1507–1515.CrossRefPubMed
23.
Zurück zum Zitat Rapkin, B. D. & Schwartz, C. E. (2004). Toward a theoretical model of quality-of-life appraisal: Implications of findings from studies of response shift. Health and Quality of Life Outcomes, 2(14). doi:10.1186/1477-7525-2-14. Rapkin, B. D. & Schwartz, C. E. (2004). Toward a theoretical model of quality-of-life appraisal: Implications of findings from studies of response shift. Health and Quality of Life Outcomes, 2(14). doi:10.​1186/​1477-7525-2-14.
24.
Zurück zum Zitat Holland, P. W., & Wainer, H. (1993). Differential item functioning. Hillsdale: Erlbaum. Holland, P. W., & Wainer, H. (1993). Differential item functioning. Hillsdale: Erlbaum.
25.
Zurück zum Zitat Osterlind, S. J., & Everson, H. T. (2009). Differential item functioning (2nd ed.). Thousand Oaks: Sage.CrossRef Osterlind, S. J., & Everson, H. T. (2009). Differential item functioning (2nd ed.). Thousand Oaks: Sage.CrossRef
Metadaten
Titel
The Guttman errors as a tool for response shift detection at subgroup and item levels
verfasst von
Myriam Blanchin
Véronique Sébille
Alice Guilleux
Jean-Benoit Hardouin
Publikationsdatum
19.03.2016
Verlag
Springer International Publishing
Erschienen in
Quality of Life Research / Ausgabe 6/2016
Print ISSN: 0962-9343
Elektronische ISSN: 1573-2649
DOI
https://doi.org/10.1007/s11136-016-1268-8

Weitere Artikel der Ausgabe 6/2016

Quality of Life Research 6/2016 Zur Ausgabe