Skip to main content
Erschienen in: Quality of Life Research 6/2014

01.08.2014

Anchoring vignettes for health comparisons: an analysis of response consistency

verfasst von: Nicole Au, Paula K. Lorgelly

Erschienen in: Quality of Life Research | Ausgabe 6/2014

Einloggen, um Zugang zu erhalten

Abstract

Purpose

Self-rated health (SRH) is widely used to measure and compare the health status of different groups of individuals. However, SRH can suffer from heterogeneity in reporting styles, making health comparisons problematic. Anchoring vignettes is a promising technique for improving inter-group comparisons of SRH. A key identifying assumption of the approach is response consistency—that respondents rate themselves using the same underlying response scale that they rate the vignettes. Despite growing research into response consistency, it remains unclear how respondents rate vignettes and why respondents may not assess vignettes and themselves consistently.

Method

Vignettes for the EQ-5D-5L were developed and included in an online survey. In-depth interviews were conducted with participants following survey completion. Response consistency was examined through qualitative analysis of the interview responses and quantitative coding of participants’ thought processes.

Results

Our analysis showed that anchoring vignettes for the EQ-5D-5L is feasible, but that response consistency may not hold for some participants. Respondents are more likely to rate their own health and vignettes in the same way if presented with overall health state vignettes than single health dimension vignettes, and if they imagined themselves in the health state of the hypothetical individual.

Conclusion

This research highlights opportunities to improve the design of anchoring vignettes in order to enhance response consistency. It additionally provides new evidence on the feasibility of employing anchoring vignettes for the EQ-5D-5L, which is promising for future work to address reporting heterogeneity in the EQ-5D-5L.
Anhänge
Nur mit Berechtigung zugänglich
Fußnoten
1
We focus on the issue of DIF in cross-population comparisons, but we note that it is also possible for DIF to occur within individuals, for example if patients change their point of reference over time when rating their own health [30].
 
2
A second key assumption is Vignette equivalence—that each vignette is perceived by all respondents as the same underlying level.
 
Literatur
1.
Zurück zum Zitat Idler, E. L., & Benyamini, Y. (1997). Self-rated health and mortality: A review of twenty-seven community studies. Journal of Health and Social Behavior, 38(1), 21–37.PubMedCrossRef Idler, E. L., & Benyamini, Y. (1997). Self-rated health and mortality: A review of twenty-seven community studies. Journal of Health and Social Behavior, 38(1), 21–37.PubMedCrossRef
2.
Zurück zum Zitat Gold, M., Franks, P., & Erickson, P. (1996). Assessing the health of the nation: The predictive validity of a preference-based measure and self-rated health. Medical Care, 34(2), 163–177.PubMedCrossRef Gold, M., Franks, P., & Erickson, P. (1996). Assessing the health of the nation: The predictive validity of a preference-based measure and self-rated health. Medical Care, 34(2), 163–177.PubMedCrossRef
3.
Zurück zum Zitat Clarke, P. M., Hayes, A. J., Glasziou, P. G., Scott, R., Simes, J., & Keech, A. C. (2009). Using the EQ-5D index score as a predictor of outcomes in patients with type 2 diabetes. Medical Care, 47(1), 61–68.PubMedCrossRef Clarke, P. M., Hayes, A. J., Glasziou, P. G., Scott, R., Simes, J., & Keech, A. C. (2009). Using the EQ-5D index score as a predictor of outcomes in patients with type 2 diabetes. Medical Care, 47(1), 61–68.PubMedCrossRef
4.
Zurück zum Zitat Rabin, R., & Charro, F. D. (2001). EQ-SD: A measure of health status from the EuroQol Group. Annals of Medicine, 33(5), 337–343.PubMedCrossRef Rabin, R., & Charro, F. D. (2001). EQ-SD: A measure of health status from the EuroQol Group. Annals of Medicine, 33(5), 337–343.PubMedCrossRef
5.
Zurück zum Zitat McHorney, C. A. (1999). Health status assessment methods for adults: Past accomplishments and future challenges 1. Annual Review of Public Health, 20(1), 309–335.PubMedCrossRef McHorney, C. A. (1999). Health status assessment methods for adults: Past accomplishments and future challenges 1. Annual Review of Public Health, 20(1), 309–335.PubMedCrossRef
6.
Zurück zum Zitat Higginson, I. J., & Carr, A. J. (2001). Measuring quality of life: Using quality of life measures in the clinical setting. British Medical Journal (BMJ), 322(7297), 1297.CrossRef Higginson, I. J., & Carr, A. J. (2001). Measuring quality of life: Using quality of life measures in the clinical setting. British Medical Journal (BMJ), 322(7297), 1297.CrossRef
8.
Zurück zum Zitat Devlin, N. J., Parkin, D., & Browne, J. (2010). Patient reported outcome measures in the NHS: New methods for analysing and reporting EQ 5D data. Health Economics, 19(8), 886–905.PubMedCrossRef Devlin, N. J., Parkin, D., & Browne, J. (2010). Patient reported outcome measures in the NHS: New methods for analysing and reporting EQ 5D data. Health Economics, 19(8), 886–905.PubMedCrossRef
10.
Zurück zum Zitat van Doorslaer, E., & Koolman, X. (2004). Explaining the differences in income-related health inequalities across European countries. Health Economics, 13(7), 609–628. doi:10.1002/hec.918.PubMedCrossRef van Doorslaer, E., & Koolman, X. (2004). Explaining the differences in income-related health inequalities across European countries. Health Economics, 13(7), 609–628. doi:10.​1002/​hec.​918.PubMedCrossRef
11.
Zurück zum Zitat Euroqol Group. (1990). EuroQol-a new facility for the measurement of health-related quality of life. Health Policy, 16(3), 199–208.CrossRef Euroqol Group. (1990). EuroQol-a new facility for the measurement of health-related quality of life. Health Policy, 16(3), 199–208.CrossRef
12.
Zurück zum Zitat Murray, C. J. L., Tandon, A., Salomon, J. A., Mathers, C. D., & Sadana, R. (2002). Cross-population comparability of evidence for health policy. GPE Discussion Paper No. 46. Geneva: WHO/EIP. Murray, C. J. L., Tandon, A., Salomon, J. A., Mathers, C. D., & Sadana, R. (2002). Cross-population comparability of evidence for health policy. GPE Discussion Paper No. 46. Geneva: WHO/EIP.
13.
Zurück zum Zitat Kaplan, G., & Baron-Epel, O. (2003). What lies behind the subjective evaluation of health status? Social Science and Medicine, 56(8), 1669–1676.PubMedCrossRef Kaplan, G., & Baron-Epel, O. (2003). What lies behind the subjective evaluation of health status? Social Science and Medicine, 56(8), 1669–1676.PubMedCrossRef
16.
Zurück zum Zitat Lindeboom, M., & Van Doorslaer, E. (2004). Cut-point shift and index shift in self-reported health. Journal of Health Economics, 23(6), 1083–1099.PubMedCrossRef Lindeboom, M., & Van Doorslaer, E. (2004). Cut-point shift and index shift in self-reported health. Journal of Health Economics, 23(6), 1083–1099.PubMedCrossRef
17.
Zurück zum Zitat Groot, W. (2000). Adaptation and scale of reference bias in self-assessments of quality of life. Journal of health economics, 19(3), 403–420.PubMedCrossRef Groot, W. (2000). Adaptation and scale of reference bias in self-assessments of quality of life. Journal of health economics, 19(3), 403–420.PubMedCrossRef
18.
Zurück zum Zitat Baron-Epel, O., Kaplan, G., Haviv-Messika, A., Tarabeia, J., Green, M. S., & Nitzan Kaluski, D. (2005). Self-reported health as a cultural health determinant in Arab and Jewish Israelis: MABAT—National Health and Nutrition Survey 1999–2001. Social Science and Medicine, 61(6), 1256–1266.PubMedCrossRef Baron-Epel, O., Kaplan, G., Haviv-Messika, A., Tarabeia, J., Green, M. S., & Nitzan Kaluski, D. (2005). Self-reported health as a cultural health determinant in Arab and Jewish Israelis: MABAT—National Health and Nutrition Survey 1999–2001. Social Science and Medicine, 61(6), 1256–1266.PubMedCrossRef
19.
Zurück zum Zitat Wiseman, V. L. (1999). Culture, self-rated health and resource allocation decision-making. Health Care Analysis, 7(3), 207–223.PubMedCrossRef Wiseman, V. L. (1999). Culture, self-rated health and resource allocation decision-making. Health Care Analysis, 7(3), 207–223.PubMedCrossRef
20.
Zurück zum Zitat Kerkhofs, M., & Lindeboom, M. (1995). Subjective health measures and state dependent reporting errors. Health Economics, 4(3), 221–235.PubMedCrossRef Kerkhofs, M., & Lindeboom, M. (1995). Subjective health measures and state dependent reporting errors. Health Economics, 4(3), 221–235.PubMedCrossRef
21.
Zurück zum Zitat Sadana, R., Mathers, C. D., Lopez, A. D., Murray, C. J. L., & Iburg, K. (2000). Comparative analyses of more than 50 household surveys on health status. GPE Discussion Paper No. 15. Geneva: World Health Organization. Sadana, R., Mathers, C. D., Lopez, A. D., Murray, C. J. L., & Iburg, K. (2000). Comparative analyses of more than 50 household surveys on health status. GPE Discussion Paper No. 15. Geneva: World Health Organization.
22.
Zurück zum Zitat Shmueli, A. (2003). Socio-economic and demographic variation in health and in its measures: The issue of reporting heterogeneity. Social Science and Medicine, 57(1), 125–134.PubMedCrossRef Shmueli, A. (2003). Socio-economic and demographic variation in health and in its measures: The issue of reporting heterogeneity. Social Science and Medicine, 57(1), 125–134.PubMedCrossRef
24.
Zurück zum Zitat Humphries, K. H., & Van Doorslaer, E. (2000). Income-related health inequality in Canada. Social Science and Medicine, 50(5), 663–671.PubMedCrossRef Humphries, K. H., & Van Doorslaer, E. (2000). Income-related health inequality in Canada. Social Science and Medicine, 50(5), 663–671.PubMedCrossRef
26.
27.
Zurück zum Zitat Holland, P. W., & Wainer, H. (1993). Differential item functioning. Hillsdale NJ: Lawrence Erlbaum. Holland, P. W., & Wainer, H. (1993). Differential item functioning. Hillsdale NJ: Lawrence Erlbaum.
28.
Zurück zum Zitat King, G., Murray, C. J. L., Salomon, J. A., & Tandon, A. (2004). Enhancing the validity and cross-cultural comparability of measurement in survey research. American Political Science Review, 98(01), 191–207.CrossRef King, G., Murray, C. J. L., Salomon, J. A., & Tandon, A. (2004). Enhancing the validity and cross-cultural comparability of measurement in survey research. American Political Science Review, 98(01), 191–207.CrossRef
29.
Zurück zum Zitat Shmueli, A. (2002). Reporting heterogeneity in the measurement of health and health-related quality of life. Pharmacoeconomics, 20(6), 405–412.PubMedCrossRef Shmueli, A. (2002). Reporting heterogeneity in the measurement of health and health-related quality of life. Pharmacoeconomics, 20(6), 405–412.PubMedCrossRef
31.
Zurück zum Zitat Baker, M., Stabile, M., & Deri, C. (2004). What do self-reported, objective, measures of health measure? Journal of Human Resources, 39(4), 1067–1093.CrossRef Baker, M., Stabile, M., & Deri, C. (2004). What do self-reported, objective, measures of health measure? Journal of Human Resources, 39(4), 1067–1093.CrossRef
32.
Zurück zum Zitat Kapteyn, A., Smith, J. P., & Van Soest, A. (2007). Vignettes and self-reports of work disability in the United States and the Netherlands. The American Economic Review, 97(1), 461–473.CrossRef Kapteyn, A., Smith, J. P., & Van Soest, A. (2007). Vignettes and self-reports of work disability in the United States and the Netherlands. The American Economic Review, 97(1), 461–473.CrossRef
33.
Zurück zum Zitat Kapteyn, A., Smith, J., & Van Soest, A. (2011). Are Americans really less happy with their incomes? RAND Working Paper Series WR-858. Kapteyn, A., Smith, J., & Van Soest, A. (2011). Are Americans really less happy with their incomes? RAND Working Paper Series WR-858.
34.
Zurück zum Zitat Grol-Prokopczyk, H., Freese, J., & Hauser, R. M. (2011). Using anchoring vignettes to assess group differences in general self-rated health. Journal of Health and Social Behavior, 52(2), 246.PubMedCentralPubMedCrossRef Grol-Prokopczyk, H., Freese, J., & Hauser, R. M. (2011). Using anchoring vignettes to assess group differences in general self-rated health. Journal of Health and Social Behavior, 52(2), 246.PubMedCentralPubMedCrossRef
35.
Zurück zum Zitat Bago D’Uva, T., Van Doorslaer, E., Lindeboom, M., & O’Donnell, O. (2008). Does reporting heterogeneity bias the measurement of health disparities? [Article]. Health Economics, 17(3), 351–375. doi:10.1002/hec.1269.PubMedCrossRef Bago D’Uva, T., Van Doorslaer, E., Lindeboom, M., & O’Donnell, O. (2008). Does reporting heterogeneity bias the measurement of health disparities? [Article]. Health Economics, 17(3), 351–375. doi:10.​1002/​hec.​1269.PubMedCrossRef
36.
Zurück zum Zitat Salomon, J. A., Tandon, A., & Murray, C. J. L. (2004). Comparability of self rated health: Cross sectional multi-country survey using anchoring vignettes. British Medical Journal, 328(7434), 258.PubMedCentralPubMedCrossRef Salomon, J. A., Tandon, A., & Murray, C. J. L. (2004). Comparability of self rated health: Cross sectional multi-country survey using anchoring vignettes. British Medical Journal, 328(7434), 258.PubMedCentralPubMedCrossRef
38.
Zurück zum Zitat Bago d’Uva, T., Lindeboom, M., O’Donnell, O., & van Doorslaer, E. (2011). Slipping anchor? Testing the vignettes approach to identification and correction of reporting heterogeneity. Journal of Human Resources, 46(4), 875–906.CrossRef Bago d’Uva, T., Lindeboom, M., O’Donnell, O., & van Doorslaer, E. (2011). Slipping anchor? Testing the vignettes approach to identification and correction of reporting heterogeneity. Journal of Human Resources, 46(4), 875–906.CrossRef
39.
Zurück zum Zitat Van Soest, A., Delaney, L., Harmon, C., Kapteyn, A., & Smith, J. P. (2011). Validating the use of anchoring vignettes for the correction of response scale differences in subjective questions. Journal of the Royal Statistical Society. Series A: Statistics in Society, 174(3), 575–595.PubMedCentralCrossRef Van Soest, A., Delaney, L., Harmon, C., Kapteyn, A., & Smith, J. P. (2011). Validating the use of anchoring vignettes for the correction of response scale differences in subjective questions. Journal of the Royal Statistical Society. Series A: Statistics in Society, 174(3), 575–595.PubMedCentralCrossRef
40.
Zurück zum Zitat König, H.-H., Bernert, S., Angermeyer, M. C., Matschinger, H., Martinez, M., Vilagut, G., et al. (2009). Comparison of population health status in six European countries: Results of a representative survey using the EQ-5D Questionnaire. Medical Care, 47(2), 255–261. doi:10.1097/MLR.0b013e318184759e.PubMedCrossRef König, H.-H., Bernert, S., Angermeyer, M. C., Matschinger, H., Martinez, M., Vilagut, G., et al. (2009). Comparison of population health status in six European countries: Results of a representative survey using the EQ-5D Questionnaire. Medical Care, 47(2), 255–261. doi:10.​1097/​MLR.​0b013e318184759e​.PubMedCrossRef
41.
Zurück zum Zitat Lubetkin, E., Jia, H., Franks, P., & Gold, M. (2005). Relationship among sociodemographic factors, clinical conditions, and health-related quality of life: Examining the EQ-5D in the U.S. general population. Quality of Life Research, 14(10), 2187–2196. doi:10.1007/s11136-005-8028-5.PubMedCrossRef Lubetkin, E., Jia, H., Franks, P., & Gold, M. (2005). Relationship among sociodemographic factors, clinical conditions, and health-related quality of life: Examining the EQ-5D in the U.S. general population. Quality of Life Research, 14(10), 2187–2196. doi:10.​1007/​s11136-005-8028-5.PubMedCrossRef
42.
Zurück zum Zitat Sun, S., Chen, J., Johannesson, M., Kind, P., Xu, L., Zhang, Y., et al. (2011). Population health status in China: EQ-5D results, by age, sex and socio-economic status, from the National Health Services Survey 2008. Quality of Life Research, 20(3), 309–320.PubMedCentralPubMedCrossRef Sun, S., Chen, J., Johannesson, M., Kind, P., Xu, L., Zhang, Y., et al. (2011). Population health status in China: EQ-5D results, by age, sex and socio-economic status, from the National Health Services Survey 2008. Quality of Life Research, 20(3), 309–320.PubMedCentralPubMedCrossRef
43.
Zurück zum Zitat Maheswaran, H., Petrou, S., Rees, K., & Stranges, S. (2012). Estimating EQ-5D utility values for major health behavioural risk factors in England. Journal of Epidemiology and Community Health, 67(2), 172–180. doi:10.1136/jech-2012-201019.PubMedCrossRef Maheswaran, H., Petrou, S., Rees, K., & Stranges, S. (2012). Estimating EQ-5D utility values for major health behavioural risk factors in England. Journal of Epidemiology and Community Health, 67(2), 172–180. doi:10.​1136/​jech-2012-201019.PubMedCrossRef
44.
Zurück zum Zitat Søltoft, F., Hammer, M., & Kragh, N. (2009). The association of body mass index and health-related quality of life in the general population: Data from the 2003 Health Survey of England. Quality of Life Research, 18(10), 1293–1299.PubMedCentralPubMedCrossRef Søltoft, F., Hammer, M., & Kragh, N. (2009). The association of body mass index and health-related quality of life in the general population: Data from the 2003 Health Survey of England. Quality of Life Research, 18(10), 1293–1299.PubMedCentralPubMedCrossRef
47.
Zurück zum Zitat Marmot, M., Banks, J., Blundell, R., Lessof, C., & Nazroo, J. (2003). Health, wealth and lifestyles of the older population in England: ELSA 2002. London: Institute for Fiscal Studies. Marmot, M., Banks, J., Blundell, R., Lessof, C., & Nazroo, J. (2003). Health, wealth and lifestyles of the older population in England: ELSA 2002. London: Institute for Fiscal Studies.
48.
Zurück zum Zitat Börsch-Supan, A., Hank, K., & Jürges, H. (2005). A new comprehensive and international view on ageing: Introducing the ‘Survey of Health, Ageing and Retirement in Europe’. European Journal of Ageing, 2(4), 245–253.CrossRef Börsch-Supan, A., Hank, K., & Jürges, H. (2005). A new comprehensive and international view on ageing: Introducing the ‘Survey of Health, Ageing and Retirement in Europe’. European Journal of Ageing, 2(4), 245–253.CrossRef
Metadaten
Titel
Anchoring vignettes for health comparisons: an analysis of response consistency
verfasst von
Nicole Au
Paula K. Lorgelly
Publikationsdatum
01.08.2014
Verlag
Springer International Publishing
Erschienen in
Quality of Life Research / Ausgabe 6/2014
Print ISSN: 0962-9343
Elektronische ISSN: 1573-2649
DOI
https://doi.org/10.1007/s11136-013-0615-2

Weitere Artikel der Ausgabe 6/2014

Quality of Life Research 6/2014 Zur Ausgabe