Skip to main content
Erschienen in: Quality of Life Research 8/2009

01.10.2009

The practical impact of differential item functioning analyses in a health-related quality of life instrument

verfasst von: Neil W. Scott, Peter M. Fayers, Neil K. Aaronson, Andrew Bottomley, Alexander de Graeff, Mogens Groenvold, Chad Gundy, Michael Koller, Morten A. Petersen, Mirjam A. G. Sprangers

Erschienen in: Quality of Life Research | Ausgabe 8/2009

Einloggen, um Zugang zu erhalten

Abstract

Introduction

Differential item functioning (DIF) analyses are commonly used to evaluate health-related quality of life (HRQoL) instruments. There is, however, a lack of consensus as to how to assess the practical impact of statistically significant DIF results.

Methods

Using our previously published ordinal logistic regression DIF results for the Fatigue scale of a HRQoL instrument as an example, the practical impact on a particular Norwegian clinical trial was investigated. The results were used to determine the difference in mean Fatigue scores assuming that the same trial was conducted in the UK. The results were then compared with published information on what would be considered a clinically important change in scores.

Results

The item with the largest DIF effect resulted in differences between the mean English and Norwegian Fatigue scores that, although small, could be considered clinically important. Sensitivity analyses showed that larger differences were found for shorter scales, and when the proportions in each response category were equal.

Discussion

Our scenarios suggest that translation differences in an item can result in small, but clinically important, differences at the scale score level. This is more likely to be problematic for observational studies than for clinical trials, where randomised groups are stratified by centre.
Anhänge
Nur mit Berechtigung zugänglich
Literatur
1.
Zurück zum Zitat Holland, P. W., & Wainer, H. (1993). Differential item functioning. Hillsdale, NJ: Lawrence Erlbaum. Holland, P. W., & Wainer, H. (1993). Differential item functioning. Hillsdale, NJ: Lawrence Erlbaum.
2.
Zurück zum Zitat Crane, P. K., Gibbons, L. E., Jolley, L., & van Belle, G. (2006). Differential item functioning analysis with ordinal logistic regression techniques. Medical Care, 44, S115–S123.PubMedCrossRef Crane, P. K., Gibbons, L. E., Jolley, L., & van Belle, G. (2006). Differential item functioning analysis with ordinal logistic regression techniques. Medical Care, 44, S115–S123.PubMedCrossRef
3.
Zurück zum Zitat Groenvold, M., & Petersen, M. A. (2005). The role and use of differential item functioning (DIF) analysis of quality of life data from clinical trials. In P. Fayers & R. Hays (Eds.), Assessing quality of life in clinical trials (pp. 195–208). Oxford: Oxford University Press. Groenvold, M., & Petersen, M. A. (2005). The role and use of differential item functioning (DIF) analysis of quality of life data from clinical trials. In P. Fayers & R. Hays (Eds.), Assessing quality of life in clinical trials (pp. 195–208). Oxford: Oxford University Press.
4.
Zurück zum Zitat Teresi, J. A. (2006). Overview of quantitative measurement methods: Equivalence, invariance, and differential item functioning in health applications. Medical Care, 44, S39–S49.PubMedCrossRef Teresi, J. A. (2006). Overview of quantitative measurement methods: Equivalence, invariance, and differential item functioning in health applications. Medical Care, 44, S39–S49.PubMedCrossRef
5.
Zurück zum Zitat Teresi, J. A. (2006). Different approaches to differential item functioning in health applications: Advantages, disadvantages and some neglected topics. Medical Care, 44, S152–S170.PubMedCrossRef Teresi, J. A. (2006). Different approaches to differential item functioning in health applications: Advantages, disadvantages and some neglected topics. Medical Care, 44, S152–S170.PubMedCrossRef
6.
Zurück zum Zitat Scott, N. W., Fayers, P. M., Bottomley, A., Aaronson, N. K., de Graeff, A., Groenvold, M., et al. (2006). Comparing translations of the EORTC QLQ-C30 using differential item functioning analyses. Quality of Life Research, 15, 1103–1115.PubMedCrossRef Scott, N. W., Fayers, P. M., Bottomley, A., Aaronson, N. K., de Graeff, A., Groenvold, M., et al. (2006). Comparing translations of the EORTC QLQ-C30 using differential item functioning analyses. Quality of Life Research, 15, 1103–1115.PubMedCrossRef
7.
Zurück zum Zitat Clauser, B. E., & Mazor, K. M. (1998). Using statistical procedures to identify differentially functioning test items. Educational Measurement: Issues and Practice, 2, 31–44.CrossRef Clauser, B. E., & Mazor, K. M. (1998). Using statistical procedures to identify differentially functioning test items. Educational Measurement: Issues and Practice, 2, 31–44.CrossRef
8.
Zurück zum Zitat Millsap, R. E. (2006). Comments on methods for the investigation of measurement bias in the mini-mental state examination. Medical Care, 44, S171–S175.PubMedCrossRef Millsap, R. E. (2006). Comments on methods for the investigation of measurement bias in the mini-mental state examination. Medical Care, 44, S171–S175.PubMedCrossRef
9.
Zurück zum Zitat Jodoin, M. G., & Gierl, M. J. (2001). Evaluating type I error and power rates using an effect size measure with the logistic regression procedure for DIF detection. Applied Measurement in Education, 14, 329–349.CrossRef Jodoin, M. G., & Gierl, M. J. (2001). Evaluating type I error and power rates using an effect size measure with the logistic regression procedure for DIF detection. Applied Measurement in Education, 14, 329–349.CrossRef
10.
Zurück zum Zitat Bjorner, J. B., Kreiner, S., Ware, J. E., Damsgaard, M. T., & Bech, P. (1998). Differential item functioning in the Danish translation of the SF-36. Journal of Clinical Epidemiology, 51, 1189–1202.PubMedCrossRef Bjorner, J. B., Kreiner, S., Ware, J. E., Damsgaard, M. T., & Bech, P. (1998). Differential item functioning in the Danish translation of the SF-36. Journal of Clinical Epidemiology, 51, 1189–1202.PubMedCrossRef
11.
Zurück zum Zitat Fayers, P., Aaronson, N., Bjordal, K., Groenvold, M., Curran, D., & Bottomley, A. (2001). EORTC QLQ-C30 scoring manual. Brussels: European Organization for Research and Treatment of Cancer. Fayers, P., Aaronson, N., Bjordal, K., Groenvold, M., Curran, D., & Bottomley, A. (2001). EORTC QLQ-C30 scoring manual. Brussels: European Organization for Research and Treatment of Cancer.
12.
Zurück zum Zitat Scott, N. W., Fayers, P. M., Aaronson, N. K., Bottomley, A., de Graeff, A., Groenvold, M., et al. (2007). The use of differential item functioning analyses to identify cultural differences in responses to the EORTC QLQ-C30. Quality of Life Research, 16, 115–129.PubMedCrossRef Scott, N. W., Fayers, P. M., Aaronson, N. K., Bottomley, A., de Graeff, A., Groenvold, M., et al. (2007). The use of differential item functioning analyses to identify cultural differences in responses to the EORTC QLQ-C30. Quality of Life Research, 16, 115–129.PubMedCrossRef
13.
Zurück zum Zitat Wisloff, F., Hjorth, M., Kaasa, S., & Westin, J. (1996). Effect of interferon on the health-related quality of life of multiple myeloma patients: Results of a Nordic randomized trial comparing melphalan-prednisone to melphalan-prednisone + alpha-interferon. British Journal of Haematology, 94, 324–332.PubMedCrossRef Wisloff, F., Hjorth, M., Kaasa, S., & Westin, J. (1996). Effect of interferon on the health-related quality of life of multiple myeloma patients: Results of a Nordic randomized trial comparing melphalan-prednisone to melphalan-prednisone + alpha-interferon. British Journal of Haematology, 94, 324–332.PubMedCrossRef
14.
Zurück zum Zitat Zieky, M. (1993). Practical questions in the use of DIF statistics in test development. In P. W. Holland & H. Wainer (Eds.), Differential item functioning (pp. 337–348). Hillsdale, NJ: Lawrence Erlbaum. Zieky, M. (1993). Practical questions in the use of DIF statistics in test development. In P. W. Holland & H. Wainer (Eds.), Differential item functioning (pp. 337–348). Hillsdale, NJ: Lawrence Erlbaum.
Metadaten
Titel
The practical impact of differential item functioning analyses in a health-related quality of life instrument
verfasst von
Neil W. Scott
Peter M. Fayers
Neil K. Aaronson
Andrew Bottomley
Alexander de Graeff
Mogens Groenvold
Chad Gundy
Michael Koller
Morten A. Petersen
Mirjam A. G. Sprangers
Publikationsdatum
01.10.2009
Verlag
Springer Netherlands
Erschienen in
Quality of Life Research / Ausgabe 8/2009
Print ISSN: 0962-9343
Elektronische ISSN: 1573-2649
DOI
https://doi.org/10.1007/s11136-009-9521-z

Weitere Artikel der Ausgabe 8/2009

Quality of Life Research 8/2009 Zur Ausgabe