Skip to main content
Erschienen in: Quality of Life Research 5/2014

01.06.2014

Screening for mental disorders in heart failure patients using computer-adaptive tests

verfasst von: H. Felix Fischer, Cassandra Klug, Koosje Roeper, Eva Blozik, Frank Edelmann, Marion Eisele, Stefan Störk, Rolf Wachter, Martin Scherer, Matthias Rose, Christoph Herrmann-Lingen

Erschienen in: Quality of Life Research | Ausgabe 5/2014

Einloggen, um Zugang zu erhalten

Abstract

Purpose

Item response theory is increasingly used in the development of psychometric tests. This paper evaluates whether these modern psychometric methods can improve self-reported screening for depression and anxiety in patients with heart failure.

Methods

The mental health status of 194 patients with heart failure was assessed using six screening tools for depression (Patient Health Questionnaire -9 (9 items), Hospital Anxiety and Depression Scale (HADS) (7 items), PROMIS-Depression Short Form 8a (8 items)) and Anxiety (GAD-7 (7 items), Hospital Anxiety and Depression Scale (HADS) (7 items), PROMIS-Anxiety Short Form 8a (8 items)). An in-person structured clinical interview was used as the current gold standard to identify the presence of a mental disorder. The diagnostic accuracy of all static tools was compared when item response theory (IRT)-based person parameter were estimated instead of sum scores. Furthermore, we compared performance of static instruments with post hoc simulated individual-tailored computer-adaptive test (CATs) for both disorders and a common negative affect CAT.

Results

In general, screening for depression was highly efficient and showed a better performance than screening for anxiety with only minimal differences among the assessed instruments. IRT-based person parameters yielded the same diagnostic accuracy as sum scores. CATs showed similar screening performance compared to legacy instruments but required significantly fewer items to identify patients without mental conditions. Ideal cutoffs varied between male and female samples.

Conclusions

Overall, the diagnostic performance of all investigated instruments was similar, regardless of the methods being used. However, CATs can individually tailor the test to each patient, thus significantly decreasing the respondent burden for patients with and without mental conditions. Such approach could efficiently increase the acceptability of mental health screening in clinical practice settings.
Anhänge
Nur mit Berechtigung zugänglich
Literatur
1.
Zurück zum Zitat Lichtman, J. H., Bigger, J. T., Blumenthal, J. A., Frasure-Smith, N., Kaufmann, P. G., Lespérance, F., et al. (2008). Depression and coronary heart disease: Recommendations for screening, referral, and treatment. Circulation, 118(17), 1768–1775. doi:10.1161/CIRCULATIONAHA.108.190769.PubMedCrossRef Lichtman, J. H., Bigger, J. T., Blumenthal, J. A., Frasure-Smith, N., Kaufmann, P. G., Lespérance, F., et al. (2008). Depression and coronary heart disease: Recommendations for screening, referral, and treatment. Circulation, 118(17), 1768–1775. doi:10.​1161/​CIRCULATIONAHA.​108.​190769.PubMedCrossRef
3.
Zurück zum Zitat Thombs, B. D., Roseman, M., Coyne, J. C., de Jonge, P., Delisle, V. C., Arthurs, E., et al. (2013). Does evidence support the American Heart Association’s recommendation to screen patients for depression in cardiovascular care? An updated systematic review. PloS one, 8(1), e52654. doi:10.1371/journal.pone.0052654.CrossRef Thombs, B. D., Roseman, M., Coyne, J. C., de Jonge, P., Delisle, V. C., Arthurs, E., et al. (2013). Does evidence support the American Heart Association’s recommendation to screen patients for depression in cardiovascular care? An updated systematic review. PloS one, 8(1), e52654. doi:10.​1371/​journal.​pone.​0052654.CrossRef
4.
Zurück zum Zitat Thombs, B., Jonge, P. De, Coyne, J., Whooley, M., Frasure-Smith, N., Mitchell, A., et al. (2008). Depression screening and patient outcomes in cardiovascular care. JAMA, 300 (18). Thombs, B., Jonge, P. De, Coyne, J., Whooley, M., Frasure-Smith, N., Mitchell, A., et al. (2008). Depression screening and patient outcomes in cardiovascular care. JAMA, 300 (18).
6.
Zurück zum Zitat Herrmann, C., Scholz, K., & Kreuzer, H. (1991). Psychologic screening of patients of a cardiologic acute care clinic with the German version of the Hospital Anxiety and Depression Scale. Psychotherapie, Psychosomatik, Medizinische Psychologie, 41(2), 83–92.PubMed Herrmann, C., Scholz, K., & Kreuzer, H. (1991). Psychologic screening of patients of a cardiologic acute care clinic with the German version of the Hospital Anxiety and Depression Scale. Psychotherapie, Psychosomatik, Medizinische Psychologie, 41(2), 83–92.PubMed
7.
Zurück zum Zitat Holzapfel, N., Zugck, C., Müller-Tasch, T., Löwe, B., Wild, B., Schellberg, D., et al. (2007). Routine screening for depression and quality of life in outpatients with congestive heart failure. Psychosomatics, 48(2), 112–116. doi:10.1176/appi.psy.48.2.112.PubMedCrossRef Holzapfel, N., Zugck, C., Müller-Tasch, T., Löwe, B., Wild, B., Schellberg, D., et al. (2007). Routine screening for depression and quality of life in outpatients with congestive heart failure. Psychosomatics, 48(2), 112–116. doi:10.​1176/​appi.​psy.​48.​2.​112.PubMedCrossRef
8.
Zurück zum Zitat Streiner, D. L. (2010). Measure for measure: New developments in measurement and item response theory. Canadian Journal of Psychiatry, 55(3), 180–186. Streiner, D. L. (2010). Measure for measure: New developments in measurement and item response theory. Canadian Journal of Psychiatry, 55(3), 180–186.
11.
Zurück zum Zitat Linacre, J. M. (2000). Computer-adaptive testing: A methodology whose time has come. Linacre, J. M. (2000). Computer-adaptive testing: A methodology whose time has come.
12.
Zurück zum Zitat Cella, D., Gershon, R., Lai, J.-S., Choi, S., Yount, S., Rothrock, N., et al. (2007). The future of outcomes measurement: Item banking, tailored short-forms, and computerized adaptive assessment. Quality of Life Research, 16 Suppl 1(5 Suppl 1), 133–41. doi:10.1007/s11136-007-9204-6. Cella, D., Gershon, R., Lai, J.-S., Choi, S., Yount, S., Rothrock, N., et al. (2007). The future of outcomes measurement: Item banking, tailored short-forms, and computerized adaptive assessment. Quality of Life Research, 16 Suppl 1(5 Suppl 1), 133–41. doi:10.​1007/​s11136-007-9204-6.
13.
14.
Zurück zum Zitat Gibbons, L. E., Feldman, B. J., Crane, H. M., Mugavero, M., Willig, J. H., Patrick, D., et al. (2011). Migrating from a legacy fixed-format measure to CAT administration: Calibrating the PHQ-9 to the PROMIS depression measures. Quality of Life Research, 20(9), 1349–1357. doi:10.1007/s11136-011-9882-y.PubMedCentralPubMedCrossRef Gibbons, L. E., Feldman, B. J., Crane, H. M., Mugavero, M., Willig, J. H., Patrick, D., et al. (2011). Migrating from a legacy fixed-format measure to CAT administration: Calibrating the PHQ-9 to the PROMIS depression measures. Quality of Life Research, 20(9), 1349–1357. doi:10.​1007/​s11136-011-9882-y.PubMedCentralPubMedCrossRef
16.
Zurück zum Zitat Fliege, H., Becker, J., Walter, O. B., Rose, M., Bjorner, J. B., & Klapp, B. F. (2009). Evaluation of a computer-adaptive test for the assessment of depression (D-CAT) in clinical application. International Journal of Methods in Psychiatric Research, 18(1), 23–36. doi:10.1002/mpr.274.PubMedCrossRef Fliege, H., Becker, J., Walter, O. B., Rose, M., Bjorner, J. B., & Klapp, B. F. (2009). Evaluation of a computer-adaptive test for the assessment of depression (D-CAT) in clinical application. International Journal of Methods in Psychiatric Research, 18(1), 23–36. doi:10.​1002/​mpr.​274.PubMedCrossRef
17.
Zurück zum Zitat Kocalevent, R.-D., Rose, M., Becker, J., Walter, O. B., Fliege, H., Bjorner, J. B., et al. (2009). An evaluation of patient-reported outcomes found computerized adaptive testing was efficient in assessing stress perception. Journal of Clinical Epidemiology, 62(3), 278–87, 287.e1–3. doi:10.1016/j.jclinepi.2008.03.003. Kocalevent, R.-D., Rose, M., Becker, J., Walter, O. B., Fliege, H., Bjorner, J. B., et al. (2009). An evaluation of patient-reported outcomes found computerized adaptive testing was efficient in assessing stress perception. Journal of Clinical Epidemiology, 62(3), 278–87, 287.e1–3. doi:10.​1016/​j.​jclinepi.​2008.​03.​003.
18.
Zurück zum Zitat Garcia, S. F., Cella, D., Clauser, S. B., Flynn, K. E., Lad, T., Lai, J., et al. (2010). Standardizing patient-reported outcomes assessment in cancer clinical trials : A patient-reported outcomes measurement information system initiative. Journal of Clinical Oncology, 25(32), 5106–5112. doi:10.1200/JCO.2007.12.2341.CrossRef Garcia, S. F., Cella, D., Clauser, S. B., Flynn, K. E., Lad, T., Lai, J., et al. (2010). Standardizing patient-reported outcomes assessment in cancer clinical trials : A patient-reported outcomes measurement information system initiative. Journal of Clinical Oncology, 25(32), 5106–5112. doi:10.​1200/​JCO.​2007.​12.​2341.CrossRef
19.
Zurück zum Zitat Cella, D., Yount, S., Rothrock, N., & Gershon, R. (2007). The patient-reported outcomes measurement information system (PROMIS): Progress of an NIH Roadmap cooperative group during its first two years. Medical Care, 45(5), 3–11.CrossRef Cella, D., Yount, S., Rothrock, N., & Gershon, R. (2007). The patient-reported outcomes measurement information system (PROMIS): Progress of an NIH Roadmap cooperative group during its first two years. Medical Care, 45(5), 3–11.CrossRef
22.
Zurück zum Zitat Kroenke, K., Spitzer, R. L., & Williams, J. B. (2001). The PHQ-9: Validity of a brief depression severity measure. Journal of General Internal Medicine, 16(9), 606–613.PubMedCentralPubMedCrossRef Kroenke, K., Spitzer, R. L., & Williams, J. B. (2001). The PHQ-9: Validity of a brief depression severity measure. Journal of General Internal Medicine, 16(9), 606–613.PubMedCentralPubMedCrossRef
23.
Zurück zum Zitat Löwe, B., Gräfe, K., Zipfel, S., Witte, S., Loerch, B., & Herzog, W. (2004). Diagnosing ICD-10 depressive episodes: Superior criterion validity of the Patient Health Questionnaire. Psychotherapy and Psychosomatics, 73(6), 386–390. doi:10.1159/000080393.PubMedCrossRef Löwe, B., Gräfe, K., Zipfel, S., Witte, S., Loerch, B., & Herzog, W. (2004). Diagnosing ICD-10 depressive episodes: Superior criterion validity of the Patient Health Questionnaire. Psychotherapy and Psychosomatics, 73(6), 386–390. doi:10.​1159/​000080393.PubMedCrossRef
25.
Zurück zum Zitat Löwe, B., Decker, O., Müller, S., Brähler, E., Schellberg, D., Herzog, W., et al. (2008). Validation and standardization of the generalized anxiety disorder screener (GAD-7) in the general population. Medical Care, 46(3), 266–274. doi:10.1097/MLR.0b013e318160d093.PubMedCrossRef Löwe, B., Decker, O., Müller, S., Brähler, E., Schellberg, D., Herzog, W., et al. (2008). Validation and standardization of the generalized anxiety disorder screener (GAD-7) in the general population. Medical Care, 46(3), 266–274. doi:10.​1097/​MLR.​0b013e318160d093​.PubMedCrossRef
26.
Zurück zum Zitat Kroenke, K., Spitzer, R., Williams, J. B. W., Monahan, P., & Löwe, B. (2007). Anxiety disorders in primary care: Prevalence, impairment, comorbidity, and detection. Annals of Internal Medicine, 146, 317–326.PubMedCrossRef Kroenke, K., Spitzer, R., Williams, J. B. W., Monahan, P., & Löwe, B. (2007). Anxiety disorders in primary care: Prevalence, impairment, comorbidity, and detection. Annals of Internal Medicine, 146, 317–326.PubMedCrossRef
27.
Zurück zum Zitat Bjelland, I., Dahl, A. A., Haug, T. T., & Neckelmann, D. (2002). The validity of the Hospital Anxiety and Depression Scale. An updated literature review. Journal of Psychosomatic Research, 52(2), 69–77.PubMedCrossRef Bjelland, I., Dahl, A. A., Haug, T. T., & Neckelmann, D. (2002). The validity of the Hospital Anxiety and Depression Scale. An updated literature review. Journal of Psychosomatic Research, 52(2), 69–77.PubMedCrossRef
28.
Zurück zum Zitat Pilkonis, P. A., Choi, S. W. S., Reise, S. P. S., Stover, A. M., Riley, W. T., & Cella, D. (2011). Item banks for measuring emotional distress from the patient-reported outcomes measurement information system (PROMIS®): Depression, anxiety, and anger. Assessment, 18(3), 263–283. doi:10.1177/1073191111411667.PubMedCentralPubMedCrossRef Pilkonis, P. A., Choi, S. W. S., Reise, S. P. S., Stover, A. M., Riley, W. T., & Cella, D. (2011). Item banks for measuring emotional distress from the patient-reported outcomes measurement information system (PROMIS®): Depression, anxiety, and anger. Assessment, 18(3), 263–283. doi:10.​1177/​1073191111411667​.PubMedCentralPubMedCrossRef
33.
Zurück zum Zitat Wittchen, H. U., Zaudig, M., & Fydrich, T. (1997). Strukturiertes Klinisches Interview für DSM-IV. Göttingen: Hogrefe. Göttingen: Hogrefe. Wittchen, H. U., Zaudig, M., & Fydrich, T. (1997). Strukturiertes Klinisches Interview für DSM-IV. Göttingen: Hogrefe. Göttingen: Hogrefe.
34.
Zurück zum Zitat Wahl, I., Löwe, B., Bjorner, J. B., Fischer, H. F., Langs, G., Voderholzer, U., et al. (9999). Standardization of depression measurement: A common metric for eleven self-report depression scales. Journal of Clinical Epidemiology. Wahl, I., Löwe, B., Bjorner, J. B., Fischer, H. F., Langs, G., Voderholzer, U., et al. (9999). Standardization of depression measurement: A common metric for eleven self-report depression scales. Journal of Clinical Epidemiology.
35.
36.
Zurück zum Zitat Rose, M., Bjorner, J. B., Becker, J., Fries, J. F., & Ware, J. E. (2008). Evaluation of a preliminary physical function item bank supported the expected advantages of the patient-reported outcomes measurement information system (PROMIS). Journal of Clinical Epidemiology, 61(1), 17–33. doi:10.1016/j.jclinepi.2006.06.025.PubMedCrossRef Rose, M., Bjorner, J. B., Becker, J., Fries, J. F., & Ware, J. E. (2008). Evaluation of a preliminary physical function item bank supported the expected advantages of the patient-reported outcomes measurement information system (PROMIS). Journal of Clinical Epidemiology, 61(1), 17–33. doi:10.​1016/​j.​jclinepi.​2006.​06.​025.PubMedCrossRef
37.
Zurück zum Zitat Rosseel, Y. (2012). lavaan: An R package for structural equation modeling. Journal of Statistical Software, 48(2). Rosseel, Y. (2012). lavaan: An R package for structural equation modeling. Journal of Statistical Software, 48(2).
38.
Zurück zum Zitat Brown, T. A., & Kenny, D. A. (2006). Confirmatory factor analysis for applied research. New York: Guilford Press. Brown, T. A., & Kenny, D. A. (2006). Confirmatory factor analysis for applied research. New York: Guilford Press.
39.
Zurück zum Zitat Ramsay, J. O. (1991). Kernel smoothing approaches to nonparametric item characteristic curve estimation. Psychometrika, 56(4), 611–630.CrossRef Ramsay, J. O. (1991). Kernel smoothing approaches to nonparametric item characteristic curve estimation. Psychometrika, 56(4), 611–630.CrossRef
41.
Zurück zum Zitat Clark, L. A., & Watson, D. (1991). Tripartite model of anxiety and depression: Psychometric evidence and taxonomic implications. Journal of Abnormal Psychology, 100(3), 316–336.PubMedCrossRef Clark, L. A., & Watson, D. (1991). Tripartite model of anxiety and depression: Psychometric evidence and taxonomic implications. Journal of Abnormal Psychology, 100(3), 316–336.PubMedCrossRef
43.
Zurück zum Zitat Choi, S. W. (2009). Firestar : Computerized adaptive testing simulation program response theory models. Applied Psychological Measurement, 33(8), 644–645.CrossRef Choi, S. W. (2009). Firestar : Computerized adaptive testing simulation program response theory models. Applied Psychological Measurement, 33(8), 644–645.CrossRef
44.
Zurück zum Zitat Embretson, S. E., & Reise, S. P. (2000). Item response theory for psychologists. Mahwah, NJ: Lawrence Erlbaum Associates. Embretson, S. E., & Reise, S. P. (2000). Item response theory for psychologists. Mahwah, NJ: Lawrence Erlbaum Associates.
45.
Zurück zum Zitat DeLong, E. R., DeLong, D. M., & Clarke-Pearson, D. L. (1988). Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics, 44(3), 837–845.PubMedCrossRef DeLong, E. R., DeLong, D. M., & Clarke-Pearson, D. L. (1988). Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics, 44(3), 837–845.PubMedCrossRef
46.
Zurück zum Zitat R Development Core Team. (2008). R: A language and environment for statistical computing. Vienna: R Foundation for Statistical Computing. R Development Core Team. (2008). R: A language and environment for statistical computing. Vienna: R Foundation for Statistical Computing.
47.
Zurück zum Zitat Raiche, G. (2010). nFactors: An R package for parallel analysis and non graphical solutions to the Cattell scree test. R package. Raiche, G. (2010). nFactors: An R package for parallel analysis and non graphical solutions to the Cattell scree test. R package.
48.
Zurück zum Zitat Chalmers, R. P. (2012). mirt: a multidimensional item response theory package for the r Environment. Journal of Statistical Software, 48(6). Chalmers, R. P. (2012). mirt: a multidimensional item response theory package for the r Environment. Journal of Statistical Software, 48(6).
50.
Zurück zum Zitat Mazza, A., Punzo, A., & McGuire, B. (2012). KernSmoothIRT: Nonparametric item response theory. R package version 3.0. Mazza, A., Punzo, A., & McGuire, B. (2012). KernSmoothIRT: Nonparametric item response theory. R package version 3.0.
51.
Zurück zum Zitat Rizopoulos, D. (2006). ltm: An R package for latent variable modeling and item response analysis. Journal of Statistical Software, 17, 1–25.CrossRef Rizopoulos, D. (2006). ltm: An R package for latent variable modeling and item response analysis. Journal of Statistical Software, 17, 1–25.CrossRef
53.
Zurück zum Zitat Haworth, J. E., Moniz-Cook, E., Clark, A. L., Wang, M., Waddington, R., & Cleland, J. G. F. (2005). Prevalence and predictors of anxiety and depression in a sample of chronic heart failure patients with left ventricular systolic dysfunction. European Journal of Heart Failure, 7(5), 803–808. doi:10.1016/j.ejheart.2005.03.001.PubMedCrossRef Haworth, J. E., Moniz-Cook, E., Clark, A. L., Wang, M., Waddington, R., & Cleland, J. G. F. (2005). Prevalence and predictors of anxiety and depression in a sample of chronic heart failure patients with left ventricular systolic dysfunction. European Journal of Heart Failure, 7(5), 803–808. doi:10.​1016/​j.​ejheart.​2005.​03.​001.PubMedCrossRef
55.
56.
Zurück zum Zitat Thissen, D., Pommerich, M., Billeaud, K., & Williams, V. S. L. (1995). Item response theory for scores on tests including polytocous items with ordered responses. Applied Psychological Measurement, 19(1), 39–49. doi:10.1177/014662169501900105.CrossRef Thissen, D., Pommerich, M., Billeaud, K., & Williams, V. S. L. (1995). Item response theory for scores on tests including polytocous items with ordered responses. Applied Psychological Measurement, 19(1), 39–49. doi:10.​1177/​0146621695019001​05.CrossRef
58.
Zurück zum Zitat Strömberg, A., & Martensson, J. (2003). Gender differences in patients with heart failure. European Journal of Cardiovascular Nursing, 2(1), 7–18.PubMedCrossRef Strömberg, A., & Martensson, J. (2003). Gender differences in patients with heart failure. European Journal of Cardiovascular Nursing, 2(1), 7–18.PubMedCrossRef
Metadaten
Titel
Screening for mental disorders in heart failure patients using computer-adaptive tests
verfasst von
H. Felix Fischer
Cassandra Klug
Koosje Roeper
Eva Blozik
Frank Edelmann
Marion Eisele
Stefan Störk
Rolf Wachter
Martin Scherer
Matthias Rose
Christoph Herrmann-Lingen
Publikationsdatum
01.06.2014
Verlag
Springer International Publishing
Erschienen in
Quality of Life Research / Ausgabe 5/2014
Print ISSN: 0962-9343
Elektronische ISSN: 1573-2649
DOI
https://doi.org/10.1007/s11136-013-0599-y

Weitere Artikel der Ausgabe 5/2014

Quality of Life Research 5/2014 Zur Ausgabe