Skip to main content
Erschienen in:

01.05.2020 | Review Article

Inter-rater reliability in performance status assessment among healthcare professionals: an updated systematic review and meta-analysis

verfasst von: Ronald Chow, Eduardo Bruera, Jennifer S. Temel, Monica Krishnan, James Im, Michael Lock

Erschienen in: Supportive Care in Cancer | Ausgabe 5/2020

Einloggen, um Zugang zu erhalten

Abstract

Introduction

Survival prediction for patients with incurable malignancies is invaluable information during end-of-life discussions, as it helps the healthcare team to appropriately recommend treatment options and consider hospice enrolment. Assessment of performance status may differ between different healthcare professionals (HCPs), which could have implications in predicting prognosis. The aim of this systematic review and meta-analysis is to update a prior systematic review with recent articles, as well as conduct a meta-analysis to quantitatively compare performance status scores.

Methods

A literature search was carried out in Ovid MEDLINE, Embase, and Cochrane Central Register of Controlled Trials, from the earliest date until the first week of August 2019. Studies were included if they reported on (1) Karnofsky Performance Status (KPS), Eastern Cooperative Oncology Group (ECOG) Performance Status, and/or Palliative Performance Scale (PPS) and (2) assessment of performance status by multiple HCPs for the same patient sets. The concordance statistics (Kappa, Krippendorff’s alpha, Kendall correlation, Spearman rank correlation, Pearson correlation) were extracted into a summary table for narrative review, and Pearson correlation coefficients were calculated for each study and meta-analyzed with a random effects analysis model. Analyses were conducted using Comprehensive Meta-Analysis (Version 3) by Biostat.

Results

Fourteen articles were included, with a cumulative sample size of 2808 patients. The Pearson correlation coefficient was 0.787 (95% CI: 0.661, 0.870) for KPS, 0.749 (95% CI: 0.716, 0.779) for PPS, and 0.705 (95% CI: 0.536, 0.819) for ECOG. Four studies compared different tools head-to-head; KPS was favored in three studies. The quality of evidence was moderate, as determined by the GRADE tool.

Conclusions

The meta-analysis’s Pearson correlation coefficient ranged from 0.705 to 0.787; there is notable correlation of performance status scores, with no one tool statistically superior to others. KPS is, however, descriptively better and favored in head-to-head trials. Future studies could now examine the accuracy of KPS assessment in prognostication and focus on model-building around KPS.
Anhänge
Nur mit Berechtigung zugänglich
Literatur
1.
Zurück zum Zitat Chow R, Chiu N, Burera E et al (2016) Inter-rater reliability in performance status assessment among health care professionals: a systematic review. Ann Palliat Med 5:83–92CrossRef Chow R, Chiu N, Burera E et al (2016) Inter-rater reliability in performance status assessment among health care professionals: a systematic review. Ann Palliat Med 5:83–92CrossRef
2.
Zurück zum Zitat Temel JS, Greer JA, Muzikansky A, Gallagher ER, Admane S, Jackson VA, Dahlin CM, Blinderman CD, Jacobsen J, Pirl WF, Billings JA, Lynch TJ (2010) Early palliative care for patients with metastatic non-small-cell lung cancer. New Engl J Med 363:733–742CrossRef Temel JS, Greer JA, Muzikansky A, Gallagher ER, Admane S, Jackson VA, Dahlin CM, Blinderman CD, Jacobsen J, Pirl WF, Billings JA, Lynch TJ (2010) Early palliative care for patients with metastatic non-small-cell lung cancer. New Engl J Med 363:733–742CrossRef
3.
Zurück zum Zitat Wright AA, Zhang B, Ray A, Mack JW, Trice E, Balboni T, Mitchell SL, Jackson VA, Block SD, Maciejewski PK, Prigerson HG (2008) Associations between end-of-life discussions, patient mental health, medical care near death, and caregiver bereavement adjustment. JAMA 300:1665–1673CrossRef Wright AA, Zhang B, Ray A, Mack JW, Trice E, Balboni T, Mitchell SL, Jackson VA, Block SD, Maciejewski PK, Prigerson HG (2008) Associations between end-of-life discussions, patient mental health, medical care near death, and caregiver bereavement adjustment. JAMA 300:1665–1673CrossRef
4.
Zurück zum Zitat Zhang B, Wright AA, Huskamp HA, Nilsson ME, Maciejewski ML, Earle CC, Block SD, Maciejewski PK, Prigerson HG (2009) Health care costs in the last week of life: associations with end-of-life conversations. Arch Intern Med 169:480–488CrossRef Zhang B, Wright AA, Huskamp HA, Nilsson ME, Maciejewski ML, Earle CC, Block SD, Maciejewski PK, Prigerson HG (2009) Health care costs in the last week of life: associations with end-of-life conversations. Arch Intern Med 169:480–488CrossRef
5.
Zurück zum Zitat Evans C, McCarthy M (1985) Prognostic uncertainty in terminal care: can the Karnofsky index help? Lancet 1:1204–1206CrossRef Evans C, McCarthy M (1985) Prognostic uncertainty in terminal care: can the Karnofsky index help? Lancet 1:1204–1206CrossRef
6.
Zurück zum Zitat Pirovano M, Maltoni M, Nanni O, Marinari M, Indelli M, Zaninetta G, Petrella V, Barni S, Zecca E, Scarpi E, Labianca R, Amadori D, Luporini G (1999) A new palliative prognostic score: a first step for the staging of terminally ill cancer patients. Italian multicenter and study group on palliative care. J Pain Symptom Manag 17:231–239CrossRef Pirovano M, Maltoni M, Nanni O, Marinari M, Indelli M, Zaninetta G, Petrella V, Barni S, Zecca E, Scarpi E, Labianca R, Amadori D, Luporini G (1999) A new palliative prognostic score: a first step for the staging of terminally ill cancer patients. Italian multicenter and study group on palliative care. J Pain Symptom Manag 17:231–239CrossRef
7.
Zurück zum Zitat Bachelot T, Ray-Coquard I, Catimel G et al (2000) Multivariable analysis of prognostic factors for toxicity and survival for patients enrolled in phase I clinical trials. Ann Oncol 11:115–116CrossRef Bachelot T, Ray-Coquard I, Catimel G et al (2000) Multivariable analysis of prognostic factors for toxicity and survival for patients enrolled in phase I clinical trials. Ann Oncol 11:115–116CrossRef
8.
Zurück zum Zitat Maltoni M, Caraceni A, Brunelli C, Broeckaert B, Christakis N, Eychmueller S, Glare P, Nabal M, Viganò A, Larkin P, de Conno F, Hanks G, Kaasa S, Steering Committee of the European Association for Palliative Care (2005) Prognostic factors in advanced cancer patients: evidence-based clinical recommendations--a study by the steering Committee of the European Association for palliative care. J Clin Oncol 23:6240–6248CrossRef Maltoni M, Caraceni A, Brunelli C, Broeckaert B, Christakis N, Eychmueller S, Glare P, Nabal M, Viganò A, Larkin P, de Conno F, Hanks G, Kaasa S, Steering Committee of the European Association for Palliative Care (2005) Prognostic factors in advanced cancer patients: evidence-based clinical recommendations--a study by the steering Committee of the European Association for palliative care. J Clin Oncol 23:6240–6248CrossRef
9.
Zurück zum Zitat Lingjun Z, Jing C, Jian L, Wee B, Jijun Z (2009) Prediction of survival time in advanced cancer: a prognostic scale for Chinese patients. J Pain Symptom Manag 38:578–586CrossRef Lingjun Z, Jing C, Jian L, Wee B, Jijun Z (2009) Prediction of survival time in advanced cancer: a prognostic scale for Chinese patients. J Pain Symptom Manag 38:578–586CrossRef
10.
Zurück zum Zitat Chan EY, Wu HY, Chan YH (2013) Revisiting the palliative performance scale: changes in scores during disease trajectory predicts survival. Palliat Med 27:367–374CrossRef Chan EY, Wu HY, Chan YH (2013) Revisiting the palliative performance scale: changes in scores during disease trajectory predicts survival. Palliat Med 27:367–374CrossRef
11.
Zurück zum Zitat Krishnan M, Temel JS, Wright AA, Bernacki R, Selvaggi K, Balboni T (2013) Predicting life expectancy in patients with advanced incurable cancer: a review. J Support Oncol 11:68–74CrossRef Krishnan M, Temel JS, Wright AA, Bernacki R, Selvaggi K, Balboni T (2013) Predicting life expectancy in patients with advanced incurable cancer: a review. J Support Oncol 11:68–74CrossRef
12.
Zurück zum Zitat Kelly CM, Shahrokni (2016) Moving beyond Karnofsky and ECOG performance status assessments with new technologies. J Oncol:6186543 Kelly CM, Shahrokni (2016) Moving beyond Karnofsky and ECOG performance status assessments with new technologies. J Oncol:6186543
13.
Zurück zum Zitat Fleiss JL, Levin B, Paik MC (eds) (2003) Statistical methods for rates and proportions, 3rd edn. John wiley & Sons, Inc., Hoboken Fleiss JL, Levin B, Paik MC (eds) (2003) Statistical methods for rates and proportions, 3rd edn. John wiley & Sons, Inc., Hoboken
15.
Zurück zum Zitat Nunally JC (ed) (1978) Psychometric theory. McGraw-Hill, New York Nunally JC (ed) (1978) Psychometric theory. McGraw-Hill, New York
16.
Zurück zum Zitat Landis JR, Koch GC (1977) The measurement of observer agreement for categorical data. Biometrics 33:159–174CrossRef Landis JR, Koch GC (1977) The measurement of observer agreement for categorical data. Biometrics 33:159–174CrossRef
18.
Zurück zum Zitat Guyatt GH, Oxman AD, Vist GE, Kunz R, Falck-Ytter Y, Alonso-Coello P, Schünemann HJ, GRADE Working Group (2008) GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. BMJ 336:924–926CrossRef Guyatt GH, Oxman AD, Vist GE, Kunz R, Falck-Ytter Y, Alonso-Coello P, Schünemann HJ, GRADE Working Group (2008) GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. BMJ 336:924–926CrossRef
19.
Zurück zum Zitat Hutchinson TA, Boyd NF, Feinstein AR (1979) Scientific problems in clinical scales, as demonstrated in the Karnofsky index of performance status. J Chronic Dis 32:661–666CrossRef Hutchinson TA, Boyd NF, Feinstein AR (1979) Scientific problems in clinical scales, as demonstrated in the Karnofsky index of performance status. J Chronic Dis 32:661–666CrossRef
20.
Zurück zum Zitat Schag CC, Heinrich RL, Ganz PA (1984) Karnofsky performance status revisited: reliability, validity and guidelines. J Clin Oncol 2:187–193CrossRef Schag CC, Heinrich RL, Ganz PA (1984) Karnofsky performance status revisited: reliability, validity and guidelines. J Clin Oncol 2:187–193CrossRef
21.
Zurück zum Zitat Conill C, Verge E, Salamero M (1990) Performance status assessment in cancer patients. Cancer 65:1864–1866CrossRef Conill C, Verge E, Salamero M (1990) Performance status assessment in cancer patients. Cancer 65:1864–1866CrossRef
22.
Zurück zum Zitat Roila F, Lupattelli M, Sassi M, Basurto C, Bracarda S, Picciafuoco M, Boschetti E, Milella G, Ballatori E, Tonato M (1991) Intra- and inter-observer variability in cancer patients’ performance status assessed according to Karnofsky and ECO scales. Ann Oncol 2:437–439CrossRef Roila F, Lupattelli M, Sassi M, Basurto C, Bracarda S, Picciafuoco M, Boschetti E, Milella G, Ballatori E, Tonato M (1991) Intra- and inter-observer variability in cancer patients’ performance status assessed according to Karnofsky and ECO scales. Ann Oncol 2:437–439CrossRef
23.
Zurück zum Zitat Sorenson JB, Klee M, Palshof T et al (1993) Performance status assessment in cancer patients. An inter-observer variability study. Br J Cancer 159:1988–1992 Sorenson JB, Klee M, Palshof T et al (1993) Performance status assessment in cancer patients. An inter-observer variability study. Br J Cancer 159:1988–1992
24.
Zurück zum Zitat Fantoni M, Izzi I, Del Borgo C et al (1999) Inter-rater reliability of a modified Karnofsky scale of performance status for HIV-infected individuals. AIDS Patient Care STDs 13:23–28CrossRef Fantoni M, Izzi I, Del Borgo C et al (1999) Inter-rater reliability of a modified Karnofsky scale of performance status for HIV-infected individuals. AIDS Patient Care STDs 13:23–28CrossRef
25.
Zurück zum Zitat Taylor AE, Olver IN, Sivanthan T, Chi M, Purnell C (1999) Observer error in grading performance status in cancer patients. Support Care Cancer 7:332–335CrossRef Taylor AE, Olver IN, Sivanthan T, Chi M, Purnell C (1999) Observer error in grading performance status in cancer patients. Support Care Cancer 7:332–335CrossRef
26.
Zurück zum Zitat Ando M, Ando Y, Hasegawa Y, Shimokata K, Minami H, Wakai K, Ohno Y, Sakai S (2001) Prognostic value of performance status assessed by patients themselves, nurses, and oncologists in advanced non-small cell lung cancer. Br J Cancer 85:1634–1639CrossRef Ando M, Ando Y, Hasegawa Y, Shimokata K, Minami H, Wakai K, Ohno Y, Sakai S (2001) Prognostic value of performance status assessed by patients themselves, nurses, and oncologists in advanced non-small cell lung cancer. Br J Cancer 85:1634–1639CrossRef
27.
Zurück zum Zitat Liem BJ, Holland JM, Kang MY et al (2002) Karnofsky performance status assessment: resident versus attending. J Cancer Educ 17:138–141PubMed Liem BJ, Holland JM, Kang MY et al (2002) Karnofsky performance status assessment: resident versus attending. J Cancer Educ 17:138–141PubMed
28.
Zurück zum Zitat de Borja MT, Chow E, Bovett G et al (2004) The correlation among patients and health care professionals in assessing functional status using the Karnofsky and eastern cooperative oncology group performance status scales. Support Cancer Ther 2:59–63CrossRef de Borja MT, Chow E, Bovett G et al (2004) The correlation among patients and health care professionals in assessing functional status using the Karnofsky and eastern cooperative oncology group performance status scales. Support Cancer Ther 2:59–63CrossRef
29.
Zurück zum Zitat Campos S, Zhang L, Sinclair E, Tsao M, Barnes EA, Danjoux C, Sahgal A, Goh P, Culleton S, Mitera G, Chow E (2009) The palliative performance scale: examining its inter-rater reliability in an outpatient palliative radiation oncology clinic. Support Care Cancer 17:685–690CrossRef Campos S, Zhang L, Sinclair E, Tsao M, Barnes EA, Danjoux C, Sahgal A, Goh P, Culleton S, Mitera G, Chow E (2009) The palliative performance scale: examining its inter-rater reliability in an outpatient palliative radiation oncology clinic. Support Care Cancer 17:685–690CrossRef
30.
Zurück zum Zitat Zimmermann C, Burman D, Bandukwala S, Seccareccia D, Kaya E, Bryson J, Rodin G, Lo C (2010) Nurse and physician inter-rater agreement of three performance status measures in palliative care outpatients. Support Care Cancer 18:609–616CrossRef Zimmermann C, Burman D, Bandukwala S, Seccareccia D, Kaya E, Bryson J, Rodin G, Lo C (2010) Nurse and physician inter-rater agreement of three performance status measures in palliative care outpatients. Support Care Cancer 18:609–616CrossRef
31.
Zurück zum Zitat Kim YJ, Hui D, Zhang Y et al. Difference in performance status assessments between palliative care specialists, nurses and oncologists. J Pain Symptom Manag 2015; 49: 1050–1058.e2 Kim YJ, Hui D, Zhang Y et al. Difference in performance status assessments between palliative care specialists, nurses and oncologists. J Pain Symptom Manag 2015; 49: 1050–1058.e2
32.
Zurück zum Zitat Neeman E, Gresham G, Ovasapians N et al (2019) Comparing physician and nurse eastern cooperative oncology group performance status (ECOG-PS) ratings as predictors of clinical outcomes in patients with Cancer. Oncologist 24:1–7CrossRef Neeman E, Gresham G, Ovasapians N et al (2019) Comparing physician and nurse eastern cooperative oncology group performance status (ECOG-PS) ratings as predictors of clinical outcomes in patients with Cancer. Oncologist 24:1–7CrossRef
33.
Zurück zum Zitat May CH, Lester JF, Lee S (2012) PS score discordance and why it matters. Lung Cancer 75:S18CrossRef May CH, Lester JF, Lee S (2012) PS score discordance and why it matters. Lung Cancer 75:S18CrossRef
34.
Zurück zum Zitat Addy C, Sephton M, Suntharalingam J et al (2012) Assessment of performance status in long cancer: do oncologists and respiratory physicians agree? Lung Cancer 75:S17–S18CrossRef Addy C, Sephton M, Suntharalingam J et al (2012) Assessment of performance status in long cancer: do oncologists and respiratory physicians agree? Lung Cancer 75:S17–S18CrossRef
Metadaten
Titel
Inter-rater reliability in performance status assessment among healthcare professionals: an updated systematic review and meta-analysis
verfasst von
Ronald Chow
Eduardo Bruera
Jennifer S. Temel
Monica Krishnan
James Im
Michael Lock
Publikationsdatum
01.05.2020
Verlag
Springer Berlin Heidelberg
Erschienen in
Supportive Care in Cancer / Ausgabe 5/2020
Print ISSN: 0941-4355
Elektronische ISSN: 1433-7339
DOI
https://doi.org/10.1007/s00520-019-05261-7

Neu im Fachgebiet Onkologie

Fortgeschrittenes Melanom: Wann den Checkpoint-Inhibitor absetzen?

Eine ICI-Therapie sollte bei Betroffenen mit fortgeschrittenem Melanom mindestens ein Jahr fortgesetzt werden. Bei anhaltendem Ansprechen kann danach offenbar ohne hohes Risiko ein Therapieabbruch erwogen werden.

Positive Phase IIb-Studie zu mRNA-gestützter CAR-T bei Myasthenia gravis

Eine auf das B-Zell-Reifungsantigen gerichtete mRNA-basierte CAR-T-Zell-Therapie wurde jetzt in einer ersten Phase IIb-Studie zur Behandlung der generalisierten Myasthenia gravis mit Placebo verglichen.

NSCLC: Hirnmetastasen durch elektrische Felder eindämmen

Zur Behandlung von Hirnmetasen bei nicht-kleinzelligem Lungenkrebs (NSCLC) stehen verschiedene Optionen zur Verfügung. TTFields – eine lokoregionäre, nicht-invasive physikalische Therapie – könnte sich hier einreihen.

Kontrollkoloskopie nach Polypektomie: Wann ist eine zweite Untersuchung nötig?

Wann benötigen polypektomierte Patienten und Patientinnen mehr als eine endoskopische Nachsorgeuntersuchung? Eine Kohortenstudie aus Großbritannien legt eine konkrete Strategie nahe.

Update Onkologie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.