The online version of this article (doi:10.1186/1471-2288-14-8) contains supplementary material, which is available to authorized users.
The authors declare that they have no competing interests.
CEP and BSRP conceived the study. CPS and FT identified the studies. CEP, CPS, and BSRP extracted the data. CEP and EMB evaluated the quality of the studies according to the COSMIN checklist. CEP and ECC performed the analyses. CEP, ECC, RVML, EMB, and BSRP drafted the manuscript. All authors read and approved the final manuscript.
Patient-reported outcome validation needs to achieve validity and reliability standards. Among reliability analysis parameters, test-retest reliability is an important psychometric property. Retested patients must be in a clinically stable condition. This is particularly problematic in palliative care (PC) settings because advanced cancer patients are prone to a faster rate of clinical deterioration. The aim of this study was to evaluate the methods by which multi-symptom and health-related qualities of life (HRQoL) based on patient-reported outcomes (PROs) have been validated in oncological PC settings with regards to test-retest reliability.
A systematic search of PubMed (1966 to June 2013), EMBASE (1980 to June 2013), PsychInfo (1806 to June 2013), CINAHL (1980 to June 2013), and SCIELO (1998 to June 2013), and specific PRO databases was performed. Studies were included if they described a set of validation studies. Studies were included if they described a set of validation studies for an instrument developed to measure multi-symptom or multidimensional HRQoL in advanced cancer patients under PC. The COSMIN checklist was used to rate the methodological quality of the study designs.
We identified 89 validation studies from 746 potentially relevant articles. From those 89 articles, 31 measured test-retest reliability and were included in this review. Upon critical analysis of the overall quality of the criteria used to determine the test-retest reliability, 6 (19.4%), 17 (54.8%), and 8 (25.8%) of these articles were rated as good, fair, or poor, respectively, and no article was classified as excellent. Multi-symptom instruments were retested over a shortened interval when compared to the HRQoL instruments (median values 24 hours and 168 hours, respectively; p = 0.001). Validation studies that included objective confirmation of clinical stability in their design yielded better results for the test-retest analysis with regard to both pain and global HRQoL scores (p < 0.05). The quality of the statistical analysis and its description were of great concern.
Test-retest reliability has been infrequently and poorly evaluated. The confirmation of clinical stability was an important factor in our analysis, and we suggest that special attention be focused on clinical stability when designing a PRO validation study that includes advanced cancer patients under PC.
The Patient-Reported Outcome and Quality of Life Instrument Database (PROQOLID). http://www.proqolid.org/,
Australian Centre on Quality of Life (ACQOL). http://www.deakin.edu.au/research/acqol/index.php,
Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, Bouter LM, de Vet HC: The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study. Qual Life Res. 2010, 19 (4): 539-549. 10.1007/s11136-010-9606-8. CrossRefPubMedPubMedCentral
Llobera J, Esteva M, Benito E, Terrasa J, Rifa J, Pons O, Maya A: Quality of life for oncology patients during the terminal period. Validation of the HRCA-QL index. Support Care Cancer. 2003, 11 (5): 294-303. PubMed
Lopes Ferreira P, Pinto Barros A: Measuring quality of life in palliative care. Acta Med Port. 2008, 21 (2): 111-124. PubMed
Suarez-del-Real Y, Allende-Perez S, Alferez-Mancera A, Rodriguez RB, Jimenez-Toxtle S, Mohar A, Onate-Ocana LF: Validation of the Mexican-Spanish version of the EORTC QLQ-C15-PAL questionnaire for the evaluation of health-related quality of life in patients on palliative care. Psychooncology. 2011, 20 (8): 889-896. 10.1002/pon.1801. CrossRefPubMed
Kim KU, Yoon SJ, Lee JL, Ahn HS, Park HJ, Lee SI, Jo MW: Validation of the Korean version of the McMaster Quality of Life Scale in terminal cancer patients. J Palliat Care. 2006, 22 (1): 40-45. PubMed
Serra-Prat M, Nabal M, Santacruz V, Picaza JM, Trelis J, Grupo Catalan de Estudio de la Efectividad de los Cuidados P: Validation of the Spanish version of the palliative care outcome scale. Med Clin. 2004, 123 (11): 406-412. CrossRef
Harding R, Selman L, Agupio G, Dinat N, Downing J, Gwyther L, Mashao T, Mmoledi K, Moll T, Sebuyira LM, et al: Validation of a core outcome measure for palliative care in Africa: the APCA African Palliative Outcome Scale. Health Qual Life Outcomes. 2010, 8: 10-10.1186/1477-7525-8-10. CrossRefPubMedPubMedCentral
Wilson KG, Graham ID, Viola RA, Chater S, de Faye BJ, Weaver LA, Lachance JA: Structured interview assessment of symptoms and concerns in palliative care. Can J Psychiatry. 2004, 49 (6): 350-358. PubMed
Stiel S, Matthes ME, Bertram L, Ostgathe C, Elsner F, Radbruch L: Validation of the new version of the minimal documentation system (MIDOS) for patients in palliative care : the German version of the edmonton symptom assessment scale (ESAS). Schmerz. 2010, 24 (6): 596-604. 10.1007/s00482-010-0972-5. CrossRefPubMed
Pereira F, Santos C: Estudo de adaptação cultural e validação da Functional Assessment of Cancer Therapy-General em cuidados paliativos. Rev Enferm Referênci. 2011, 5: 10-
Sterkenburg CA, King B, Woodward CA: A reliability and validity study of the McMaster Quality of Life Scale (MQLS) for a palliative population. J Palliat Care. 1996, 12 (1): 18-25. PubMed
Fayers P, Machin D: Quality of Life. Assessment, Analysis and Interpretation. 2007, Chichester: John Wiley, 2
The COSMIN checklist manual. http://www.cosmin.nl,
Streiner DL, Norman GR: Health Measurement Scales. A Practical Guide to Their Development and use. 2008, New York: Oxford University Press, 4 CrossRef
Werner MU, Petersen MA, Bischoff JM: Test-retest studies in quantitative sensory testing: a critical review. Acta Anaestheriol Scand. 2013, 57 (8): 957-963. 10.1111/aas.12150. CrossRef
- A critical analysis of test-retest reliability in instrument validation studies of cancer patients under palliative care: a systematic review
Carlos Eduardo Paiva
Eliane Marçon Barroso
Estela Cristina Carneseca
Cristiano de Pádua Souza
Felipe Thomé dos Santos
Rossana Verónica Mendoza López
Sakamoto Bianca Ribeiro Paiva
- BioMed Central
Neu im Fachgebiet AINS
Meistgelesene Bücher aus dem Fachgebiet AINS
Mail Icon II