Skip to main content
Erschienen in: Supportive Care in Cancer 11/2007

01.11.2007 | Short Communication

Intraclass correlation metrics for the accuracy of algorithmic definitions in a computerized decision support system for supportive cancer care

verfasst von: Matti Aapro, Ivo Abraham, Karen MacDonald, Pierre Soubeyran, Jan Foubert, Carsten Bokemeyer, Michael Muenzberg, Joanna Van Erps, Matthew Turner

Erschienen in: Supportive Care in Cancer | Ausgabe 11/2007

Einloggen, um Zugang zu erhalten

Abstract

As part of the development of a computerized clinical decision support system for anemia management in cancer patients, we applied psychometric principles and techniques to assess the accuracy of the algorithmic operationalizations of a set of evidence-based practice guidelines. In an iterative rating process, five medical and nursing experts rated 27 algorithmic sets derived from 18 guidelines, the objective being an intraclass coefficient (ICC) exceeding 0.90. The first round of review yielded an ICC of 1.00 for 22 sets. After revision and resubmission to the expert panel, an ICC of 1.00 was obtained for the additional five sets. The evolving decision support system is based on algorithms that accurately specify evidence-based guidelines for anemia management in cancer patients.
Literatur
1.
Zurück zum Zitat Bates DW, Kuperman GJ, Wang S, Gandhi T, Kittler A, Volk I et al (2003) Ten commandments for effective clinical decision support: making the practice of evidence-based medicine a reality. J Am Med Inform Assoc 10:523–530PubMedCrossRef Bates DW, Kuperman GJ, Wang S, Gandhi T, Kittler A, Volk I et al (2003) Ten commandments for effective clinical decision support: making the practice of evidence-based medicine a reality. J Am Med Inform Assoc 10:523–530PubMedCrossRef
2.
Zurück zum Zitat Bokemeyer C, Aapro MS, Courdi A, Foubert J, Link H, Ősterborg A et al (2004) EORTC guidelines for the use of erythropoietic proteins in anaemic patients with cancer. Eur J Cancer 40:2201–2216PubMedCrossRef Bokemeyer C, Aapro MS, Courdi A, Foubert J, Link H, Ősterborg A et al (2004) EORTC guidelines for the use of erythropoietic proteins in anaemic patients with cancer. Eur J Cancer 40:2201–2216PubMedCrossRef
3.
Zurück zum Zitat Bokemeyer C, Aapro MS, Courdi A, Foubert J, Link H, Ősterborg A et al (2006) EORTC guidelines for the use of erythropoietic proteins in anaemic patients with cancer: 2006 update. Eur J Cancer 43(2):258–270PubMedCrossRef Bokemeyer C, Aapro MS, Courdi A, Foubert J, Link H, Ősterborg A et al (2006) EORTC guidelines for the use of erythropoietic proteins in anaemic patients with cancer: 2006 update. Eur J Cancer 43(2):258–270PubMedCrossRef
4.
Zurück zum Zitat Cella D (1998) Factors influencing quality of life in cancer patients: anemia and fatigue. Sem Oncol 25(3 Suppl 7):43–46 Cella D (1998) Factors influencing quality of life in cancer patients: anemia and fatigue. Sem Oncol 25(3 Suppl 7):43–46
5.
Zurück zum Zitat Eddy DM (2005) Evidence-based medicine: a unified approach. Health Aff 24:9–17CrossRef Eddy DM (2005) Evidence-based medicine: a unified approach. Health Aff 24:9–17CrossRef
6.
Zurück zum Zitat Kawamoto K, Houlihan CA, Balas EA, Lobach DF (2005) Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success. Br Med J 330:775–782CrossRef Kawamoto K, Houlihan CA, Balas EA, Lobach DF (2005) Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success. Br Med J 330:775–782CrossRef
7.
Zurück zum Zitat Ludwig H, Van Belle S, Barrett-Lee P, Birgegard G, Bokemeyer C, Gascon P et al (2004) The European Cancer Anaemia Study (ECAS): a large, multinational, prospective study defining the prevalence, incidence, and treatment of anaemia in cancer patients. Eur J Cancer 40:2293–2306PubMedCrossRef Ludwig H, Van Belle S, Barrett-Lee P, Birgegard G, Bokemeyer C, Gascon P et al (2004) The European Cancer Anaemia Study (ECAS): a large, multinational, prospective study defining the prevalence, incidence, and treatment of anaemia in cancer patients. Eur J Cancer 40:2293–2306PubMedCrossRef
8.
Zurück zum Zitat Nunnally JC, Bernstein I (1994) Psychometric theory, 3rd ed. McGraw-Hill, New York Nunnally JC, Bernstein I (1994) Psychometric theory, 3rd ed. McGraw-Hill, New York
9.
Zurück zum Zitat Park HM, Jung HW (2003) Evaluating interrater agreement with intraclass correlation coefficient in SPICE-based software process assessment. In: IEEE proceedings of the third international conference on quality software. IEEE, Washington, DC Park HM, Jung HW (2003) Evaluating interrater agreement with intraclass correlation coefficient in SPICE-based software process assessment. In: IEEE proceedings of the third international conference on quality software. IEEE, Washington, DC
10.
Zurück zum Zitat Rizzo JD, Lichtin AE, Woolf SH, Seidenfeld J, Bennett CL, Cella D et al (2002) Use of epoetin in patients with cancer: evidence-based clinical practice guidelines of the American Society of Clinical Oncology and the American Society of Hematology. J Clin Oncol 20:4083–4107PubMedCrossRef Rizzo JD, Lichtin AE, Woolf SH, Seidenfeld J, Bennett CL, Cella D et al (2002) Use of epoetin in patients with cancer: evidence-based clinical practice guidelines of the American Society of Clinical Oncology and the American Society of Hematology. J Clin Oncol 20:4083–4107PubMedCrossRef
11.
Zurück zum Zitat Shiffman RN, Brandt CA, Liaw Y, Corb GJ (1999) A design model for computer-based guideline implementation based on information management services. J Am Med Inform Assoc 6:99–103PubMed Shiffman RN, Brandt CA, Liaw Y, Corb GJ (1999) A design model for computer-based guideline implementation based on information management services. J Am Med Inform Assoc 6:99–103PubMed
12.
Zurück zum Zitat Sim I, Gorman P, Greenes RA, Haynes RB, Kaplan B, Lehmann H et al (2001) Clinical decision support systems for the practice of evidence-based medicine. J Am Med Inform Assoc 8:527–534PubMed Sim I, Gorman P, Greenes RA, Haynes RB, Kaplan B, Lehmann H et al (2001) Clinical decision support systems for the practice of evidence-based medicine. J Am Med Inform Assoc 8:527–534PubMed
13.
Zurück zum Zitat Timmermans S, Mauck A (2005) The promises and pitfalls of evidence-based medicine. Health Aff 24:18–28CrossRef Timmermans S, Mauck A (2005) The promises and pitfalls of evidence-based medicine. Health Aff 24:18–28CrossRef
Metadaten
Titel
Intraclass correlation metrics for the accuracy of algorithmic definitions in a computerized decision support system for supportive cancer care
verfasst von
Matti Aapro
Ivo Abraham
Karen MacDonald
Pierre Soubeyran
Jan Foubert
Carsten Bokemeyer
Michael Muenzberg
Joanna Van Erps
Matthew Turner
Publikationsdatum
01.11.2007
Verlag
Springer-Verlag
Erschienen in
Supportive Care in Cancer / Ausgabe 11/2007
Print ISSN: 0941-4355
Elektronische ISSN: 1433-7339
DOI
https://doi.org/10.1007/s00520-007-0246-7

Weitere Artikel der Ausgabe 11/2007

Supportive Care in Cancer 11/2007 Zur Ausgabe

Nodal-negativ nach neoadjuvanter Chemo: Axilladissektion verzichtbar?

03.05.2024 Mammakarzinom Nachrichten

Wenn bei Mammakarzinomen durch eine neoadjuvante Chemotherapie ein Downstaging von nodal-positiv zu nodal-negativ gelingt, scheint es auch ohne Axilladissektion nur selten zu axillären Rezidiven zu kommen.

Wo hapert es noch bei der Umsetzung der POMGAT-Leitlinie?

03.05.2024 DCK 2024 Kongressbericht

Seit November 2023 gibt es evidenzbasierte Empfehlungen zum perioperativen Management bei gastrointestinalen Tumoren (POMGAT) auf S3-Niveau. Vieles wird schon entsprechend der Empfehlungen durchgeführt. Wo es im Alltag noch hapert, zeigt eine Umfrage in einem Klinikverbund.

Bestrahlung nach Prostatektomie: mehr Schaden als Nutzen?

02.05.2024 Prostatakarzinom Nachrichten

Eine adjuvante Radiotherapie nach radikaler Prostata-Op. bringt den Betroffenen wahrscheinlich keinen Vorteil. Im Gegenteil: Durch die Bestrahlung steigt offenbar das Risiko für Harn- und Stuhlinkontinenz.

Endlich: Zi zeigt, mit welchen PVS Praxen zufrieden sind

IT für Ärzte Nachrichten

Darauf haben viele Praxen gewartet: Das Zi hat eine Liste von Praxisverwaltungssystemen veröffentlicht, die von Nutzern positiv bewertet werden. Eine gute Grundlage für wechselwillige Ärzte und Psychotherapeuten.

Update Onkologie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.