Skip to main content
Erschienen in: Journal of Anesthesia 2/2018

13.02.2018 | Original Article

Interrater variability in ASA physical status assignment: an analysis in the pediatric cancer setting

verfasst von: Luis E. Tollinche, Gloria Yang, Kay-See Tan, Ruth Borchardt

Erschienen in: Journal of Anesthesia | Ausgabe 2/2018

Einloggen, um Zugang zu erhalten

Abstract

Background

The American Society of Anesthesiologists (ASA) physical status is a universal classification system that helps clinicians to categorize their patients preoperatively. However, there is a lack of both inter-rater and intra-rater reliability among clinicians for the ASA physical status classification. Our study focuses on testing these reliabilities within pediatric anesthesia providers in the cancer setting.

Methods

In our retrospective observational study, a total of 1177 anesthesia records were reviewed. The cohort included all pediatric patients (≤ 18 years old) diagnosed with either retinoblastoma or neuroblastoma who had two or more anesthesia procedure within a 14-day time period.

Results

Overall, the ASA physical status score among two different anesthesia providers for the same patient treated at different times had very little inter-rater reliability, κ = − 0.042 (95% CI − 0.17; 0.09). Of the 1177-patient anesthesia records, only 25% had two or more ASA physical status score assigned by the same anesthesiologist within a 14-day time period. There was moderate intra-rater reliability κ = 0.48 (95% CI 0.29; 0.68) for patients who were assigned an ASA physical status score by the identical anesthesia provider at different times points within a 14 day period.

Conclusion

In contrast to observations in earlier studies, findings indicate poor agreement in inter-rater reliability. Although there was moderate agreement in intra-rater reliability, one would expect to find stronger, even perfect, intra-rater reliability. These findings suggest the need to develop a specific physical status classification system directed toward patients with a systemic illness such as cancer in both young and adult patients.
Literatur
2.
Zurück zum Zitat Burgoyne LL, Smeltzer MP, Pereiras LA, Norris AL, De Armendi AJ. How well do pediatric anesthesiologists agree when assigning ASA physical status classifications to their patients? Paediatr Anaesth. 2007;17(10):956–62.CrossRefPubMed Burgoyne LL, Smeltzer MP, Pereiras LA, Norris AL, De Armendi AJ. How well do pediatric anesthesiologists agree when assigning ASA physical status classifications to their patients? Paediatr Anaesth. 2007;17(10):956–62.CrossRefPubMed
3.
Zurück zum Zitat Ranta S, Hynynen M, Tammisto T. A survey of the ASA physical status classification: significant variation in allocation among Finnish anaesthesiologists. Acta Anaesthesiol Scand. 1997;41(5):629–32.CrossRefPubMed Ranta S, Hynynen M, Tammisto T. A survey of the ASA physical status classification: significant variation in allocation among Finnish anaesthesiologists. Acta Anaesthesiol Scand. 1997;41(5):629–32.CrossRefPubMed
4.
Zurück zum Zitat Riley R, Holman C, Fletcher D. Inter-rater reliability of the ASA physical status classification in a sample of anaesthetists in Western Australia. Anaesth Intensive Care. 2014;42(5):614–8.PubMed Riley R, Holman C, Fletcher D. Inter-rater reliability of the ASA physical status classification in a sample of anaesthetists in Western Australia. Anaesth Intensive Care. 2014;42(5):614–8.PubMed
5.
Zurück zum Zitat Mak PH, Campbell RC, Irwin MG, American Society of A. The ASA physical status classification: inter-observer consistency. American Society of Anesthesiologists. Anaesth Intensive Care. 2002;30(5):633–40.PubMed Mak PH, Campbell RC, Irwin MG, American Society of A. The ASA physical status classification: inter-observer consistency. American Society of Anesthesiologists. Anaesth Intensive Care. 2002;30(5):633–40.PubMed
6.
Zurück zum Zitat Ringdal KG, Skaga NO, Steen PA, Hestnes M, Laake P, Jones JM, Lossius HM. Classification of comorbidity in trauma: the reliability of pre-injury ASA physical status classification. Injury. 2013;44(1):29–35CrossRefPubMed Ringdal KG, Skaga NO, Steen PA, Hestnes M, Laake P, Jones JM, Lossius HM. Classification of comorbidity in trauma: the reliability of pre-injury ASA physical status classification. Injury. 2013;44(1):29–35CrossRefPubMed
7.
Zurück zum Zitat Ihejirika RC, Thakore RV, Sathiyakumar V, Ehrenfeld JM, Obremskey WT, Sethi MK. An assessment of the inter-rater reliability of the ASA physical status score in the orthopaedic trauma population. Injury. 2015;46(4):542–6.CrossRefPubMed Ihejirika RC, Thakore RV, Sathiyakumar V, Ehrenfeld JM, Obremskey WT, Sethi MK. An assessment of the inter-rater reliability of the ASA physical status score in the orthopaedic trauma population. Injury. 2015;46(4):542–6.CrossRefPubMed
8.
Zurück zum Zitat Cohen J. A coefficient of agreement for nominal scales. Educ Psychol Meas. 1960;20(1):37–46.CrossRef Cohen J. A coefficient of agreement for nominal scales. Educ Psychol Meas. 1960;20(1):37–46.CrossRef
9.
Zurück zum Zitat Cohen J. Weighted kappa: nominal scale agreement with provision for scaled disagreement or partial credit. Psychol Bull. 1968;70(4):213–20.CrossRefPubMed Cohen J. Weighted kappa: nominal scale agreement with provision for scaled disagreement or partial credit. Psychol Bull. 1968;70(4):213–20.CrossRefPubMed
10.
Zurück zum Zitat Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33(1):159–74.CrossRefPubMed Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33(1):159–74.CrossRefPubMed
11.
Zurück zum Zitat Sankar A, Johnson SR, Beattie WS, Tait G, Wijeysundera DN. Reliability of the American Society of Anesthesiologists physical status scale in clinical practice. Br J Anaesth. 2014;113(3):424–32.CrossRefPubMedPubMedCentral Sankar A, Johnson SR, Beattie WS, Tait G, Wijeysundera DN. Reliability of the American Society of Anesthesiologists physical status scale in clinical practice. Br J Anaesth. 2014;113(3):424–32.CrossRefPubMedPubMedCentral
12.
Zurück zum Zitat McHugh ML. Interrater reliability: the kappa statistic. Biochem Med (Zagreb). 2012;22(3):276–82.CrossRef McHugh ML. Interrater reliability: the kappa statistic. Biochem Med (Zagreb). 2012;22(3):276–82.CrossRef
13.
Zurück zum Zitat Hurwitz EE, Simon M, Vinta SR, Zehm CF, Shabot SM, Minhajuddin A, Abouleish AE. Adding examples to the ASA-physical status classification improves correct assignment to patients. Anesthesiology. 2017;126(4):614–22CrossRefPubMed Hurwitz EE, Simon M, Vinta SR, Zehm CF, Shabot SM, Minhajuddin A, Abouleish AE. Adding examples to the ASA-physical status classification improves correct assignment to patients. Anesthesiology. 2017;126(4):614–22CrossRefPubMed
14.
Zurück zum Zitat Goodhart IM, Andrzejowski JC, Jones GL, Berthoud M, Dennis A, Mills GH. Patient-completed, preoperative web-based anaesthetic assessment. Eur J Anesthesiology (EJA). 2017;34(4):221–228CrossRef Goodhart IM, Andrzejowski JC, Jones GL, Berthoud M, Dennis A, Mills GH. Patient-completed, preoperative web-based anaesthetic assessment. Eur J Anesthesiology (EJA). 2017;34(4):221–228CrossRef
15.
Zurück zum Zitat Sweitzer B. Three wise men (× 2) and the ASA-physical status classification system. Anesthesiology. 2017;126(4):577–8.CrossRefPubMed Sweitzer B. Three wise men (× 2) and the ASA-physical status classification system. Anesthesiology. 2017;126(4):577–8.CrossRefPubMed
16.
Zurück zum Zitat Jacqueline R, Malviya S, Burke C, Reynolds P. An assessment of interrater reliability of the ASA physical status classification in pediatric surgical patients. Paediatr Anaesth. 2006;16(9):928–31.CrossRefPubMed Jacqueline R, Malviya S, Burke C, Reynolds P. An assessment of interrater reliability of the ASA physical status classification in pediatric surgical patients. Paediatr Anaesth. 2006;16(9):928–31.CrossRefPubMed
17.
Zurück zum Zitat Aplin S, Baines D, De Lima J. Use of the ASA physical status grading system in pediatric practice. Paediatr Anaesth. 2007;17(3):216–22.CrossRefPubMed Aplin S, Baines D, De Lima J. Use of the ASA physical status grading system in pediatric practice. Paediatr Anaesth. 2007;17(3):216–22.CrossRefPubMed
18.
Zurück zum Zitat Reed JF 3rd. Homogeneity of kappa statistics in multiple samples. Comput Methods Progr Biomed. 2000;63(1):43–6.CrossRef Reed JF 3rd. Homogeneity of kappa statistics in multiple samples. Comput Methods Progr Biomed. 2000;63(1):43–6.CrossRef
19.
Zurück zum Zitat Nasr VG, DiNardo JA, Faraoni D. Development of a pediatric risk assessment score to predict perioperative mortality in children undergoing noncardiac surgery. Anesth Analg. 2017;124(5):1514–9.CrossRefPubMed Nasr VG, DiNardo JA, Faraoni D. Development of a pediatric risk assessment score to predict perioperative mortality in children undergoing noncardiac surgery. Anesth Analg. 2017;124(5):1514–9.CrossRefPubMed
20.
Zurück zum Zitat Faraoni D, Vo D, Nasr VG, DiNardo JA. Development and validation of a risk stratification score for children with congenital heart disease undergoing noncardiac surgery. Anesth Analg. 2016;123(4):824–30.CrossRefPubMed Faraoni D, Vo D, Nasr VG, DiNardo JA. Development and validation of a risk stratification score for children with congenital heart disease undergoing noncardiac surgery. Anesth Analg. 2016;123(4):824–30.CrossRefPubMed
Metadaten
Titel
Interrater variability in ASA physical status assignment: an analysis in the pediatric cancer setting
verfasst von
Luis E. Tollinche
Gloria Yang
Kay-See Tan
Ruth Borchardt
Publikationsdatum
13.02.2018
Verlag
Springer Japan
Erschienen in
Journal of Anesthesia / Ausgabe 2/2018
Print ISSN: 0913-8668
Elektronische ISSN: 1438-8359
DOI
https://doi.org/10.1007/s00540-018-2463-2

Weitere Artikel der Ausgabe 2/2018

Journal of Anesthesia 2/2018 Zur Ausgabe

Tipps für den Umgang mit Behandlungsfehlern

01.05.2024 DGIM 2024 Kongressbericht

Es ist nur eine Frage der Zeit, bis es zu einem Zwischenfall kommt und ein Behandlungsfehler passiert. Doch wenn Ärztinnen und Ärzte gut vorbereitet sind, schaffen es alle Beteiligten den Umständen entsprechend gut durch diese Krise. 

Sind Frauen die fähigeren Ärzte?

30.04.2024 Gendermedizin Nachrichten

Patienten, die von Ärztinnen behandelt werden, dürfen offenbar auf bessere Therapieergebnisse hoffen als Patienten von Ärzten. Besonders gilt das offenbar für weibliche Kranke, wie eine Studie zeigt.

Akuter Schwindel: Wann lohnt sich eine MRT?

28.04.2024 Schwindel Nachrichten

Akuter Schwindel stellt oft eine diagnostische Herausforderung dar. Wie nützlich dabei eine MRT ist, hat eine Studie aus Finnland untersucht. Immerhin einer von sechs Patienten wurde mit akutem ischämischem Schlaganfall diagnostiziert.

Bei schweren Reaktionen auf Insektenstiche empfiehlt sich eine spezifische Immuntherapie

Insektenstiche sind bei Erwachsenen die häufigsten Auslöser einer Anaphylaxie. Einen wirksamen Schutz vor schweren anaphylaktischen Reaktionen bietet die allergenspezifische Immuntherapie. Jedoch kommt sie noch viel zu selten zum Einsatz.

Update AINS

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.