Skip to main content
Erschienen in: World Journal of Urology 3/2018

02.01.2018 | Original Article

Inter-rater reliability in the radiological classification of renal injuries

verfasst von: Elias J. Pretorius, Amir D. Zarrabi, Stephanie Griffith-Richards, Justin Harvey, Hilgard M. Ackermann, Catharina M. Meintjes, Willem G. Cilliers, Moleen Zunza, Alexander J. Szpytko, Richard D. Pitcher

Erschienen in: World Journal of Urology | Ausgabe 3/2018

Einloggen, um Zugang zu erhalten

Abstract

Introduction

Although many radiologists invoke the surgical classification of renal injury proposed by the American Association for Surgery in Trauma (AAST), there has been only limited work on the role of the AAST system as an imaging stratification. The aim was to determine the inter-rater reliability (IRR) amongst radiologists and urologists using the AAST system.

Methods

A 1-year retrospective study of consecutive patients with computed tomography (CT) evidence of renal trauma managed at a Level 1 trauma center. Three radiologists and three urologists independently stratified the presentation CT findings according to the AAST renal trauma classification. Agreement between independent raters and mutually exclusive groups was determined utilizing weighted kappa coefficients.

Results

One hundred and one patients were included. Individual inter-observer agreements ranged from 54/101 (53.4%) to 62/101 (61.4%), with corresponding weighted kappa values from 0.61 to 0.69, constituting substantial agreement. Urologists achieved intra-disciplinary agreement in 49 cases (48.5%) and radiologists in 36 cases (35.6%). Six-reader agreement was achieved in 24 cases (23.7%). The AAST grade I injuries had the highest level of agreement, overall.

Conclusion

The finding of substantial IRR amongst radiologists and urologists utilizing the AAST system supports continued use of the broad parameters of the AAST system, with some modification in specific categories with lower agreement.
Literatur
1.
Zurück zum Zitat Kawashima A, Sandler CM, Corl FM, West OC, Tamm EP, Fishman EK et al (2001) Imaging of renal trauma: a comprehensive review. Radiogr Rev Publ Radiol Soc N Am Inc 21(3):557–574 Kawashima A, Sandler CM, Corl FM, West OC, Tamm EP, Fishman EK et al (2001) Imaging of renal trauma: a comprehensive review. Radiogr Rev Publ Radiol Soc N Am Inc 21(3):557–574
2.
Zurück zum Zitat Lee YJ, Oh SN, Rha SE, Byun JY (2007) Renal trauma. Radiol Clin N Am 45(3):581–592, ix Lee YJ, Oh SN, Rha SE, Byun JY (2007) Renal trauma. Radiol Clin N Am 45(3):581–592, ix
4.
Zurück zum Zitat Moore EE, Shackford SR, Pachter HL, McAninch JW, Browner BD, Champion HR et al (1989) Organ injury scaling: spleen, liver, and kidney. J Trauma 29(12):1664–1666CrossRefPubMed Moore EE, Shackford SR, Pachter HL, McAninch JW, Browner BD, Champion HR et al (1989) Organ injury scaling: spleen, liver, and kidney. J Trauma 29(12):1664–1666CrossRefPubMed
5.
Zurück zum Zitat Santucci RA, McAninch JW, Safir M, Mario LA, Service S, Segal MR (2001) Validation of the American Association for the surgery of trauma organ injury severity scale for the kidney. J Trauma 50(2):195–200CrossRefPubMed Santucci RA, McAninch JW, Safir M, Mario LA, Service S, Segal MR (2001) Validation of the American Association for the surgery of trauma organ injury severity scale for the kidney. J Trauma 50(2):195–200CrossRefPubMed
6.
Zurück zum Zitat Lynch TH, Martinez-Pineiro L, Plas E, Serafetinides E, Turkeri L, Santucci RA et al (2005) EAU guidelines on urological trauma. Eur Urol 47(1):1–15CrossRefPubMed Lynch TH, Martinez-Pineiro L, Plas E, Serafetinides E, Turkeri L, Santucci RA et al (2005) EAU guidelines on urological trauma. Eur Urol 47(1):1–15CrossRefPubMed
7.
Zurück zum Zitat Santucci RA, Wessells H, Bartsch G, Descotes J, Heyns CF, McAninch JW et al (2004) Evaluation and management of renal injuries: consensus statement of the renal trauma subcommittee. BJU Int 93(7):937–954CrossRefPubMed Santucci RA, Wessells H, Bartsch G, Descotes J, Heyns CF, McAninch JW et al (2004) Evaluation and management of renal injuries: consensus statement of the renal trauma subcommittee. BJU Int 93(7):937–954CrossRefPubMed
8.
Zurück zum Zitat Martinez-Pineiro L, Djakovic N, Plas E, Mor Y, Santucci RA, Serafetinidis E et al (2010) EAU guidelines on urethral trauma. Eur Urol 57(5):791–803CrossRefPubMed Martinez-Pineiro L, Djakovic N, Plas E, Mor Y, Santucci RA, Serafetinidis E et al (2010) EAU guidelines on urethral trauma. Eur Urol 57(5):791–803CrossRefPubMed
9.
Zurück zum Zitat Shariat SF, Roehrborn CG, Karakiewicz PI, Dhami G, Stage KH (2007) Evidence-based validation of the predictive value of the American Association for the surgery of trauma kidney injury scale. J Trauma 62(4):933–939CrossRefPubMed Shariat SF, Roehrborn CG, Karakiewicz PI, Dhami G, Stage KH (2007) Evidence-based validation of the predictive value of the American Association for the surgery of trauma kidney injury scale. J Trauma 62(4):933–939CrossRefPubMed
10.
Zurück zum Zitat Heller MT, Schnor N (2014) MDCT of renal trauma: correlation to AAST organ injury scale. Clin Imaging 38(4):410–417CrossRefPubMed Heller MT, Schnor N (2014) MDCT of renal trauma: correlation to AAST organ injury scale. Clin Imaging 38(4):410–417CrossRefPubMed
11.
Zurück zum Zitat Kuo RL, Eachempati SR, Makhuli MJ, Reed RL 2nd (2002) Factors affecting management and outcome in blunt renal injury. World J Surg 26(4):416–419CrossRefPubMed Kuo RL, Eachempati SR, Makhuli MJ, Reed RL 2nd (2002) Factors affecting management and outcome in blunt renal injury. World J Surg 26(4):416–419CrossRefPubMed
12.
Zurück zum Zitat Tinkoff G, Esposito TJ, Reed J, Kilgo P, Fildes J, Pasquale M et al (2008) American Association for the Surgery of Trauma Organ Injury Scale I: spleen, liver, and kidney, validation based on the National Trauma Data Bank. J Am Coll Surg 207(5):646–655CrossRefPubMed Tinkoff G, Esposito TJ, Reed J, Kilgo P, Fildes J, Pasquale M et al (2008) American Association for the Surgery of Trauma Organ Injury Scale I: spleen, liver, and kidney, validation based on the National Trauma Data Bank. J Am Coll Surg 207(5):646–655CrossRefPubMed
13.
Zurück zum Zitat Alsikafi NF, Rosenstein DI (2006) Staging, evaluation, and nonoperative management of renal injuries. Urol Clin N Am 33(1):13–19CrossRef Alsikafi NF, Rosenstein DI (2006) Staging, evaluation, and nonoperative management of renal injuries. Urol Clin N Am 33(1):13–19CrossRef
14.
Zurück zum Zitat Master VA, McAninch JW (2006) Operative management of renal injuries: parenchymal and vascular. Urol Clin N Am 3(1):21–31, v–vi Master VA, McAninch JW (2006) Operative management of renal injuries: parenchymal and vascular. Urol Clin N Am 3(1):21–31, v–vi
15.
Zurück zum Zitat Peng N, Wang X, Zhang Z, Fu S, Fan J, Zhang Y (2016) Diagnosis value of multi-slice spiral CT in renal trauma. J X-ray Sci Technol 24(5):649–655CrossRef Peng N, Wang X, Zhang Z, Fu S, Fan J, Zhang Y (2016) Diagnosis value of multi-slice spiral CT in renal trauma. J X-ray Sci Technol 24(5):649–655CrossRef
16.
Zurück zum Zitat Joseph B, Khalil M, Rhee P (2015) Penetrating injuries to the spleen and kidney: an evolution in progress. Curr Trauma Rep 1(2):76–84CrossRef Joseph B, Khalil M, Rhee P (2015) Penetrating injuries to the spleen and kidney: an evolution in progress. Curr Trauma Rep 1(2):76–84CrossRef
17.
Zurück zum Zitat Chong ST, Cherry-Bukowiec JR, Willatt JM, Kielar AZ (2016) Renal trauma: imaging evaluation and implications for clinical management. Abdom Radiol (New York) 41(8):1565–1579CrossRef Chong ST, Cherry-Bukowiec JR, Willatt JM, Kielar AZ (2016) Renal trauma: imaging evaluation and implications for clinical management. Abdom Radiol (New York) 41(8):1565–1579CrossRef
18.
Zurück zum Zitat Steenburg SD, Persohn S, Shen C, Dunkle JW, Gussick SD, Petersen MJ et al (2015) Iterative reconstruction improves image quality and preserves diagnostic accuracy in the setting of blunt solid organ injuries. Emerg Radiol 22(1):43–51CrossRefPubMed Steenburg SD, Persohn S, Shen C, Dunkle JW, Gussick SD, Petersen MJ et al (2015) Iterative reconstruction improves image quality and preserves diagnostic accuracy in the setting of blunt solid organ injuries. Emerg Radiol 22(1):43–51CrossRefPubMed
19.
20.
Zurück zum Zitat Heyns CF (2004) Renal trauma: indications for imaging and surgical exploration. BJU Int 93(8):1165–1170CrossRefPubMed Heyns CF (2004) Renal trauma: indications for imaging and surgical exploration. BJU Int 93(8):1165–1170CrossRefPubMed
21.
Zurück zum Zitat Meng MV, Brandes SB, McAninch JW (1999) Renal trauma: indications and techniques for surgical exploration. World J Urol 17(2):71–77CrossRefPubMed Meng MV, Brandes SB, McAninch JW (1999) Renal trauma: indications and techniques for surgical exploration. World J Urol 17(2):71–77CrossRefPubMed
22.
Zurück zum Zitat Heyns CF, De Klerk DP, De Kock ML (1985) Nonoperative management of renal stab wounds. J Urol 134(2):239–242CrossRefPubMed Heyns CF, De Klerk DP, De Kock ML (1985) Nonoperative management of renal stab wounds. J Urol 134(2):239–242CrossRefPubMed
23.
Zurück zum Zitat Husmann DA, Gilling PJ, Perry MO, Morris JS, Boone TB (1993) Major renal lacerations with a devitalized fragment following blunt abdominal trauma: a comparison between nonoperative (expectant) versus surgical management. J Urol 150(6):1774–1777CrossRefPubMed Husmann DA, Gilling PJ, Perry MO, Morris JS, Boone TB (1993) Major renal lacerations with a devitalized fragment following blunt abdominal trauma: a comparison between nonoperative (expectant) versus surgical management. J Urol 150(6):1774–1777CrossRefPubMed
24.
Zurück zum Zitat Hammer CC, Santucci RA (2003) Effect of an institutional policy of nonoperative treatment of grades I to IV renal injuries. J Urol 169(5):1751–1753CrossRefPubMed Hammer CC, Santucci RA (2003) Effect of an institutional policy of nonoperative treatment of grades I to IV renal injuries. J Urol 169(5):1751–1753CrossRefPubMed
25.
Zurück zum Zitat van der Wilden GM, Velmahos GC, Joseph DK et al (2013) Successful nonoperative management of the most severe blunt renal injuries: a multicenter study of the research consortium of New England centers for trauma. JAMA Surg 148(10):924–931CrossRefPubMed van der Wilden GM, Velmahos GC, Joseph DK et al (2013) Successful nonoperative management of the most severe blunt renal injuries: a multicenter study of the research consortium of New England centers for trauma. JAMA Surg 148(10):924–931CrossRefPubMed
26.
Zurück zum Zitat McCombie SP, Thyer I, Corcoran NM, Rowling C, Dyer J, Le Roux A et al (2014) The conservative management of renal trauma: a literature review and practical clinical guideline from Australia and New Zealand. BJU Int 114(Suppl 1):13–21CrossRefPubMed McCombie SP, Thyer I, Corcoran NM, Rowling C, Dyer J, Le Roux A et al (2014) The conservative management of renal trauma: a literature review and practical clinical guideline from Australia and New Zealand. BJU Int 114(Suppl 1):13–21CrossRefPubMed
27.
Zurück zum Zitat Stein DM, Santucci RA (2015) An update on urotrauma. Curr Opin Urol 25(4):323–330PubMed Stein DM, Santucci RA (2015) An update on urotrauma. Curr Opin Urol 25(4):323–330PubMed
28.
Zurück zum Zitat Moudouni SM, Hadj Slimen M, Manunta A, Patard JJ, Guiraud PH, Guille F et al (2001) Management of major blunt renal lacerations: is a nonoperative approach indicated? Eur Urol 40(4):409–414CrossRefPubMed Moudouni SM, Hadj Slimen M, Manunta A, Patard JJ, Guiraud PH, Guille F et al (2001) Management of major blunt renal lacerations: is a nonoperative approach indicated? Eur Urol 40(4):409–414CrossRefPubMed
29.
Zurück zum Zitat Matthews LA, Smith EM, Spirnak JP (1997) Nonoperative treatment of major blunt renal lacerations with urinary extravasation. J Urol 157(6):2056–2058CrossRefPubMed Matthews LA, Smith EM, Spirnak JP (1997) Nonoperative treatment of major blunt renal lacerations with urinary extravasation. J Urol 157(6):2056–2058CrossRefPubMed
30.
Zurück zum Zitat Traub KB, Hua V, Broman S, Stage KH (2001) Introduction of a genitourinary trauma database for use as a multi-institutional urologic trauma registry. J Trauma 51(2):336–339CrossRefPubMed Traub KB, Hua V, Broman S, Stage KH (2001) Introduction of a genitourinary trauma database for use as a multi-institutional urologic trauma registry. J Trauma 51(2):336–339CrossRefPubMed
31.
Zurück zum Zitat Santucci RA (2016) 2015 William Hunter Harridge lecture: how did we go from operating on nearly all injured kidneys to operating on almost none of them? Am J Surg 211(3):501–505CrossRefPubMed Santucci RA (2016) 2015 William Hunter Harridge lecture: how did we go from operating on nearly all injured kidneys to operating on almost none of them? Am J Surg 211(3):501–505CrossRefPubMed
32.
Zurück zum Zitat Chakraverty S, Zealley I, Kessel D (2014) Damage control radiology in the severely injured patient: what the anaesthetist needs to know. Br J Anaesth 113(2):250–257CrossRefPubMed Chakraverty S, Zealley I, Kessel D (2014) Damage control radiology in the severely injured patient: what the anaesthetist needs to know. Br J Anaesth 113(2):250–257CrossRefPubMed
33.
Zurück zum Zitat Kawashima A, Vrtiska TJ, LeRoy AJ, Hartman RP, McCollough CH, Bernard F, King J (2004) CT Urography. Radiogr Rev Publ Radiol Soc N Am Inc 24(suppl1):S35–S54 Kawashima A, Vrtiska TJ, LeRoy AJ, Hartman RP, McCollough CH, Bernard F, King J (2004) CT Urography. Radiogr Rev Publ Radiol Soc N Am Inc 24(suppl1):S35–S54
34.
Zurück zum Zitat Bonatti M, Lombardo F, Vezzali N, Zamboni G, Ferro F, Pernter P et al (2015) MDCT of blunt renal trauma: imaging findings and therapeutic implications. Insights Imaging 6(2):261–272CrossRefPubMedPubMedCentral Bonatti M, Lombardo F, Vezzali N, Zamboni G, Ferro F, Pernter P et al (2015) MDCT of blunt renal trauma: imaging findings and therapeutic implications. Insights Imaging 6(2):261–272CrossRefPubMedPubMedCentral
35.
Zurück zum Zitat Reis LO, Kim FJ, Moore EE, Hirano ES, Fraga GP, Nascimento B et al (2013) Update in the classification and treatment of complex renal injuries. Revista do Colegio Brasileiro de Cirurgioes 40(4):347–350CrossRefPubMed Reis LO, Kim FJ, Moore EE, Hirano ES, Fraga GP, Nascimento B et al (2013) Update in the classification and treatment of complex renal injuries. Revista do Colegio Brasileiro de Cirurgioes 40(4):347–350CrossRefPubMed
36.
Zurück zum Zitat Chiron P, Hornez E, Boddaert G, Dusaud M, Bayoud Y, Molimard B et al (2016) Grade IV renal trauma management. A revision of the AAST renal injury grading scale is mandatory. Eur J Trauma Emerg Surg 42(2):237–241CrossRefPubMed Chiron P, Hornez E, Boddaert G, Dusaud M, Bayoud Y, Molimard B et al (2016) Grade IV renal trauma management. A revision of the AAST renal injury grading scale is mandatory. Eur J Trauma Emerg Surg 42(2):237–241CrossRefPubMed
37.
Zurück zum Zitat Dugi DD 3rd, Morey AF, Gupta A, Nuss GR, Sheu GL, Pruitt JH (2010) American Association for the surgery of trauma grade 4 renal injury substratification into grades 4a (low risk) and 4b (high risk). J Urol 183(2):592–597CrossRefPubMed Dugi DD 3rd, Morey AF, Gupta A, Nuss GR, Sheu GL, Pruitt JH (2010) American Association for the surgery of trauma grade 4 renal injury substratification into grades 4a (low risk) and 4b (high risk). J Urol 183(2):592–597CrossRefPubMed
38.
Zurück zum Zitat Buckley JC, McAninch JW (2011) Revision of current American Association for the surgery of trauma renal injury grading system. J Trauma 70(1):35–37CrossRefPubMed Buckley JC, McAninch JW (2011) Revision of current American Association for the surgery of trauma renal injury grading system. J Trauma 70(1):35–37CrossRefPubMed
39.
Zurück zum Zitat Powers WFT, Beard LN Jr, Adams A, Kotwall CA, Clancy TV, Hope WW (2012) Solid organ injury grading in trauma: accuracy of grading by surgical residents. Am Surg 78(8):834–836PubMed Powers WFT, Beard LN Jr, Adams A, Kotwall CA, Clancy TV, Hope WW (2012) Solid organ injury grading in trauma: accuracy of grading by surgical residents. Am Surg 78(8):834–836PubMed
40.
Zurück zum Zitat du Plessis J, Pitcher R (2015) Towards task shifting? A comparison of the accuracy of acute trauma-radiograph reporting by medical officers and senior radiographers in an African hospital. Pan Afr Med J 21:308CrossRefPubMedPubMedCentral du Plessis J, Pitcher R (2015) Towards task shifting? A comparison of the accuracy of acute trauma-radiograph reporting by medical officers and senior radiographers in an African hospital. Pan Afr Med J 21:308CrossRefPubMedPubMedCentral
42.
Zurück zum Zitat Berry KJ, Johnston JE, Mielke PW Jr (2008) Weighted kappa for multiple raters. Percept Mot Skills 107(3):837–848CrossRefPubMed Berry KJ, Johnston JE, Mielke PW Jr (2008) Weighted kappa for multiple raters. Percept Mot Skills 107(3):837–848CrossRefPubMed
43.
Zurück zum Zitat Landis JR, Koch GG (1977) The measurement of observer agreement for categorical data. Biometrics 33(1):159–174CrossRefPubMed Landis JR, Koch GG (1977) The measurement of observer agreement for categorical data. Biometrics 33(1):159–174CrossRefPubMed
44.
45.
Zurück zum Zitat Buijze GA, Guitton TG, van Dijk CN, Ring D, The Science of Variation G (2012) Training improves interobserver reliability for the diagnosis of scaphoid fracture displacement. Clin Orthop Relat Res 470(7):2029–2034CrossRefPubMedPubMedCentral Buijze GA, Guitton TG, van Dijk CN, Ring D, The Science of Variation G (2012) Training improves interobserver reliability for the diagnosis of scaphoid fracture displacement. Clin Orthop Relat Res 470(7):2029–2034CrossRefPubMedPubMedCentral
46.
Zurück zum Zitat Alcott D, Swann R, Grafham A (1999) The effect of training on rater reliability on the scoring of the NART. Br J Clin Psychol 38(4):431–434CrossRefPubMed Alcott D, Swann R, Grafham A (1999) The effect of training on rater reliability on the scoring of the NART. Br J Clin Psychol 38(4):431–434CrossRefPubMed
47.
Zurück zum Zitat Lee AY, Wisner DJ, Aminololama-Shakeri S, Arasu VA, Feig SA, Hargreaves J et al (2017) Inter-reader variability in the use of BI-RADS descriptors for suspicious findings on diagnostic mammography: a multi-institution study of 10 academic radiologists. Acad Radiol 24(1):60–66CrossRefPubMed Lee AY, Wisner DJ, Aminololama-Shakeri S, Arasu VA, Feig SA, Hargreaves J et al (2017) Inter-reader variability in the use of BI-RADS descriptors for suspicious findings on diagnostic mammography: a multi-institution study of 10 academic radiologists. Acad Radiol 24(1):60–66CrossRefPubMed
Metadaten
Titel
Inter-rater reliability in the radiological classification of renal injuries
verfasst von
Elias J. Pretorius
Amir D. Zarrabi
Stephanie Griffith-Richards
Justin Harvey
Hilgard M. Ackermann
Catharina M. Meintjes
Willem G. Cilliers
Moleen Zunza
Alexander J. Szpytko
Richard D. Pitcher
Publikationsdatum
02.01.2018
Verlag
Springer Berlin Heidelberg
Erschienen in
World Journal of Urology / Ausgabe 3/2018
Print ISSN: 0724-4983
Elektronische ISSN: 1433-8726
DOI
https://doi.org/10.1007/s00345-017-2166-6

Weitere Artikel der Ausgabe 3/2018

World Journal of Urology 3/2018 Zur Ausgabe

Update Urologie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.