Skip to main content
Erschienen in: European Spine Journal 10/2018

11.07.2018 | Original Article

Does the META score evaluating osteoporotic and metastatic vertebral fractures have enough agreement to be used by orthopaedic surgeons with different levels of training?

verfasst von: Julio Urrutia, Pablo Besa, Sergio Morales, Antonio Parlange, Sebastian Flores, Mauricio Campos, Sebastian Mobarec

Erschienen in: European Spine Journal | Ausgabe 10/2018

Einloggen, um Zugang zu erhalten

Abstract

Purpose

Differentiating osteoporotic vertebral fractures (OVF) from metastatic vertebral fractures (MVF) is difficult. A magnetic resonance imaging (MRI)-based score (META score) aiming to differentiate OVF and MVF was recently published; however, an independent agreement assessment is required before the score is used. We performed such independent agreement evaluation, including raters with different levels of training.

Methods

Sixty-four patients with confirmed OVF or MVF were evaluated by six raters (three spine surgeons and three orthopaedic residents) using the META score. We used the intra-class correlation coefficient (ICC) to evaluate inter- and intra-observer agreement and the kappa statistic (κ) to determine the agreement for individual score criteria. We calculated the area under the receiver-operating characteristic curve (AUC) to establish the score accuracy.

Results

The inter-observer agreement was poor [ICC = 0.22 (0.12–0.33)]; spine surgeons [ICC = 0.75 (0.66–0.83)] had better agreement than that of residents [ICC = 0.06 (− 0.07 to 0.23)]. The intra-observer agreement was poor [ICC = 0.15 (− 0.04 to 0.30)]; both spine surgeons [ICC = 0.21 (0.05–0.41)] and residents exhibited poor agreement [ICC = − 0.06 (− 0.40 to 0.20)]. The agreement for each specific criterion varied from κ = 0.24 to κ = 0.38. The AUC was 0.57 (0.64 for spine surgeons and 0.51 for residents, p < 0.01).

Conclusion

The inter-observer agreement using the META score was adequate for spine surgeons but not for residents; the intra-observer agreement was poor. These results do not support the standard use of the META score to differentiate OVF and MVF.

Graphical abstract

These slides can be retrieved under Electronic Supplementary Material.
Anhänge
Nur mit Berechtigung zugänglich
Literatur
3.
Zurück zum Zitat Baur A, Huber A, Ertl-Wagner B, Durr R, Zysk S, Arbogast S, Deimling M, Reiser M (2001) Diagnostic value of increased diffusion weighting of a steady-state free precession sequence for differentiating acute benign osteoporotic fractures from pathologic vertebral compression fractures. AJNR Am J Neuroradiol 22:366–372PubMed Baur A, Huber A, Ertl-Wagner B, Durr R, Zysk S, Arbogast S, Deimling M, Reiser M (2001) Diagnostic value of increased diffusion weighting of a steady-state free precession sequence for differentiating acute benign osteoporotic fractures from pathologic vertebral compression fractures. AJNR Am J Neuroradiol 22:366–372PubMed
5.
Zurück zum Zitat Lindsay R, Silverman SL, Cooper C, Hanley DA, Barton I, Broy SB, Licata A, Benhamou L, Geusens P, Flowers K, Stracke H, Seeman E (2001) Risk of new vertebral fracture in the year following a fracture. JAMA 285:320–323CrossRef Lindsay R, Silverman SL, Cooper C, Hanley DA, Barton I, Broy SB, Licata A, Benhamou L, Geusens P, Flowers K, Stracke H, Seeman E (2001) Risk of new vertebral fracture in the year following a fracture. JAMA 285:320–323CrossRef
6.
Zurück zum Zitat Nevitt MC, Ettinger B, Black DM, Stone K, Jamal SA, Ensrud K, Segal M, Genant HK, Cummings SR (1998) The association of radiographically detected vertebral fractures with back pain and function: a prospective study. Ann Intern Med 128:793–800CrossRef Nevitt MC, Ettinger B, Black DM, Stone K, Jamal SA, Ensrud K, Segal M, Genant HK, Cummings SR (1998) The association of radiographically detected vertebral fractures with back pain and function: a prospective study. Ann Intern Med 128:793–800CrossRef
7.
Zurück zum Zitat Kubota T, Yamada K, Ito H, Kizu O, Nishimura T (2005) High-resolution imaging of the spine using multidetector-row computed tomography: differentiation between benign and malignant vertebral compression fractures. J Comput Assist Tomogr 29:712–719CrossRef Kubota T, Yamada K, Ito H, Kizu O, Nishimura T (2005) High-resolution imaging of the spine using multidetector-row computed tomography: differentiation between benign and malignant vertebral compression fractures. J Comput Assist Tomogr 29:712–719CrossRef
10.
Zurück zum Zitat Shih TT, Huang KM, Li YW (1999) Solitary vertebral collapse: distinction between benign and malignant causes using MR patterns. J Magn Reson Imag 9:635–642CrossRef Shih TT, Huang KM, Li YW (1999) Solitary vertebral collapse: distinction between benign and malignant causes using MR patterns. J Magn Reson Imag 9:635–642CrossRef
11.
Zurück zum Zitat Walter SD, Eliasziw M, Donner A (1998) Sample size and optimal designs for reliability studies. Stat Med 17:101–110CrossRef Walter SD, Eliasziw M, Donner A (1998) Sample size and optimal designs for reliability studies. Stat Med 17:101–110CrossRef
12.
Zurück zum Zitat Hallgren KA (2012) Computing inter-rater reliability for observational data: an overview and tutorial. Tutor Quant Methods Psychol 8:23–34CrossRef Hallgren KA (2012) Computing inter-rater reliability for observational data: an overview and tutorial. Tutor Quant Methods Psychol 8:23–34CrossRef
13.
Zurück zum Zitat Fleiss J (1986) The design and analysis of clinical experiments. Wiley, New York, pp 1–31 Fleiss J (1986) The design and analysis of clinical experiments. Wiley, New York, pp 1–31
14.
Zurück zum Zitat Landis JR, Koch GG (1977) The measurement of observer agreement for categorical data. Biometrics 33:159–174CrossRef Landis JR, Koch GG (1977) The measurement of observer agreement for categorical data. Biometrics 33:159–174CrossRef
17.
Zurück zum Zitat Rupp RE, Ebraheim NA, Coombs RJ (1995) Magnetic resonance imaging differentiation of compression spine fractures or vertebral lesions caused by osteoporosis or tumor. Spine (Phila Pa 1976) 20:2499–2503 (Discussion 2504) CrossRef Rupp RE, Ebraheim NA, Coombs RJ (1995) Magnetic resonance imaging differentiation of compression spine fractures or vertebral lesions caused by osteoporosis or tumor. Spine (Phila Pa 1976) 20:2499–2503 (Discussion 2504) CrossRef
18.
Zurück zum Zitat Tan DY, Tsou IY, Chee TS (2002) Differentiation of malignant vertebral collapse from osteoporotic and other benign causes using magnetic resonance imaging. Ann Acad Med Singap 31:8–14PubMed Tan DY, Tsou IY, Chee TS (2002) Differentiation of malignant vertebral collapse from osteoporotic and other benign causes using magnetic resonance imaging. Ann Acad Med Singap 31:8–14PubMed
22.
Zurück zum Zitat Brorson S, Bagger J, Sylvest A, Hrobjartsson A (2002) Improved interobserver variation after training of doctors in the Neer system. A randomised trial. J Bone Jt Surg Br 84:950–954CrossRef Brorson S, Bagger J, Sylvest A, Hrobjartsson A (2002) Improved interobserver variation after training of doctors in the Neer system. A randomised trial. J Bone Jt Surg Br 84:950–954CrossRef
25.
Zurück zum Zitat Kalenderer O, Agus H, Ozcalabi IT, Ozluk S (2005) The importance of surgeons’ experience on intraobserver and interobserver reliability of classifications used for Perthes disease. J Pediatr Orthop 25:460–464CrossRef Kalenderer O, Agus H, Ozcalabi IT, Ozluk S (2005) The importance of surgeons’ experience on intraobserver and interobserver reliability of classifications used for Perthes disease. J Pediatr Orthop 25:460–464CrossRef
31.
Zurück zum Zitat Urrutia J, Zamora T, Klaber I, Carmona M, Palma J, Campos M, Yurac R (2016) Do thoraco-lumbar spinal injuries classification systems exhibit lower inter- and intra-observer agreement than other fractures classifications?: a comparison using fractures of the trochanteric area of the proximal femur as contrast model. Injury 47:859–864. https://doi.org/10.1016/j.injury.2015.11.016 CrossRefPubMed Urrutia J, Zamora T, Klaber I, Carmona M, Palma J, Campos M, Yurac R (2016) Do thoraco-lumbar spinal injuries classification systems exhibit lower inter- and intra-observer agreement than other fractures classifications?: a comparison using fractures of the trochanteric area of the proximal femur as contrast model. Injury 47:859–864. https://​doi.​org/​10.​1016/​j.​injury.​2015.​11.​016 CrossRefPubMed
32.
Zurück zum Zitat Sanders R (1997) The problem with apples and oranges [editorial]. J Orthop Trauma 11:465–466CrossRef Sanders R (1997) The problem with apples and oranges [editorial]. J Orthop Trauma 11:465–466CrossRef
Metadaten
Titel
Does the META score evaluating osteoporotic and metastatic vertebral fractures have enough agreement to be used by orthopaedic surgeons with different levels of training?
verfasst von
Julio Urrutia
Pablo Besa
Sergio Morales
Antonio Parlange
Sebastian Flores
Mauricio Campos
Sebastian Mobarec
Publikationsdatum
11.07.2018
Verlag
Springer Berlin Heidelberg
Erschienen in
European Spine Journal / Ausgabe 10/2018
Print ISSN: 0940-6719
Elektronische ISSN: 1432-0932
DOI
https://doi.org/10.1007/s00586-018-5694-x

Weitere Artikel der Ausgabe 10/2018

European Spine Journal 10/2018 Zur Ausgabe

Arthropedia

Grundlagenwissen der Arthroskopie und Gelenkchirurgie. Erweitert durch Fallbeispiele, Videos und Abbildungen. 
» Jetzt entdecken

Update Orthopädie und Unfallchirurgie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.