Skip to main content
Erschienen in: Clinical Orthopaedics and Related Research® 12/2011

01.12.2011 | Clinical Research

Diagnostic Performance Tests for Suspected Scaphoid Fractures Differ with Conventional and Latent Class Analysis

verfasst von: Geert A. Buijze, MD, Wouter H. Mallee, MD, Frank J. P. Beeres, MD, PhD, Timothy E. Hanson, PhD, Wesley O. Johnson, PhD, David Ring, MD, PhD

Erschienen in: Clinical Orthopaedics and Related Research® | Ausgabe 12/2011

Einloggen, um Zugang zu erhalten

Abstract

Background

Evaluation of the diagnostic performance characteristics of radiographic tests for diagnosing a true fracture among suspected scaphoid fractures is hindered by the lack of a consensus reference standard. Latent class analysis is a statistical method that takes advantage of unobserved, or latent, classes in the data that can be used to determine diagnostic performance characteristics when there is no consensus reference (gold) standard.

Purposes

We therefore compared the diagnostic performance characteristics of MRI, CT, bone scintigraphy, and physical examination to identify true fractures among suspected scaphoid fractures.

Patients and Methods

We used data from two studies, one that prospectively studied 34 patients who had MRI and CT of the wrist, and a second that studied 78 patients who had MRI, bone scintigraphy, and structured physical examination. We compared the diagnostic performance characteristics calculated by latent class analysis with those calculated using formulas based on a reference standard.

Results

In the first cohort, the calculated sensitivity and specificity with latent class analysis were different than those with traditional reference standard-based calculations for the CT in the scaphoid planes (sensitivity, 0.78 versus 0.67; specificity, 1.0 versus 0.96) and the MRI (sensitivity, 0.80 versus 0.67; specificity, 0.93 versus 0.89). In the second cohort, the greatest differences were in the sensitivity of MRI (0.84 versus 0.75) and the sensitivities of physical examination maneuvers (range, 0.63–0.73 versus 1.0).

Conclusions

The diagnostic performance characteristics calculated using latent class analysis may differ from those calculated according to formulas based on a reference standard. We believe latent class analysis merits further study as an option for assessing diagnostic performance characteristics for orthopaedic conditions when there is no consensus reference standard.

Level of Evidence

Level II, prognostic study. See the Guidelines for Authors for a complete description of levels of evidence.
Anhänge
Nur mit Berechtigung zugänglich
Literatur
1.
Zurück zum Zitat Adey L, Souer JS, Lozano-Calderon S, Palmer W, Lee SG, Ring D. Computed tomography of suspected scaphoid fractures. J Hand Surg Am. 2007;32:61–66.PubMedCrossRef Adey L, Souer JS, Lozano-Calderon S, Palmer W, Lee SG, Ring D. Computed tomography of suspected scaphoid fractures. J Hand Surg Am. 2007;32:61–66.PubMedCrossRef
2.
Zurück zum Zitat Akdemir UO, Atasever T, Sipahioglu S, Turkolmez S, Kazimoglu C, Sener E. Value of bone scintigraphy in patients with carpal trauma. Ann Nucl Med. 2004;18:495–499.PubMedCrossRef Akdemir UO, Atasever T, Sipahioglu S, Turkolmez S, Kazimoglu C, Sener E. Value of bone scintigraphy in patients with carpal trauma. Ann Nucl Med. 2004;18:495–499.PubMedCrossRef
3.
Zurück zum Zitat Baughman AL, Bisgard KM, Cortese MM, Thompson WW, Sanden GN, Strebel PM. Utility of composite reference standards and latent class analysis in evaluating the clinical accuracy of diagnostic tests for pertussis. Clin Vaccine Immunol. 2008;15:106–114.PubMedCrossRef Baughman AL, Bisgard KM, Cortese MM, Thompson WW, Sanden GN, Strebel PM. Utility of composite reference standards and latent class analysis in evaluating the clinical accuracy of diagnostic tests for pertussis. Clin Vaccine Immunol. 2008;15:106–114.PubMedCrossRef
4.
Zurück zum Zitat Bayes T. An essay towards solving a problem in the doctrine of chances. Phil Trans R Soc London. 1763;53:370–418.CrossRef Bayes T. An essay towards solving a problem in the doctrine of chances. Phil Trans R Soc London. 1763;53:370–418.CrossRef
5.
Zurück zum Zitat Beeres FJ, Rhemrev SJ, den Hollander P, Kingma LM, Meylaerts SA, le Cessie S, Bartlema KA, Hamming JF, Hogervorst M. Early magnetic resonance imaging compared with bone scintigraphy in suspected scaphoid fractures. J Bone Joint Surg Br. 2008;90:1205–1209.PubMedCrossRef Beeres FJ, Rhemrev SJ, den Hollander P, Kingma LM, Meylaerts SA, le Cessie S, Bartlema KA, Hamming JF, Hogervorst M. Early magnetic resonance imaging compared with bone scintigraphy in suspected scaphoid fractures. J Bone Joint Surg Br. 2008;90:1205–1209.PubMedCrossRef
6.
Zurück zum Zitat Breederveld RS, Tuinebreijer WE. Investigation of computed tomographic scan concurrent criterion validity in doubtful scaphoid fracture of the wrist. J Trauma. 2004;57:851–854.PubMedCrossRef Breederveld RS, Tuinebreijer WE. Investigation of computed tomographic scan concurrent criterion validity in doubtful scaphoid fracture of the wrist. J Trauma. 2004;57:851–854.PubMedCrossRef
7.
Zurück zum Zitat Buijze GA, Hanson TE, Johnson W, Ring D. Latent class analysis to determine the accuracy of diagnostic tests in orthopaedics. Orthop J Harvard Med School. 2010;12:106–108. Buijze GA, Hanson TE, Johnson W, Ring D. Latent class analysis to determine the accuracy of diagnostic tests in orthopaedics. Orthop J Harvard Med School. 2010;12:106–108.
8.
Zurück zum Zitat Butler JC, Bosshardt SC, Phelan M, Moroney SM, Tondella ML, Farley MM, Schuchat A, Fields BS. Classical and latent class analysis evaluation of sputum polymerase chain reaction and urine antigen testing for diagnosis of pneumococcal pneumonia in adults. J Infect Dis. 2003;187:1416–1423.PubMedCrossRef Butler JC, Bosshardt SC, Phelan M, Moroney SM, Tondella ML, Farley MM, Schuchat A, Fields BS. Classical and latent class analysis evaluation of sputum polymerase chain reaction and urine antigen testing for diagnosis of pneumococcal pneumonia in adults. J Infect Dis. 2003;187:1416–1423.PubMedCrossRef
9.
Zurück zum Zitat Casella G, Berger RL. Statistical Inference. Ed 2. Pacific Grove, CA: Duxbury Press; 2001. Casella G, Berger RL. Statistical Inference. Ed 2. Pacific Grove, CA: Duxbury Press; 2001.
10.
Zurück zum Zitat Christensen R, Johnson WO, Branscum A, Hanson TF. Bayesian Ideas and Data Analysis: An Introduction for Scientists and Statisticians. Ed 3. Boca Raton, FL: CRC Press; 2010. Christensen R, Johnson WO, Branscum A, Hanson TF. Bayesian Ideas and Data Analysis: An Introduction for Scientists and Statisticians. Ed 3. Boca Raton, FL: CRC Press; 2010.
11.
Zurück zum Zitat De La Rosa GD, Valencia ML, Arango CM, Gomez CI, Garcia A, Ospina S, Osorno S, Henao A, Jaimes FA. Toward an operative diagnosis in sepsis: a latent class approach. BMC Infect Dis. 2008;8:18.PubMedCrossRef De La Rosa GD, Valencia ML, Arango CM, Gomez CI, Garcia A, Ospina S, Osorno S, Henao A, Jaimes FA. Toward an operative diagnosis in sepsis: a latent class approach. BMC Infect Dis. 2008;8:18.PubMedCrossRef
12.
Zurück zum Zitat Dendukuri N, Joseph L. Bayesian approaches to modeling the conditional dependence between multiple diagnostic tests. Biometrics. 2001;57:158–167.PubMedCrossRef Dendukuri N, Joseph L. Bayesian approaches to modeling the conditional dependence between multiple diagnostic tests. Biometrics. 2001;57:158–167.PubMedCrossRef
13.
Zurück zum Zitat Faraone SV, Tsuang MT. Measuring diagnostic accuracy in the absence of a “gold standard”. Am J Psychiatry. 1994;151:650–657.PubMed Faraone SV, Tsuang MT. Measuring diagnostic accuracy in the absence of a “gold standard”. Am J Psychiatry. 1994;151:650–657.PubMed
14.
Zurück zum Zitat Fisher RA. On the mathematical foundations of theoretical statistics. Phil Trans R Soc A. 1922;222:309–368.CrossRef Fisher RA. On the mathematical foundations of theoretical statistics. Phil Trans R Soc A. 1922;222:309–368.CrossRef
15.
Zurück zum Zitat Gabler C, Kukla C, Breitenseher MJ, Trattnig S, Vecsei V. Diagnosis of occult scaphoid fractures and other wrist injuries: are repeated clinical examinations and plain radiographs still state of the art? Langenbecks Arch Surg. 2001;386:150–154.PubMedCrossRef Gabler C, Kukla C, Breitenseher MJ, Trattnig S, Vecsei V. Diagnosis of occult scaphoid fractures and other wrist injuries: are repeated clinical examinations and plain radiographs still state of the art? Langenbecks Arch Surg. 2001;386:150–154.PubMedCrossRef
16.
Zurück zum Zitat Georgiadis MP, Johnson WO, Singh R, Gardner IA. Correlation-adjusted estimation of sensitivity and specificity of two diagnostic tests. J Royal Stat Soc C. 2003;52:63–76.CrossRef Georgiadis MP, Johnson WO, Singh R, Gardner IA. Correlation-adjusted estimation of sensitivity and specificity of two diagnostic tests. J Royal Stat Soc C. 2003;52:63–76.CrossRef
17.
Zurück zum Zitat Groves AM, Kayani I, Syed R, Hutton BF, Bearcroft PP, Dixon AK, Ell PJ. An international survey of hospital practice in the imaging of acute scaphoid trauma. AJR Am J Roentgenol. 2006;187:1453–1456.PubMedCrossRef Groves AM, Kayani I, Syed R, Hutton BF, Bearcroft PP, Dixon AK, Ell PJ. An international survey of hospital practice in the imaging of acute scaphoid trauma. AJR Am J Roentgenol. 2006;187:1453–1456.PubMedCrossRef
18.
Zurück zum Zitat Hui SL, Walter SD. Estimating the error rates of diagnostic tests. Biometrics. 1980;36:167–171.PubMedCrossRef Hui SL, Walter SD. Estimating the error rates of diagnostic tests. Biometrics. 1980;36:167–171.PubMedCrossRef
19.
Zurück zum Zitat Hunter JC, Escobedo EM, Wilson AJ, Hanel DP, Zink-Brody GC, Mann FA. MR imaging of clinically suspected scaphoid fractures. AJR Am J Roentgenol. 1997;168:1287–1293.PubMed Hunter JC, Escobedo EM, Wilson AJ, Hanel DP, Zink-Brody GC, Mann FA. MR imaging of clinically suspected scaphoid fractures. AJR Am J Roentgenol. 1997;168:1287–1293.PubMed
20.
Zurück zum Zitat Johnson WO, Gastwirth JL, Pearson LM. Screening without a “gold standard”: the Hui-Walter paradigm revisited. Am J Epidemiol. 2001;153:921–924.PubMedCrossRef Johnson WO, Gastwirth JL, Pearson LM. Screening without a “gold standard”: the Hui-Walter paradigm revisited. Am J Epidemiol. 2001;153:921–924.PubMedCrossRef
21.
Zurück zum Zitat Jones G, Johnson WO, Hanson TE, Christensen R. Identifiability of models for multiple diagnostic testing in the absence of a gold standard. Biometrics. 2010;66:855–863.PubMedCrossRef Jones G, Johnson WO, Hanson TE, Christensen R. Identifiability of models for multiple diagnostic testing in the absence of a gold standard. Biometrics. 2010;66:855–863.PubMedCrossRef
22.
Zurück zum Zitat LaJoie AS, McCabe SJ, Thomas B, Edgell SE. Determining the sensitivity and specificity of common diagnostic tests for carpal tunnel syndrome using latent class analysis. Plast Reconstr Surg. 2005;116:502–507.PubMedCrossRef LaJoie AS, McCabe SJ, Thomas B, Edgell SE. Determining the sensitivity and specificity of common diagnostic tests for carpal tunnel syndrome using latent class analysis. Plast Reconstr Surg. 2005;116:502–507.PubMedCrossRef
23.
Zurück zum Zitat Low G, Raby N. Can follow-up radiography for acute scaphoid fracture still be considered a valid investigation? Clin Radiol. 2005;60:1106–1110.PubMedCrossRef Low G, Raby N. Can follow-up radiography for acute scaphoid fracture still be considered a valid investigation? Clin Radiol. 2005;60:1106–1110.PubMedCrossRef
24.
Zurück zum Zitat Lozano-Calderon S, Blazar P, Zurakowski D, Lee SG, Ring D. Diagnosis of scaphoid fracture displacement with radiography and computed tomography. J Bone Joint Surg Am. 2006;88:2695–2703.PubMedCrossRef Lozano-Calderon S, Blazar P, Zurakowski D, Lee SG, Ring D. Diagnosis of scaphoid fracture displacement with radiography and computed tomography. J Bone Joint Surg Am. 2006;88:2695–2703.PubMedCrossRef
25.
Zurück zum Zitat Mallee W, Doornberg JN, Ring D, van Dijk CN, Maas M, Goslings JC. Comparison of CT and MRI for diagnosis of suspected scaphoid fractures. J Bone Joint Surg Am. 2011;93:20–28.PubMedCrossRef Mallee W, Doornberg JN, Ring D, van Dijk CN, Maas M, Goslings JC. Comparison of CT and MRI for diagnosis of suspected scaphoid fractures. J Bone Joint Surg Am. 2011;93:20–28.PubMedCrossRef
26.
Zurück zum Zitat Memarsadeghi M, Breitenseher MJ, Schaefer-Prokop C, Weber M, Aldrian S, Gabler C, Prokop M. Occult scaphoid fractures: comparison of multidetector CT and MR imaging. Initial experience. Radiology. 2006;240:169–176. Memarsadeghi M, Breitenseher MJ, Schaefer-Prokop C, Weber M, Aldrian S, Gabler C, Prokop M. Occult scaphoid fractures: comparison of multidetector CT and MR imaging. Initial experience. Radiology. 2006;240:169–176.
27.
Zurück zum Zitat Nielsen PT, Hedeboe J, Thommesen P. Bone scintigraphy in the evaluation of fracture of the carpal scaphoid bone. Acta Orthop Scand. 1983;54:303–306.PubMedCrossRef Nielsen PT, Hedeboe J, Thommesen P. Bone scintigraphy in the evaluation of fracture of the carpal scaphoid bone. Acta Orthop Scand. 1983;54:303–306.PubMedCrossRef
28.
Zurück zum Zitat Rhemrev SJ, Beeres FJ, van Leerdam RH, Hogervorst M, Ring D. Clinical prediction rule for suspected scaphoid fractures: a prospective cohort study. Injury. 2010;41:1026–1030.PubMedCrossRef Rhemrev SJ, Beeres FJ, van Leerdam RH, Hogervorst M, Ring D. Clinical prediction rule for suspected scaphoid fractures: a prospective cohort study. Injury. 2010;41:1026–1030.PubMedCrossRef
29.
Zurück zum Zitat Rice JP, Endicott J, Knesevich MA, Rochberg N. The estimation of diagnostic sensitivity using stability data: an application to major depressive disorder. J Psychiatr Res. 1987;21:337–345.PubMedCrossRef Rice JP, Endicott J, Knesevich MA, Rochberg N. The estimation of diagnostic sensitivity using stability data: an application to major depressive disorder. J Psychiatr Res. 1987;21:337–345.PubMedCrossRef
30.
Zurück zum Zitat Sanders WE. Evaluation of the humpback scaphoid by computed tomography in the longitudinal axial plane of the scaphoid. J Hand Surg Am. 1988;13:182–187.PubMedCrossRef Sanders WE. Evaluation of the humpback scaphoid by computed tomography in the longitudinal axial plane of the scaphoid. J Hand Surg Am. 1988;13:182–187.PubMedCrossRef
31.
Zurück zum Zitat Siegel S, Castellan JN. Nonparametric Statistics for the Behavioral Sciences. New York, NY: McGraw-Hill; 1988. Siegel S, Castellan JN. Nonparametric Statistics for the Behavioral Sciences. New York, NY: McGraw-Hill; 1988.
32.
Zurück zum Zitat Symmons DP, Lunt M, Watkins G, Helliwell P, Jones S, McHugh N, Veale D. Developing classification criteria for peripheral joint psoriatic arthritis: Step I. Establishing whether the rheumatologist’s opinion on the diagnosis can be used as the “gold standard”. J Rheumatol. 2006;33:552–557.PubMed Symmons DP, Lunt M, Watkins G, Helliwell P, Jones S, McHugh N, Veale D. Developing classification criteria for peripheral joint psoriatic arthritis: Step I. Establishing whether the rheumatologist’s opinion on the diagnosis can be used as the “gold standard”. J Rheumatol. 2006;33:552–557.PubMed
33.
Zurück zum Zitat Thorpe AP, Murray AD, Smith FW, Ferguson J. Clinically suspected scaphoid fracture: a comparison of magnetic resonance imaging and bone scintigraphy. Br J Radiol. 1996;69:109–113.PubMedCrossRef Thorpe AP, Murray AD, Smith FW, Ferguson J. Clinically suspected scaphoid fracture: a comparison of magnetic resonance imaging and bone scintigraphy. Br J Radiol. 1996;69:109–113.PubMedCrossRef
34.
Zurück zum Zitat Tuyisenge L, Ndimubanzi CP, Ndayisaba G, Muganga N, Menten J, Boelaert M, Van den Ende J. Evaluation of latent class analysis and decision thresholds to guide the diagnosis of pediatric tuberculosis in a Rwandan reference hospital. Pediatr Infect Dis J. 2010;29:e11–e18.PubMedCrossRef Tuyisenge L, Ndimubanzi CP, Ndayisaba G, Muganga N, Menten J, Boelaert M, Van den Ende J. Evaluation of latent class analysis and decision thresholds to guide the diagnosis of pediatric tuberculosis in a Rwandan reference hospital. Pediatr Infect Dis J. 2010;29:e11–e18.PubMedCrossRef
35.
Zurück zum Zitat Unay K, Gokcen B, Ozkan K, Poyanli O, Eceviz E. Examination tests predictive of bone injury in patients with clinically suspected occult scaphoid fracture. Injury. 2009;40:1265–1268.PubMedCrossRef Unay K, Gokcen B, Ozkan K, Poyanli O, Eceviz E. Examination tests predictive of bone injury in patients with clinically suspected occult scaphoid fracture. Injury. 2009;40:1265–1268.PubMedCrossRef
36.
Zurück zum Zitat Walter SD, Irwig L, Glasziou PP. Meta-analysis of diagnostic tests with imperfect reference standards. J Clin Epidemiol. 1999;52:943–951.PubMedCrossRef Walter SD, Irwig L, Glasziou PP. Meta-analysis of diagnostic tests with imperfect reference standards. J Clin Epidemiol. 1999;52:943–951.PubMedCrossRef
37.
Zurück zum Zitat Wilson AW, Kurer MH, Peggington JL, Grant DS, Kirk CC. Bone scintigraphy in the management of X-ray-negative potential scaphoid fractures. Arch Emerg Med. 1986;3:235–242.PubMed Wilson AW, Kurer MH, Peggington JL, Grant DS, Kirk CC. Bone scintigraphy in the management of X-ray-negative potential scaphoid fractures. Arch Emerg Med. 1986;3:235–242.PubMed
38.
Zurück zum Zitat Yin ZG, Zhang JB, Kan SL, Wang XG. Diagnosing suspected scaphoid fractures: a systematic review and meta-analysis. Clin Orthop Relat Res. 2010;468:723–734.PubMedCrossRef Yin ZG, Zhang JB, Kan SL, Wang XG. Diagnosing suspected scaphoid fractures: a systematic review and meta-analysis. Clin Orthop Relat Res. 2010;468:723–734.PubMedCrossRef
Metadaten
Titel
Diagnostic Performance Tests for Suspected Scaphoid Fractures Differ with Conventional and Latent Class Analysis
verfasst von
Geert A. Buijze, MD
Wouter H. Mallee, MD
Frank J. P. Beeres, MD, PhD
Timothy E. Hanson, PhD
Wesley O. Johnson, PhD
David Ring, MD, PhD
Publikationsdatum
01.12.2011
Verlag
Springer-Verlag
Erschienen in
Clinical Orthopaedics and Related Research® / Ausgabe 12/2011
Print ISSN: 0009-921X
Elektronische ISSN: 1528-1132
DOI
https://doi.org/10.1007/s11999-011-2074-9

Weitere Artikel der Ausgabe 12/2011

Clinical Orthopaedics and Related Research® 12/2011 Zur Ausgabe

Arthropedia

Grundlagenwissen der Arthroskopie und Gelenkchirurgie. Erweitert durch Fallbeispiele, Videos und Abbildungen. 
» Jetzt entdecken

Update Orthopädie und Unfallchirurgie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.