Skip to main content
Erschienen in: Clinical Orthopaedics and Related Research® 1/2014

01.01.2014 | Survey (Systematic Review)

What Are the Levels of Evidence on Which We Base Decisions for Surgical Management of Lower Extremity Bone Tumors?

verfasst von: Nathan Evaniew, MD, James Nuttall, MBBChBAO, Forough Farrokhyar, MPhil, PhD, Mohit Bhandari, MD, PhD, Michelle Ghert, MD

Erschienen in: Clinical Orthopaedics and Related Research® | Ausgabe 1/2014

Einloggen, um Zugang zu erhalten

Abstract

Background

Benign and malignant lower extremity primary bone tumors are among the least common conditions treated by orthopaedic surgeons. The literature supporting their surgical management has historically been in the form of observational studies rather than prospective controlled studies. Observational studies are prone to confounding bias, sampling bias, and recall bias.

Questions/purposes

(1) What are the overall levels of evidence of articles published on the surgical management of lower extremity bone tumors? (2) What is the overall quality of reporting of studies in this field based on the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) checklist? (3) What are the most common pitfalls in reporting that authors might improve on?

Methods

All studies describing the surgical management of lower extremity primary bone tumors from 2002 to 2012 were systematically reviewed. Two authors independently appraised levels of evidence. Quality of reporting was assessed with the STROBE checklist. Pitfalls in reporting were quantified by determining the 10 most underreported elements of research study design in the group of studies analyzed, again using the STROBE checklist as the reference standard. Of 1387 studies identified, 607 met eligibility criteria.

Results

There were no Level I studies, two Level II studies, 47 Level III studies, 308 Level IV studies, and 250 Level V studies. The mean percentage of STROBE points reported satisfactorily in each article as graded by the two reviewers was 53% (95% confidence interval, 42%–63%). The most common pitfalls in reporting were failures to justify sample size (2.2% reported), examine sensitivity (2.2%), account for missing data (9.8%), and discuss sources of bias (14%). Followup (66%), precision of outcomes (64%), eligibility criteria (55%), and methodological limitations (53%) were variably reported.

Conclusions

Observational studies are the dominant evidence for the surgical management of primary lower extremity bone tumors. Numerous deficiencies in reporting limit their clinical use. Authors may use these results to inform future work and improve reporting in observational studies, and treating surgeons should be aware of these limitations when choosing among the various options with their patients.
Literatur
1.
Zurück zum Zitat Audige L, Bhandari M, Griffin D, Middleton P, Reeves BC. Systematic reviews of nonrandomized clinical studies in the orthopaedic literature. Clin Orthop Relat Res. 2004;427:249–257.PubMedCrossRef Audige L, Bhandari M, Griffin D, Middleton P, Reeves BC. Systematic reviews of nonrandomized clinical studies in the orthopaedic literature. Clin Orthop Relat Res. 2004;427:249–257.PubMedCrossRef
2.
Zurück zum Zitat Bhandari M, Guyatt GH, Lochner H, Sprague S, Tornetta P 3rd. Application of the Consolidated Standards of Reporting Trials (CONSORT) in the fracture care literature. J Bone Joint Surg Am. 2002;84:485–489.PubMed Bhandari M, Guyatt GH, Lochner H, Sprague S, Tornetta P 3rd. Application of the Consolidated Standards of Reporting Trials (CONSORT) in the fracture care literature. J Bone Joint Surg Am. 2002;84:485–489.PubMed
3.
Zurück zum Zitat Bhandari M, Morrow F, Kulkarni AV, Tornetta P 3rd. Meta-analyses in orthopaedic surgery. A systematic review of their methodologies. J Bone Joint Surg Am. 2001;83:15–24.PubMed Bhandari M, Morrow F, Kulkarni AV, Tornetta P 3rd. Meta-analyses in orthopaedic surgery. A systematic review of their methodologies. J Bone Joint Surg Am. 2001;83:15–24.PubMed
4.
Zurück zum Zitat Bhandari M, Richards RR, Sprague S, Schemitsch EH. The quality of reporting of randomized trials in the journal of bone and joint surgery from 1988 through 2000. J Bone Joint Surg Am. 2002;84:388–396.PubMed Bhandari M, Richards RR, Sprague S, Schemitsch EH. The quality of reporting of randomized trials in the journal of bone and joint surgery from 1988 through 2000. J Bone Joint Surg Am. 2002;84:388–396.PubMed
6.
Zurück zum Zitat Carr AJ. Evidence-based orthopaedic surgery: what type of research will best improve clinical practice? J Bone Joint Surg Br. 2005;87:1593–1594.PubMedCrossRef Carr AJ. Evidence-based orthopaedic surgery: what type of research will best improve clinical practice? J Bone Joint Surg Br. 2005;87:1593–1594.PubMedCrossRef
7.
Zurück zum Zitat Chan S, Bhandari M. The quality of reporting of orthopaedic randomized trials with use of a checklist for nonpharmacological therapies. J Bone Joint Surg Am. 2007;89:1970–1978.PubMedCrossRef Chan S, Bhandari M. The quality of reporting of orthopaedic randomized trials with use of a checklist for nonpharmacological therapies. J Bone Joint Surg Am. 2007;89:1970–1978.PubMedCrossRef
8.
Zurück zum Zitat Detsky AS, Naylor CD, O’Rourke K, McGeer AJ, L’Abbe KA. Incorporating variations in the quality of individual randomized trials into meta-analysis. J Clin Epidemiol. 1992;45:255–256.PubMedCrossRef Detsky AS, Naylor CD, O’Rourke K, McGeer AJ, L’Abbe KA. Incorporating variations in the quality of individual randomized trials into meta-analysis. J Clin Epidemiol. 1992;45:255–256.PubMedCrossRef
9.
Zurück zum Zitat Devereaux PJ, Bhandari M, Clarke M, Montori VM, Cook DJ, Yusuf S, Sackett DL, Cinà CS, Walter SD, Haynes B, Schünemann HJ, Norman GR, Guyatt GH. Need for expertise based randomised controlled trials. BMJ. 2005;330:88.PubMedCentralPubMedCrossRef Devereaux PJ, Bhandari M, Clarke M, Montori VM, Cook DJ, Yusuf S, Sackett DL, Cinà CS, Walter SD, Haynes B, Schünemann HJ, Norman GR, Guyatt GH. Need for expertise based randomised controlled trials. BMJ. 2005;330:88.PubMedCentralPubMedCrossRef
10.
Zurück zum Zitat Dowrick AS, Bhandari M. Ethical issues in the design of randomized trials: to sham or not to sham. J Bone Joint Surg Am. 2012;94(Suppl 1):7–10.PubMedCrossRef Dowrick AS, Bhandari M. Ethical issues in the design of randomized trials: to sham or not to sham. J Bone Joint Surg Am. 2012;94(Suppl 1):7–10.PubMedCrossRef
11.
Zurück zum Zitat Farrokhyar F, Karanicolas PJ, Thoma A, Simunovic M, Bhandari M, Devereaux PJ, Anvari M, Adili A, Guyatt G. Randomized controlled trials of surgical interventions. Ann Surg. 2010;251:409–416.PubMedCrossRef Farrokhyar F, Karanicolas PJ, Thoma A, Simunovic M, Bhandari M, Devereaux PJ, Anvari M, Adili A, Guyatt G. Randomized controlled trials of surgical interventions. Ann Surg. 2010;251:409–416.PubMedCrossRef
12.
Zurück zum Zitat Ghert M, Deheshi B, Holt G, Randall RL, Ferguson P, Wunder J, Turcotte R, Werier J, Clarkson P, Damron T, Benevenia J, Anderson M, Gebhardt M, Isler M, Mottard S, Healey J, Evaniew N, Racano A, Sprague S, Swinton M, Bryant D, Thabane L, Guyatt G, Bhandari M; PARITY Investigators. Prophylactic Antibiotic Regimens In Tumour Surgery (PARITY): protocol for a multicentre randomised controlled study. BMJ Open. 2012;2:10.1136/bmjopen,2012-002197. Print 2012. Ghert M, Deheshi B, Holt G, Randall RL, Ferguson P, Wunder J, Turcotte R, Werier J, Clarkson P, Damron T, Benevenia J, Anderson M, Gebhardt M, Isler M, Mottard S, Healey J, Evaniew N, Racano A, Sprague S, Swinton M, Bryant D, Thabane L, Guyatt G, Bhandari M; PARITY Investigators. Prophylactic Antibiotic Regimens In Tumour Surgery (PARITY): protocol for a multicentre randomised controlled study. BMJ Open. 2012;2:10.​1136/​bmjopen,2012-002197. Print 2012.
13.
Zurück zum Zitat Hanzlik S, Mahabir RC, Baynosa RC, Khiabani KT. Levels of evidence in research published in The Journal of Bone And Joint Surgery (American Volume) over the last thirty years. J Bone Joint Surg Am. 2009;91:425–428.PubMedCrossRef Hanzlik S, Mahabir RC, Baynosa RC, Khiabani KT. Levels of evidence in research published in The Journal of Bone And Joint Surgery (American Volume) over the last thirty years. J Bone Joint Surg Am. 2009;91:425–428.PubMedCrossRef
14.
Zurück zum Zitat Hoppe DJ, Schemitsch EH, Morshed S, Tornetta P 3rd, Bhandari M. Hierarchy of evidence: where observational studies fit in and why we need them. J Bone Joint Surg Am. 2009;91(Suppl 3):2–9.PubMedCrossRef Hoppe DJ, Schemitsch EH, Morshed S, Tornetta P 3rd, Bhandari M. Hierarchy of evidence: where observational studies fit in and why we need them. J Bone Joint Surg Am. 2009;91(Suppl 3):2–9.PubMedCrossRef
15.
Zurück zum Zitat Horton R. Surgical research or comic opera: questions, but few answers. Lancet. 1996;347:984–985.PubMedCrossRef Horton R. Surgical research or comic opera: questions, but few answers. Lancet. 1996;347:984–985.PubMedCrossRef
16.
Zurück zum Zitat Konstantakos EK, Laughlin RT, Markert RJ, Crosby LA. Assuring the research competence of orthopedic graduates. J Surg Educ. 2010;67:129–134.PubMedCrossRef Konstantakos EK, Laughlin RT, Markert RJ, Crosby LA. Assuring the research competence of orthopedic graduates. J Surg Educ. 2010;67:129–134.PubMedCrossRef
17.
Zurück zum Zitat Kooistra B, Dijkman B, Einhorn TA, Bhandari M. How to design a good case series. J Bone Joint Surg Am. 2009;91(Suppl 3):21–26.PubMedCrossRef Kooistra B, Dijkman B, Einhorn TA, Bhandari M. How to design a good case series. J Bone Joint Surg Am. 2009;91(Suppl 3):21–26.PubMedCrossRef
18.
Zurück zum Zitat Moher D, Cook DJ, Eastwood S, Olkin I, Rennie D, Stroup DF. Improving the Quality of Reports of Meta-analyses of Randomised Controlled Trials: the QUOROM statement. QUOROM group. Br J Surg. 2000;87:1448–1454.PubMedCrossRef Moher D, Cook DJ, Eastwood S, Olkin I, Rennie D, Stroup DF. Improving the Quality of Reports of Meta-analyses of Randomised Controlled Trials: the QUOROM statement. QUOROM group. Br J Surg. 2000;87:1448–1454.PubMedCrossRef
19.
Zurück zum Zitat Moseley JB, O’Malley K, Petersen NJ, Menke TJ, Brody BA, Kuykendall DH, Hollingsworth JC, Ashton CM, Wray NP. A controlled trial of arthroscopic surgery for osteoarthritis of the knee. N Engl J Med. 2002;347:81–88.PubMedCrossRef Moseley JB, O’Malley K, Petersen NJ, Menke TJ, Brody BA, Kuykendall DH, Hollingsworth JC, Ashton CM, Wray NP. A controlled trial of arthroscopic surgery for osteoarthritis of the knee. N Engl J Med. 2002;347:81–88.PubMedCrossRef
20.
21.
Zurück zum Zitat Obremskey WT, Pappas N, Attallah-Wasif E, Tornetta P 3rd, Bhandari M. Level of evidence in orthopaedic journals. J Bone Joint Surg Am. 2005;87:2632–2638.PubMedCrossRef Obremskey WT, Pappas N, Attallah-Wasif E, Tornetta P 3rd, Bhandari M. Level of evidence in orthopaedic journals. J Bone Joint Surg Am. 2005;87:2632–2638.PubMedCrossRef
22.
23.
Zurück zum Zitat Parsons NR, Price CL, Hiskens R, Achten J, Costa ML. An evaluation of the quality of statistical design and analysis of published medical research: results from a systematic survey of general orthopaedic journals. BMC Med Res Methodol. 2012;12:60.PubMedCentralPubMedCrossRef Parsons NR, Price CL, Hiskens R, Achten J, Costa ML. An evaluation of the quality of statistical design and analysis of published medical research: results from a systematic survey of general orthopaedic journals. BMC Med Res Methodol. 2012;12:60.PubMedCentralPubMedCrossRef
24.
Zurück zum Zitat Poolman RW, Struijs PA, Krips R, Sierevelt IN, Lutz KH, Bhandari M. Does a ‘level I evidence’ rating imply high quality of reporting in orthopaedic randomised controlled trials? BMC Med Res Methodol. 2006;6:44.PubMedCentralPubMedCrossRef Poolman RW, Struijs PA, Krips R, Sierevelt IN, Lutz KH, Bhandari M. Does a ‘level I evidence’ rating imply high quality of reporting in orthopaedic randomised controlled trials? BMC Med Res Methodol. 2006;6:44.PubMedCentralPubMedCrossRef
25.
Zurück zum Zitat Rangan A, Brealey S, Carr A. Orthopaedic trial networks. J Bone Joint Surg Am. 2012;94(Suppl 1):97–100.PubMedCrossRef Rangan A, Brealey S, Carr A. Orthopaedic trial networks. J Bone Joint Surg Am. 2012;94(Suppl 1):97–100.PubMedCrossRef
26.
Zurück zum Zitat Sackett D, Haynes R, Guyatt G, Tugwell P. Clinical Epidemiology: A Basic Science for Clinicians. 2nd ed. Boston, MA, USA: Little Brown; 1991. Sackett D, Haynes R, Guyatt G, Tugwell P. Clinical Epidemiology: A Basic Science for Clinicians. 2nd ed. Boston, MA, USA: Little Brown; 1991.
27.
Zurück zum Zitat Sackett DL, Rosenberg WM, Gray JA, Haynes RB, Richardson WS. Evidence based medicine: what it is and what it isn’t. 1996. Clin Orthop Relat Res. 2007;455:3–5.PubMed Sackett DL, Rosenberg WM, Gray JA, Haynes RB, Richardson WS. Evidence based medicine: what it is and what it isn’t. 1996. Clin Orthop Relat Res. 2007;455:3–5.PubMed
28.
Zurück zum Zitat Samuelsson K, Desai N, McNair E, van Eck CF, Petzold M, Fu FH, Bhandari M, Karlsson J. Level of evidence in anterior cruciate ligament reconstruction research: a systematic review. Am J Sports Med. 2013;41:924–934.PubMedCrossRef Samuelsson K, Desai N, McNair E, van Eck CF, Petzold M, Fu FH, Bhandari M, Karlsson J. Level of evidence in anterior cruciate ligament reconstruction research: a systematic review. Am J Sports Med. 2013;41:924–934.PubMedCrossRef
29.
Zurück zum Zitat Scholtes VA, Nijman TH, van Beers L, Devereaux PJ, Poolman RW. Emerging designs in orthopaedics: expertise-based randomized controlled trials. J Bone Joint Surg Am. 2012;94(Suppl 1):24–28.PubMedCrossRef Scholtes VA, Nijman TH, van Beers L, Devereaux PJ, Poolman RW. Emerging designs in orthopaedics: expertise-based randomized controlled trials. J Bone Joint Surg Am. 2012;94(Suppl 1):24–28.PubMedCrossRef
30.
Zurück zum Zitat Sheffler LC, Yoo B, Bhandari M, Ferguson T. Observational studies in orthopaedic surgery: the STROBE statement as a tool for transparent reporting. J Bone Joint Surg Am. 2013;95:e14(1–12). Sheffler LC, Yoo B, Bhandari M, Ferguson T. Observational studies in orthopaedic surgery: the STROBE statement as a tool for transparent reporting. J Bone Joint Surg Am. 2013;95:e14(1–12).
31.
Zurück zum Zitat Shore BJ, Nasreddine AY, Kocher MS. Overcoming the funding challenge: the cost of randomized controlled trials in the next decade. J Bone Joint Surg Am. 2012;94(Suppl 1):101–106.PubMedCrossRef Shore BJ, Nasreddine AY, Kocher MS. Overcoming the funding challenge: the cost of randomized controlled trials in the next decade. J Bone Joint Surg Am. 2012;94(Suppl 1):101–106.PubMedCrossRef
32.
Zurück zum Zitat Solomon MJ, McLeod RS. Should we be performing more randomized controlled trials evaluating surgical operations? Surgery. 1995;118:459–467.PubMedCrossRef Solomon MJ, McLeod RS. Should we be performing more randomized controlled trials evaluating surgical operations? Surgery. 1995;118:459–467.PubMedCrossRef
33.
Zurück zum Zitat Study to Prospectively Evaluate Reamed Intramedullary Nails in Patients with Tibial Fractures Investigators, Bhandari M, Guyatt G, Tornetta P 3rd, Schemitsch EH, Swiontkowski M, Sanders D, Walter SD. Randomized trial of reamed and unreamed intramedullary nailing of tibial shaft fractures. J Bone Joint Surg Am. 2008;90:2567–2578. Study to Prospectively Evaluate Reamed Intramedullary Nails in Patients with Tibial Fractures Investigators, Bhandari M, Guyatt G, Tornetta P 3rd, Schemitsch EH, Swiontkowski M, Sanders D, Walter SD. Randomized trial of reamed and unreamed intramedullary nailing of tibial shaft fractures. J Bone Joint Surg Am. 2008;90:2567–2578.
34.
Zurück zum Zitat Tooth L, Ware R, Bain C, Purdie DM, Dobson A. Quality of reporting of observational longitudinal research. Am J Epidemiol. 2005;161:280–288.PubMedCrossRef Tooth L, Ware R, Bain C, Purdie DM, Dobson A. Quality of reporting of observational longitudinal research. Am J Epidemiol. 2005;161:280–288.PubMedCrossRef
35.
Zurück zum Zitat Vandenbroucke JP, von Elm E, Altman DG, Gotzsche PC, Mulrow CD, Pocock SJ, Poole C, Schlesselman JJ, Egger M, STROBE Initiative. Strengthening The Reporting of Observational Studies in Epidemiology (STROBE): explanation and elaboration. Epidemiology. 2007;18:805–835.PubMedCrossRef Vandenbroucke JP, von Elm E, Altman DG, Gotzsche PC, Mulrow CD, Pocock SJ, Poole C, Schlesselman JJ, Egger M, STROBE Initiative. Strengthening The Reporting of Observational Studies in Epidemiology (STROBE): explanation and elaboration. Epidemiology. 2007;18:805–835.PubMedCrossRef
36.
Zurück zum Zitat Wright JG, Swiontkowski MF, Heckman JD. Introducing levels of evidence to the journal. J Bone Joint Surg Am. 2003;85:1–3.PubMedCrossRef Wright JG, Swiontkowski MF, Heckman JD. Introducing levels of evidence to the journal. J Bone Joint Surg Am. 2003;85:1–3.PubMedCrossRef
37.
Zurück zum Zitat Wright JG, Yandow S, Donaldson S, Marley L, Simple Bone Cyst Trial Group. A randomized clinical trial comparing intralesional bone marrow and steroid injections for simple bone cysts. J Bone Joint Surg Am. 2008;90:722–730.PubMedCrossRef Wright JG, Yandow S, Donaldson S, Marley L, Simple Bone Cyst Trial Group. A randomized clinical trial comparing intralesional bone marrow and steroid injections for simple bone cysts. J Bone Joint Surg Am. 2008;90:722–730.PubMedCrossRef
38.
Zurück zum Zitat Zaidi R, Abbassian A, Cro S, Guha A, Cullen N, Singh D, Goldberg A. Levels of evidence in foot and ankle surgery literature: progress from 2000 to 2010? J Bone Joint Surg Am. 2012;94:e1121–1110. Zaidi R, Abbassian A, Cro S, Guha A, Cullen N, Singh D, Goldberg A. Levels of evidence in foot and ankle surgery literature: progress from 2000 to 2010? J Bone Joint Surg Am. 2012;94:e1121–1110.
Metadaten
Titel
What Are the Levels of Evidence on Which We Base Decisions for Surgical Management of Lower Extremity Bone Tumors?
verfasst von
Nathan Evaniew, MD
James Nuttall, MBBChBAO
Forough Farrokhyar, MPhil, PhD
Mohit Bhandari, MD, PhD
Michelle Ghert, MD
Publikationsdatum
01.01.2014
Verlag
Springer US
Erschienen in
Clinical Orthopaedics and Related Research® / Ausgabe 1/2014
Print ISSN: 0009-921X
Elektronische ISSN: 1528-1132
DOI
https://doi.org/10.1007/s11999-013-3311-1

Weitere Artikel der Ausgabe 1/2014

Clinical Orthopaedics and Related Research® 1/2014 Zur Ausgabe

Arthropedia

Grundlagenwissen der Arthroskopie und Gelenkchirurgie. Erweitert durch Fallbeispiele, Videos und Abbildungen. 
» Jetzt entdecken

Update Orthopädie und Unfallchirurgie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.