Skip to main content
Erschienen in:

04.02.2020 | Position Statement

Moving Sport and Exercise Science Forward: A Call for the Adoption of More Transparent Research Practices

verfasst von: Aaron R. Caldwell, Andrew D. Vigotsky, Matthew S. Tenan, Rémi Radel, David T. Mellor, Andreas Kreutzer, Ian M. Lahart, John P. Mills, Matthieu P. Boisgontier, Consortium for Transparency in Exercise Science (COTES) Collaborators

Erschienen in: Sports Medicine | Ausgabe 3/2020

Einloggen, um Zugang zu erhalten

Abstract

The primary means of disseminating sport and exercise science research is currently through journal articles. However, not all studies, especially those with null findings, make it to formal publication. This publication bias towards positive findings may contribute to questionable research practices. Preregistration is a solution to prevent the publication of distorted evidence resulting from this system. This process asks authors to register their hypotheses and methods before data collection on a publicly available repository or by submitting a Registered Report. In the Registered Report format, authors submit a stage 1 manuscript to a participating journal that includes an introduction, methods, and any pilot data indicating the exploratory or confirmatory nature of the study. After a stage 1 peer review, the manuscript can then be offered in-principle acceptance, rejected, or sent back for revisions to improve the quality of the study. If accepted, the project is guaranteed publication, assuming the authors follow the data collection and analysis protocol. After data collection, authors re-submit a stage 2 manuscript that includes the results and discussion, and the study is evaluated on clarity and conformity with the planned analysis. In its final form, Registered Reports appear almost identical to a typical publication, but give readers confidence that the hypotheses and main analyses are less susceptible to bias from questionable research practices. From this perspective, we argue that inclusion of Registered Reports by researchers and journals will improve the transparency, replicability, and trust in sport and exercise science research. The preprint version of this work is available on SportR\(\chi \)iv: https://​osf.​io/​preprints/​sportrxiv/​fxe7a/​.
Fußnoten
1
The reviewers find that the research question makes some meaningful contribution to the field and that the proposed methods are sound.
 
2
While Registered Reports are not meant to replace the current publishing approach, this would be partly appreciated. Such a transition would make the literature homogeneously more rigorous and transparent, properties that are at the heart of good science. This transition would ultimately allow readers of both original studies and meta-analyses to know that the findings have much less bias than they would in a traditional publishing format.
 
3
Registered Reports are only one step in a long process for improving sport and exercise science research. In fact, from the email thread used during the creation of this paper, the Society for Transparency, Openness, and Reproducibility in Kinesiology (STORK, http://​storkinesiology.​org/​) was formed to help address these issues.
 
Literatur
4.
Zurück zum Zitat Camerer CF, Dreber A, Holzmeister F, Ho TH, Huber J, Johannesson M, Kirchler M, Nave G, Nosek BA, Pfeiffer T, Altmejd A, Buttrick N, Chan T, Chen Y, Forsell E, Gampa A, Heikensten E, Hummer L, Imai T, Isaksson S, Manfredi D, Rose J, Wagenmakers EJ, Wu H. Evaluating the replicability of social science experiments in nature and science between 2010 and 2015. Nat Hum Behav. 2018. https://doi.org/10.1038/s41562-018-0399-z. (ISSN 2397-3374).CrossRef Camerer CF, Dreber A, Holzmeister F, Ho TH, Huber J, Johannesson M, Kirchler M, Nave G, Nosek BA, Pfeiffer T, Altmejd A, Buttrick N, Chan T, Chen Y, Forsell E, Gampa A, Heikensten E, Hummer L, Imai T, Isaksson S, Manfredi D, Rose J, Wagenmakers EJ, Wu H. Evaluating the replicability of social science experiments in nature and science between 2010 and 2015. Nat Hum Behav. 2018. https://​doi.​org/​10.​1038/​s41562-018-0399-z. (ISSN 2397-3374).CrossRef
7.
Zurück zum Zitat John Leslie K, Loewenstein George, Prelec Drazen. Measuring the prevalence of questionable research practices with incentives for truth telling. Psychol Sci. 2012;23(5):524–32.CrossRef John Leslie K, Loewenstein George, Prelec Drazen. Measuring the prevalence of questionable research practices with incentives for truth telling. Psychol Sci. 2012;23(5):524–32.CrossRef
15.
Zurück zum Zitat White PD, Sharpe MC, Chalder T, DeCesare JC, Walwyn R, Pace trial group. Protocol for the pace trial: a randomised controlled trial of adaptive pacing, cognitive behaviour therapy, and graded exercise, as supplements to standardised specialist medical care versus standardised specialist medical care alone for patients with the chronic fatigue syndrome/myalgic encephalomyelitis or encephalopathy. BMC Neurol. 2007;7:6. https://doi.org/10.1186/1471-2377-7-6(ISSN 1471-2377 (Electronic) 1471-2377 (Linking)). White PD, Sharpe MC, Chalder T, DeCesare JC, Walwyn R, Pace trial group. Protocol for the pace trial: a randomised controlled trial of adaptive pacing, cognitive behaviour therapy, and graded exercise, as supplements to standardised specialist medical care versus standardised specialist medical care alone for patients with the chronic fatigue syndrome/myalgic encephalomyelitis or encephalopathy. BMC Neurol. 2007;7:6. https://​doi.​org/​10.​1186/​1471-2377-7-6(ISSN 1471-2377 (Electronic) 1471-2377 (Linking)).
16.
Zurück zum Zitat Vink Mark. Pace trial authors continue to ignore their own null effect. J Health Psychol. 2017;22(9):1134–40.CrossRef Vink Mark. Pace trial authors continue to ignore their own null effect. J Health Psychol. 2017;22(9):1134–40.CrossRef
18.
Zurück zum Zitat Bishop David. An applied research model for the sport sciences. Sports Med. 2008;38(3):253–63.CrossRef Bishop David. An applied research model for the sport sciences. Sports Med. 2008;38(3):253–63.CrossRef
20.
Zurück zum Zitat Fischhoff B. Hindsight not equal to foresight: the effect of outcome knowledge on judgment under uncertainty. 1975. Qual Saf Health Care. 2003;12(4):304–11 (discussion 311–312. ISSN 1475-3898. PMID: 12897366 PMCID: PMC1743746). Fischhoff B. Hindsight not equal to foresight: the effect of outcome knowledge on judgment under uncertainty. 1975. Qual Saf Health Care. 2003;12(4):304–11 (discussion 311–312. ISSN 1475-3898. PMID: 12897366 PMCID: PMC1743746).
23.
Zurück zum Zitat de Groot AD. The meaning of “significance” for different types of research [translated and annotated by eric-jan wagenmakers, denny borsboom, josine verhagen, rogier kievit, marjan bakker, angelique cramer, dora matzke, don mellenbergh, and han l. j. van der maas]. 1969. Acta Psychol (Amst). 2014;148:188–94. https://doi.org/10.1016/j.actpsy.2014.02.001(ISSN 1873-6297, PMID: 24589374).CrossRef de Groot AD. The meaning of “significance” for different types of research [translated and annotated by eric-jan wagenmakers, denny borsboom, josine verhagen, rogier kievit, marjan bakker, angelique cramer, dora matzke, don mellenbergh, and han l. j. van der maas]. 1969. Acta Psychol (Amst). 2014;148:188–94. https://​doi.​org/​10.​1016/​j.​actpsy.​2014.​02.​001(ISSN 1873-6297, PMID: 24589374).CrossRef
28.
Zurück zum Zitat Gelman A, Loken E. The garden of forking paths: Why multiple comparisons can be a problem, even when there is no “fishing expedition” or “p-hacking” and the research hypothesis was posited ahead of time. 2013. Gelman A, Loken E. The garden of forking paths: Why multiple comparisons can be a problem, even when there is no “fishing expedition” or “p-hacking” and the research hypothesis was posited ahead of time. 2013.
30.
Zurück zum Zitat Silberzahn R, Uhlmann EL, Martin DP, Anselmi P, Aust F, Awtrey E, Bahník Š, Bai F, Bannard C, Bonnier CE, Carlsson R, Cheung F, Christensen G, Clay R, Craig MA, Dalla Rosa A, Dam L, Evans MH, Cervantes I Flores, Fong N, Gamez-Djokic M, Glenz A, Gordon-McKeon S, Heaton TJ, Hederos K, Heene M, Hofelich Mohr AJ, Högden F, Hui K, Johannesson M, Kalodimos J, Kaszubowski E, Kennedy DM, Lei R, Lindsay TA, Liverani S, Madan CR, Molden D, Molleman E, Morey RD, Mulder LB, Nijstad BR, Pope NG, Pope B, Prenoveau JM, Rink F, Robusto E, Roderique H, Sandberg A, Schlüter E, Schönbrodt FD, Sherman MF, Sommer SA, Sotak K, Spain S, Spörlein C, Stafford T, Stefanutti L, Tauber S, Ullrich J, Vianello M, Wagenmakers E-J, Witkowiak M, Yoon S, Nosek BA. Many analysts, one data set: making transparent how variations in analytic choices affect results. Adv Methods Pract Psychol Sci. 2018. https://doi.org/10.1177/2515245917747646 (ISSN 2515-2459).CrossRef Silberzahn R, Uhlmann EL, Martin DP, Anselmi P, Aust F, Awtrey E, Bahník Š, Bai F, Bannard C, Bonnier CE, Carlsson R, Cheung F, Christensen G, Clay R, Craig MA, Dalla Rosa A, Dam L, Evans MH, Cervantes I Flores, Fong N, Gamez-Djokic M, Glenz A, Gordon-McKeon S, Heaton TJ, Hederos K, Heene M, Hofelich Mohr AJ, Högden F, Hui K, Johannesson M, Kalodimos J, Kaszubowski E, Kennedy DM, Lei R, Lindsay TA, Liverani S, Madan CR, Molden D, Molleman E, Morey RD, Mulder LB, Nijstad BR, Pope NG, Pope B, Prenoveau JM, Rink F, Robusto E, Roderique H, Sandberg A, Schlüter E, Schönbrodt FD, Sherman MF, Sommer SA, Sotak K, Spain S, Spörlein C, Stafford T, Stefanutti L, Tauber S, Ullrich J, Vianello M, Wagenmakers E-J, Witkowiak M, Yoon S, Nosek BA. Many analysts, one data set: making transparent how variations in analytic choices affect results. Adv Methods Pract Psychol Sci. 2018. https://​doi.​org/​10.​1177/​2515245917747646​ (ISSN 2515-2459).CrossRef
37.
Zurück zum Zitat Atkinson G, Batterham AM. True and false interindividual differences in the physiological response to an intervention. Exp Physiol. 2015;100(6):577–88.CrossRef Atkinson G, Batterham AM. True and false interindividual differences in the physiological response to an intervention. Exp Physiol. 2015;100(6):577–88.CrossRef
41.
Zurück zum Zitat Earnest Conrad, Roberts Brandon, Harnish Christopher, Kutz Jessica, Cholewa Jason, Johannsen Neil. Reporting characteristics in sports nutrition. Sports (Basel). 2018;6(4):139.CrossRef Earnest Conrad, Roberts Brandon, Harnish Christopher, Kutz Jessica, Cholewa Jason, Johannsen Neil. Reporting characteristics in sports nutrition. Sports (Basel). 2018;6(4):139.CrossRef
42.
Zurück zum Zitat Kothari CR. Research methodology: methods and techniques. New Age International, 2004. Google-Books-ID: hZ9wSHysQDYC (ISBN 978-81-224-1522-3). Kothari CR. Research methodology: methods and techniques. New Age International, 2004. Google-Books-ID: hZ9wSHysQDYC (ISBN 978-81-224-1522-3).
44.
Zurück zum Zitat Lakens Daniël, Evers Ellen RK. Sailing from the seas of chaos into the corridor of stability: practical recommendations to increase the informational value of studies. Perspect Psychol Sci. 2014;9(3):278–92.CrossRef Lakens Daniël, Evers Ellen RK. Sailing from the seas of chaos into the corridor of stability: practical recommendations to increase the informational value of studies. Perspect Psychol Sci. 2014;9(3):278–92.CrossRef
45.
Zurück zum Zitat Jonas KJ, Cesario J, Alger M, Bailey AH, Bombari D, Carney D, Dovidio JF, Duffy S, Harder JA, van Dian H, Jackson B, Johnson DJ, Keller VN, Klaschinski L, LaBelle O, LaFrance M, Latu IM, Morssinkhoff M, Nault K, Pardal V, Pulfrey C, Rohleder N, Ronay R, Richman LS, Mast MS, Schnabel K, Schröder-Abé M, Tybur JM. Power poses–where do we stand? Compr Results Soc Psychol. 2017;2(1):139–41. https://doi.org/10.1080/23743603.2017.1342447 (ISSN 2374-3603).CrossRef Jonas KJ, Cesario J, Alger M, Bailey AH, Bombari D, Carney D, Dovidio JF, Duffy S, Harder JA, van Dian H, Jackson B, Johnson DJ, Keller VN, Klaschinski L, LaBelle O, LaFrance M, Latu IM, Morssinkhoff M, Nault K, Pardal V, Pulfrey C, Rohleder N, Ronay R, Richman LS, Mast MS, Schnabel K, Schröder-Abé M, Tybur JM. Power poses–where do we stand? Compr Results Soc Psychol. 2017;2(1):139–41. https://​doi.​org/​10.​1080/​23743603.​2017.​1342447 (ISSN 2374-3603).CrossRef
47.
Zurück zum Zitat Hagger MS, Chatzisarantis NLD, Alberts H, Anggono CO, Batailler C, Birt AR, Brand R, Brandt MJ, Brewer G, Bruyneel S, Calvillo DP, Campbell WK, Cannon PR, Carlucci M, Carruth NP, Cheung T, Crowell A, De Ridder DTD, Dewitte S, Elson M, Evans JR, Fay BA, Fennis BM, Finley A, Francis Z, Heise E, Hoemann H, Inzlicht M, Koole SL, Koppel L, Kroese F, Lange F, Lau K, Lynch BP, Martijn C, Merckelbach H, Mills NV, Michirev A, Miyake A, Mosser AE, Muise M, Muller D, Muzi M, Nalis D, Nurwanti R, Otgaar H, Philipp MC, Primoceri P, Rentzsch K, Ringos L, Schlinkert C, Schmeichel BJ, Schoch SF, Schrama M, Schütz A, Stamos A, Tingög G, Ullrich J, vanDellen M, Wimbarti S, Wolff W, Yusainy C, Zerhouni O, Zwienenberg M. A multilab preregistered replication of the ego-depletion effect. Perspect Psychol Sci. 2016;11(4):546–73. https://doi.org/10.1177/1745691616652873 (ISSN 1745-6916).CrossRefPubMed Hagger MS, Chatzisarantis NLD, Alberts H, Anggono CO, Batailler C, Birt AR, Brand R, Brandt MJ, Brewer G, Bruyneel S, Calvillo DP, Campbell WK, Cannon PR, Carlucci M, Carruth NP, Cheung T, Crowell A, De Ridder DTD, Dewitte S, Elson M, Evans JR, Fay BA, Fennis BM, Finley A, Francis Z, Heise E, Hoemann H, Inzlicht M, Koole SL, Koppel L, Kroese F, Lange F, Lau K, Lynch BP, Martijn C, Merckelbach H, Mills NV, Michirev A, Miyake A, Mosser AE, Muise M, Muller D, Muzi M, Nalis D, Nurwanti R, Otgaar H, Philipp MC, Primoceri P, Rentzsch K, Ringos L, Schlinkert C, Schmeichel BJ, Schoch SF, Schrama M, Schütz A, Stamos A, Tingög G, Ullrich J, vanDellen M, Wimbarti S, Wolff W, Yusainy C, Zerhouni O, Zwienenberg M. A multilab preregistered replication of the ego-depletion effect. Perspect Psychol Sci. 2016;11(4):546–73. https://​doi.​org/​10.​1177/​1745691616652873​ (ISSN 1745-6916).CrossRefPubMed
52.
Zurück zum Zitat Altman Douglas G, Simera Iveta, Hoey John, Moher David. Equator: reporting guidelines for health research. Lancet. 2008;371(9619):1149–50.CrossRef Altman Douglas G, Simera Iveta, Hoey John, Moher David. Equator: reporting guidelines for health research. Lancet. 2008;371(9619):1149–50.CrossRef
62.
Zurück zum Zitat DeHaven AC, Graf C, Mellor DT, Morris E, Moylan E, Pedder S, Tan S. Registered reports: views from editors, reviewers and authors. MetaArXiv. September.2019;17. DeHaven AC, Graf C, Mellor DT, Morris E, Moylan E, Pedder S, Tan S. Registered reports: views from editors, reviewers and authors. MetaArXiv. September.2019;17.
63.
Zurück zum Zitat Chambers C. What’s next for registered reports? 2019. Chambers C. What’s next for registered reports? 2019.
64.
Zurück zum Zitat Wood J, Freemantle N, King M, Nazareth I. Trap of trends to statistical significance: likelihood of near significant p value becoming more significant with extra data. BMJ. 2014;348:g2215.CrossRef Wood J, Freemantle N, King M, Nazareth I. Trap of trends to statistical significance: likelihood of near significant p value becoming more significant with extra data. BMJ. 2014;348:g2215.CrossRef
65.
Zurück zum Zitat Greenland S, Senn SJ, Rothman KJ, Carlin JB, Poole C, Goodman SN, Altman DG. Statistical tests, p values, confidence intervals, and power: a guide to misinterpretations. Eur J Epidemiol. 2016;31(4):337–50.CrossRef Greenland S, Senn SJ, Rothman KJ, Carlin JB, Poole C, Goodman SN, Altman DG. Statistical tests, p values, confidence intervals, and power: a guide to misinterpretations. Eur J Epidemiol. 2016;31(4):337–50.CrossRef
Metadaten
Titel
Moving Sport and Exercise Science Forward: A Call for the Adoption of More Transparent Research Practices
verfasst von
Aaron R. Caldwell
Andrew D. Vigotsky
Matthew S. Tenan
Rémi Radel
David T. Mellor
Andreas Kreutzer
Ian M. Lahart
John P. Mills
Matthieu P. Boisgontier
Consortium for Transparency in Exercise Science (COTES) Collaborators
Publikationsdatum
04.02.2020
Verlag
Springer International Publishing
Erschienen in
Sports Medicine / Ausgabe 3/2020
Print ISSN: 0112-1642
Elektronische ISSN: 1179-2035
DOI
https://doi.org/10.1007/s40279-019-01227-1

Arthropedia

Grundlagenwissen der Arthroskopie und Gelenkchirurgie erweitert durch Fallbeispiele, Videos und Abbildungen. Zur Fortbildung und Wissenserweiterung, verfasst und geprüft von Expertinnen und Experten der Gesellschaft für Arthroskopie und Gelenkchirurgie (AGA).


Jetzt entdecken!

Neu im Fachgebiet Orthopädie und Unfallchirurgie

Knapp 2% mit Infektionen nach Hüftfraktur-Op.

Infekte im Op.-Bereich sind die häufigsten spezifischen Komplikationen nach einer Hüftfraktur-Op. Längerfristig machen vor allem ein Versagen der Fixierung sowie periprothetische oder periimplantäre Frakturen zu schaffen. Darauf deutet eine Analyse von 95 Studien.

Hamstring-Reparatur des Kreuzbandes ist revisionsanfällig

Die operative Rekonstruktion eines gerissenen vorderen Kreuzbandes löst die Probleme nicht immer dauerhaft. Wie oft, wann und warum Revisionseingriffe fällig werden, haben norwegische Orthopäden untersucht.

Ab sofort gelten die neuen Verordnungsausnahmen für Lipidsenker

Freie Fahrt für Lipidsenker? Das nicht, doch mit niedrigerem Schwellenwert fürs Infarktrisiko und neuen Indikationen hat der G-BA die Verordnungs-Handbremse ein gutes Stück weit gelockert.

Aerobes Training hilft bei Fibromyalgie

Sport im aeroben Bereich ist ein veritables Mittel, um die Schmerzen von Menschen mit Fibromyalgie zu reduzieren, wie eine Metaanalyse zeigt. Frequenz, Dauer und Intensität der Übungen geben den Ausschlag.

Update Orthopädie und Unfallchirurgie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.