Skip to main content
Erschienen in: BMC Psychiatry 1/2023

Open Access 01.12.2023 | Correspondence

Only one cluster per condition is an invalid design for a cluster randomized trial and should be re-labeled a quasi-experimental study. Response to: “Effect of behavioral activation on time and frequency domain heart rate variability in older adults with subthreshold depression: a cluster randomized controlled trial in Thailand”

verfasst von: Yasaman Jamshidi-Naeini, Lilian Golzarri-Arroyo, Abu Bakkar Siddique, Colby J. Vorland, David B. Allison

Erschienen in: BMC Psychiatry | Ausgabe 1/2023

download
DOWNLOAD
print
DRUCKEN
insite
SUCHEN

Abstract

Ayudhaya et al. examined the effect of Behavioral Activation on daily step count and heart rate variability among older adults with depression in a study labeled a cluster randomized controlled trial (cRCT). However, only one cluster was assigned to either of the study conditions. Such a design would have zero degrees of freedom for inferential testing, because the variation due to cluster membership cannot be estimated apart from the variation due to treatment assignment. Thus, the intervention effect is completely confounded with the cluster effect. The study should be labeled a quasi-experimental study, not a cRCT. Accordingly, the numerical results should be interpreted as associations but not evidence for causal relationships.
Hinweise

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Abkürzungen
BA
Behavioral Activation
cRCT
Cluster Randomized Controlled Trial
Ayudhaya et al. [1] conducted a study to examine the effect of Behavioral Activation (BA) on daily step count (as a physical activity indicator) and heart rate variability (as a depression-related autonomic function indicator) among community-dwelling older adults with mild to moderate depression. The article is labeled as a cluster randomized controlled trial (cRCT). However, there is only one cluster (i.e., hospitals) assigned to either of the study conditions (BA plus usual care or usual care only), which makes the study design invalid for estimating the causal effect of treatment assignment. Forty-one participants were recruited in each hospital after they were assigned to study conditions.
In cRCTs, there can be and typically are correlated data within each cluster (i.e., unit of randomization) so “errors” (loosely speaking, model residuals) cannot be assumed to be independent across study participants within clusters. Moreover, when clusters (rather than individuals) are assigned to study conditions, the study has a hierarchical structure (individuals nested in clusters) [2]. Thus, the degrees of freedom for testing the intervention effect depends both on the number of individual participants and on the number of clusters per condition [3]. A purported cRCT with two conditions and only one cluster assigned to each condition, such as Ayudhaya et al.’s study [1], would have zero degrees of freedom (n1 + n2–2) for inferential testing. That is, the variation due to cluster membership cannot be estimated apart from the variation due to treatment assignment, and a valid analysis of the intervention effect could not exist [4].
We commend Ayudhaya et al. for addressing an important question about depression among the older population, and for their collegiality in providing clarification about their study design. The authors’ clarification confirmed our understanding from reading the published methods.
Because in Ayudhaya et al.’s study [1] the intervention effect is completely confounded with the cluster effect, it should be labeled a quasi-experimental study, not a cRCT. Accordingly, the numerical results should be interpreted as associations between BA and the outcomes but not evidence for causal relationships [5].

Acknowledgements

Not applicable.

Declarations

Not applicable.
Not applicable.

Competing interests

Dr. Allison and his institution (Indiana University) have received payments for consultation, grants, contracts, in-kind donations, and contributions from multiple for-profit and not-for-profit entities interested in statistical design and analysis of experiments, but not directly related to the research questions addressed in the paper question.
Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://​creativecommons.​org/​licenses/​by/​4.​0/​. The Creative Commons Public Domain Dedication waiver (http://​creativecommons.​org/​publicdomain/​zero/​1.​0/​) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Literatur
1.
Zurück zum Zitat Ayudhaya WSN, Pityaratstian N, Eungpinichpong W, et al. Effect of behavioral activation on time and frequency domain heart rate variability in older adults with subthreshold depression: a cluster randomized controlled trial in Thailand. BMC Psychiatry. 2022;22:319.CrossRef Ayudhaya WSN, Pityaratstian N, Eungpinichpong W, et al. Effect of behavioral activation on time and frequency domain heart rate variability in older adults with subthreshold depression: a cluster randomized controlled trial in Thailand. BMC Psychiatry. 2022;22:319.CrossRef
2.
Zurück zum Zitat Murray DM, Varnell SP, Blitstein JL. Design and analysis of group-randomized trials: a review of recent methodological developments. Am J Public Health. 2004;94:423–32.CrossRef Murray DM, Varnell SP, Blitstein JL. Design and analysis of group-randomized trials: a review of recent methodological developments. Am J Public Health. 2004;94:423–32.CrossRef
3.
Zurück zum Zitat Jamshidi-Naeini Y, Brown AW, Mehta T, et al. A practical decision tree to support editorial adjudication of submitted parallel cluster randomized controlled trials. Obesity. 2022;30:565–70.CrossRef Jamshidi-Naeini Y, Brown AW, Mehta T, et al. A practical decision tree to support editorial adjudication of submitted parallel cluster randomized controlled trials. Obesity. 2022;30:565–70.CrossRef
4.
Zurück zum Zitat Varnell SP, Murray DM, Baker WL. An evaluation of analysis options for the one-group-per-condition design: can any of the alternatives overcome the problems inherent in this design? Eval Rev. 2001;25:440–53.CrossRef Varnell SP, Murray DM, Baker WL. An evaluation of analysis options for the one-group-per-condition design: can any of the alternatives overcome the problems inherent in this design? Eval Rev. 2001;25:440–53.CrossRef
5.
Zurück zum Zitat Shadish WR, Cook TD, Campbell DT. Experimental and quasi-experimental designs for generalized causal inference. Boston: Houghton Mifflin. 2002. Shadish WR, Cook TD, Campbell DT. Experimental and quasi-experimental designs for generalized causal inference. Boston: Houghton Mifflin. 2002.
Metadaten
Titel
Only one cluster per condition is an invalid design for a cluster randomized trial and should be re-labeled a quasi-experimental study. Response to: “Effect of behavioral activation on time and frequency domain heart rate variability in older adults with subthreshold depression: a cluster randomized controlled trial in Thailand”
verfasst von
Yasaman Jamshidi-Naeini
Lilian Golzarri-Arroyo
Abu Bakkar Siddique
Colby J. Vorland
David B. Allison
Publikationsdatum
01.12.2023
Verlag
BioMed Central
Erschienen in
BMC Psychiatry / Ausgabe 1/2023
Elektronische ISSN: 1471-244X
DOI
https://doi.org/10.1186/s12888-022-04491-0

Weitere Artikel der Ausgabe 1/2023

BMC Psychiatry 1/2023 Zur Ausgabe

„Übersichtlicher Wegweiser“: Lauterbachs umstrittener Klinik-Atlas ist online

17.05.2024 Klinik aktuell Nachrichten

Sie sei „ethisch geboten“, meint Gesundheitsminister Karl Lauterbach: mehr Transparenz über die Qualität von Klinikbehandlungen. Um sie abzubilden, lässt er gegen den Widerstand vieler Länder einen virtuellen Klinik-Atlas freischalten.

ADHS-Medikation erhöht das kardiovaskuläre Risiko

16.05.2024 Herzinsuffizienz Nachrichten

Erwachsene, die Medikamente gegen das Aufmerksamkeitsdefizit-Hyperaktivitätssyndrom einnehmen, laufen offenbar erhöhte Gefahr, an Herzschwäche zu erkranken oder einen Schlaganfall zu erleiden. Es scheint eine Dosis-Wirkungs-Beziehung zu bestehen.

Klinikreform soll zehntausende Menschenleben retten

15.05.2024 Klinik aktuell Nachrichten

Gesundheitsminister Lauterbach hat die vom Bundeskabinett beschlossene Klinikreform verteidigt. Kritik an den Plänen kommt vom Marburger Bund. Und in den Ländern wird über den Gang zum Vermittlungsausschuss spekuliert.

Typ-2-Diabetes und Depression folgen oft aufeinander

14.05.2024 Typ-2-Diabetes Nachrichten

Menschen mit Typ-2-Diabetes sind überdurchschnittlich gefährdet, in den nächsten Jahren auch noch eine Depression zu entwickeln – und umgekehrt. Besonders ausgeprägt ist die Wechselbeziehung laut GKV-Daten bei jüngeren Erwachsenen.