Skip to main content
Erschienen in: Annals of Behavioral Medicine 6/2015

01.12.2015 | Original Article

Reliability of Identification of Behavior Change Techniques in Intervention Descriptions

verfasst von: Charles Abraham, PhD, Caroline E Wood, PhD, Marie Johnston, PhD, Jill Francis, PhD, Wendy Hardeman, PhD, Michelle Richardson, PhD, Susan Michie, PhD

Erschienen in: Annals of Behavioral Medicine | Ausgabe 6/2015

Einloggen, um Zugang zu erhalten

Abstract

Purpose

The aim of this paper is to assess the frequency of identification as well as the inter-coder and test–retest reliability of identification of behavior change techniques (BCTs) in written intervention descriptions.

Methods

Forty trained coders applied the “Behavior Change Technique Taxonomy version 1” (BCTTv1) to 40 intervention descriptions published in protocols and repeated this 1 month later.

Results

Eighty of 93 defined BCTs were identified by at least one trained coder, and 22 BCTs were identified in 16 (40 %) or more of 40 descriptions. Good inter-coder reliability was observed across 80 BCTs identified in the protocols: 66 (80 %) achieved mean prevalence and bias-adjusted kappa (PABAK) scores of 0.70 or greater, and 59 (74 %) achieved mean scores of 0.80 or greater. There was good within-coder agreement between baseline and 1 month, demonstrating good test–retest reliability.

Conclusions

BCTTv1 can be used by trained coders to identify BCTs in intervention descriptions reliably. However, some frequently occurring BCT definitions require further clarification.
Anhänge
Nur mit Berechtigung zugänglich
Literatur
1.
Zurück zum Zitat Whitlock G, Lewington S, Sherliker P, et al. Body-mass index and cause-specific mortality in 900 000 adults: Collaborative analyses of 57 prospective studies. Lancet. 2009; 373: 1083-1096.CrossRefPubMed Whitlock G, Lewington S, Sherliker P, et al. Body-mass index and cause-specific mortality in 900 000 adults: Collaborative analyses of 57 prospective studies. Lancet. 2009; 373: 1083-1096.CrossRefPubMed
2.
Zurück zum Zitat Wing R, Jeffery R. Benefits of recruiting participants with friends and increasing social support for weight loss and maintenance. J Consult Clin Psychol. 1999; 67: 132-138.CrossRefPubMed Wing R, Jeffery R. Benefits of recruiting participants with friends and increasing social support for weight loss and maintenance. J Consult Clin Psychol. 1999; 67: 132-138.CrossRefPubMed
4.
Zurück zum Zitat Denford S, Abraham C, Smith J, et al. Designing and evaluating behavior change interventions to promote health. In: Reynolds KJ, Branscombe NR, eds. The Psychology of Change: Life Contexts, Experiences, and Identities. New York: Psychology Press; 2015. Denford S, Abraham C, Smith J, et al. Designing and evaluating behavior change interventions to promote health. In: Reynolds KJ, Branscombe NR, eds. The Psychology of Change: Life Contexts, Experiences, and Identities. New York: Psychology Press; 2015.
5.
Zurück zum Zitat Davidson KW, Goldstein M, Kaplan RM, et al. Evidence-based behavioral medicine: What is it and how do we achieve it? Ann Behav Med. 2003; 26: 161-171.CrossRefPubMed Davidson KW, Goldstein M, Kaplan RM, et al. Evidence-based behavioral medicine: What is it and how do we achieve it? Ann Behav Med. 2003; 26: 161-171.CrossRefPubMed
6.
Zurück zum Zitat Abraham C, Michie S. A taxonomy of behavior change techniques used in interventions. Health Psychol. 2008; 27: 379-387.CrossRefPubMed Abraham C, Michie S. A taxonomy of behavior change techniques used in interventions. Health Psychol. 2008; 27: 379-387.CrossRefPubMed
7.
Zurück zum Zitat Albarracín D, Gillette JC, Earl AN, et al. A test of major assumptions about behavior change: A comprehensive look at the effects of passive and active HIV-prevention interventions since the beginning of the epidemic. Psychol Bull. 2005; 131: 856-897.PubMedCentralCrossRefPubMed Albarracín D, Gillette JC, Earl AN, et al. A test of major assumptions about behavior change: A comprehensive look at the effects of passive and active HIV-prevention interventions since the beginning of the epidemic. Psychol Bull. 2005; 131: 856-897.PubMedCentralCrossRefPubMed
8.
Zurück zum Zitat Moher D, Schulz K, Altman D. The CONSORT statement: Revised recommendations for improving the quality of reports of parallel-group randomised trials. Clin Oral Investig. 2003; 7: 2-7.PubMed Moher D, Schulz K, Altman D. The CONSORT statement: Revised recommendations for improving the quality of reports of parallel-group randomised trials. Clin Oral Investig. 2003; 7: 2-7.PubMed
9.
Zurück zum Zitat CONSORT Group, Boutron I, Moher D, et al. Statement to randomized trials of non-pharmacologic treatment: Explanation and elaboration. Ann Intern Med. 2008; 148: 295-309.CrossRef CONSORT Group, Boutron I, Moher D, et al. Statement to randomized trials of non-pharmacologic treatment: Explanation and elaboration. Ann Intern Med. 2008; 148: 295-309.CrossRef
10.
Zurück zum Zitat Hoffmann T, Glasziou P, Boutron I, et al. Better reporting of interventions: Template for intervention description and replication (TIDieR) checklist and guide. BMJ. 2014; 348. Hoffmann T, Glasziou P, Boutron I, et al. Better reporting of interventions: Template for intervention description and replication (TIDieR) checklist and guide. BMJ. 2014; 348.
11.
Zurück zum Zitat Abraham C. Designing and evaluating interventions to change health-related behaviour patterns. In: Boutron I, Ravaud P, Moher D, eds. Randomized Clinical Trials of Non-Pharmacologic Treatments. London: Chapman and Hall; 2012: 357-368. Abraham C. Designing and evaluating interventions to change health-related behaviour patterns. In: Boutron I, Ravaud P, Moher D, eds. Randomized Clinical Trials of Non-Pharmacologic Treatments. London: Chapman and Hall; 2012: 357-368.
12.
Zurück zum Zitat Abraham C, Johnson BT, de Bruin M, et al. Enhancing reporting of behavior change intervention evaluations. JAIDS. 2014; 15: S293-9. Abraham C, Johnson BT, de Bruin M, et al. Enhancing reporting of behavior change intervention evaluations. JAIDS. 2014; 15: S293-9.
13.
Zurück zum Zitat Albrecht L, Archibald M, Arseneau D, et al. Development of a checklist to assess the quality of reporting of knowledge translation interventions using the Workgroup for Intervention Development and Evaluation Research (WIDER) recommendations. Implement Sci. 2013; 8: 52.PubMedCentralCrossRefPubMed Albrecht L, Archibald M, Arseneau D, et al. Development of a checklist to assess the quality of reporting of knowledge translation interventions using the Workgroup for Intervention Development and Evaluation Research (WIDER) recommendations. Implement Sci. 2013; 8: 52.PubMedCentralCrossRefPubMed
14.
Zurück zum Zitat Hoffmann T, English T, Glasziou P. Reporting of interventions in randomised trials: An audit of journal instructions to authors. Trials. 2014; 15: 20.PubMedCentralCrossRefPubMed Hoffmann T, English T, Glasziou P. Reporting of interventions in randomised trials: An audit of journal instructions to authors. Trials. 2014; 15: 20.PubMedCentralCrossRefPubMed
15.
Zurück zum Zitat Glasgow R, Bull S, Gillette C, et al. Behavior change intervention research in healthcare settings: A review of recent reports with emphasis on external validity. Am J Prev Med. 2002; 23: 62-69.CrossRefPubMed Glasgow R, Bull S, Gillette C, et al. Behavior change intervention research in healthcare settings: A review of recent reports with emphasis on external validity. Am J Prev Med. 2002; 23: 62-69.CrossRefPubMed
16.
Zurück zum Zitat Bartholomew L, Parcel G, Kok G, et al., eds. Planning Health Promotion Programs: An Intervention Mapping Approach. 3rd ed. San Francisco: Jossey-Bass; 2011. Bartholomew L, Parcel G, Kok G, et al., eds. Planning Health Promotion Programs: An Intervention Mapping Approach. 3rd ed. San Francisco: Jossey-Bass; 2011.
17.
Zurück zum Zitat Michie S, van Stralen MM, West R. The behaviour change wheel: A new method for characterising and designing behaviour change interventions. Implement Sci. 2011; 6: 42.PubMedCentralCrossRefPubMed Michie S, van Stralen MM, West R. The behaviour change wheel: A new method for characterising and designing behaviour change interventions. Implement Sci. 2011; 6: 42.PubMedCentralCrossRefPubMed
18.
Zurück zum Zitat Michie S. Behaviour change techniques. In: Gellman MT, Rick J, eds. Encyclopedia of Behavioural Medicine. London: Springer; 2013: 182-187. Michie S. Behaviour change techniques. In: Gellman MT, Rick J, eds. Encyclopedia of Behavioural Medicine. London: Springer; 2013: 182-187.
19.
Zurück zum Zitat Michie S, Abraham C, Whittington C, et al. Effective techniques in healthy eating and physical activity interventions: A meta-regression. Health Psychol. 2009; 28: 690-701.CrossRefPubMed Michie S, Abraham C, Whittington C, et al. Effective techniques in healthy eating and physical activity interventions: A meta-regression. Health Psychol. 2009; 28: 690-701.CrossRefPubMed
20.
Zurück zum Zitat Carver CS, Scheier MF. Control theory: A useful conceptual framework for personality—social, clinical, and health psychology. Psychol Bull. 1982; 92: 111.CrossRefPubMed Carver CS, Scheier MF. Control theory: A useful conceptual framework for personality—social, clinical, and health psychology. Psychol Bull. 1982; 92: 111.CrossRefPubMed
21.
Zurück zum Zitat Michie S, Ashford S, Sniehotta FF, et al. A refined taxonomy of behaviour change techniques to help people change their physical activity and healthy eating behaviours: The CALO-RE taxonomy. Psychol Health. 2011; 26: 1479-1498.CrossRefPubMed Michie S, Ashford S, Sniehotta FF, et al. A refined taxonomy of behaviour change techniques to help people change their physical activity and healthy eating behaviours: The CALO-RE taxonomy. Psychol Health. 2011; 26: 1479-1498.CrossRefPubMed
22.
Zurück zum Zitat Michie S, Hyder N, Walia A, et al. Development of a taxonomy of behaviour change techniques used in individual behavioural support for smoking cessation. Addict Behav. 2011; 36: 315-319.CrossRefPubMed Michie S, Hyder N, Walia A, et al. Development of a taxonomy of behaviour change techniques used in individual behavioural support for smoking cessation. Addict Behav. 2011; 36: 315-319.CrossRefPubMed
23.
Zurück zum Zitat Michie S, Churchill S, West R. Identifying evidence-based competences required to deliver behavioural support for smoking cessation. Ann Behav Med. 2011; 41: 59-70.CrossRefPubMed Michie S, Churchill S, West R. Identifying evidence-based competences required to deliver behavioural support for smoking cessation. Ann Behav Med. 2011; 41: 59-70.CrossRefPubMed
24.
Zurück zum Zitat Michie S, Whittington C, Hamoudi Z, et al. Identification of behaviour change techniques to reduce excessive alcohol consumption. Addiction. 2012; 107: 1431-1440.CrossRefPubMed Michie S, Whittington C, Hamoudi Z, et al. Identification of behaviour change techniques to reduce excessive alcohol consumption. Addiction. 2012; 107: 1431-1440.CrossRefPubMed
25.
Zurück zum Zitat Abraham C, Good A, Huedo-Medina TB, et al. Reliability and utility of the SHARP taxonomy of behaviour change techniques. Psychol Health. 2012; 27: 1-2. Abraham C, Good A, Huedo-Medina TB, et al. Reliability and utility of the SHARP taxonomy of behaviour change techniques. Psychol Health. 2012; 27: 1-2.
26.
Zurück zum Zitat Ivers N, Jamtvedt G, Flottorp S, et al. Audit and feedback: Effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev. 2012; 6: Cd000259.PubMed Ivers N, Jamtvedt G, Flottorp S, et al. Audit and feedback: Effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev. 2012; 6: Cd000259.PubMed
27.
Zurück zum Zitat Schulz R, Czaja SJ, McKay JR, et al. Intervention taxonomy (ITAX): Describing essential features of interventions (HMC). Am J Health Behav. 2010; 34: 811-821.PubMedCentralCrossRefPubMed Schulz R, Czaja SJ, McKay JR, et al. Intervention taxonomy (ITAX): Describing essential features of interventions (HMC). Am J Health Behav. 2010; 34: 811-821.PubMedCentralCrossRefPubMed
28.
Zurück zum Zitat Michie S, Richardson M, Johnston M, et al. The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: Building an international consensus for the reporting of behavior change interventions. Ann Behav Med. 2013; 46: 81-95.CrossRefPubMed Michie S, Richardson M, Johnston M, et al. The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: Building an international consensus for the reporting of behavior change interventions. Ann Behav Med. 2013; 46: 81-95.CrossRefPubMed
29.
Zurück zum Zitat Michie S, Abraham C, Eccles MP, et al. Strengthening evaluation and implementation by specifying components of behaviour change interventions: A study protocol. Implement Sci. 2011; 6: 10.PubMedCentralCrossRefPubMed Michie S, Abraham C, Eccles MP, et al. Strengthening evaluation and implementation by specifying components of behaviour change interventions: A study protocol. Implement Sci. 2011; 6: 10.PubMedCentralCrossRefPubMed
30.
Zurück zum Zitat Wood C, Richardson M, Johnston M, et al.: Applying the Behaviour Change Technique (BCT) Taxonomy v1: A study of coder training. Tran Behav Med. 2014:1–15. Wood C, Richardson M, Johnston M, et al.: Applying the Behaviour Change Technique (BCT) Taxonomy v1: A study of coder training. Tran Behav Med. 2014:1–15.
31.
Zurück zum Zitat Byrt T, Bishop J, Carlin JB. Bias, prevalence and kappa. J Clin Epidemiol. 1993; 46: 423-429.CrossRefPubMed Byrt T, Bishop J, Carlin JB. Bias, prevalence and kappa. J Clin Epidemiol. 1993; 46: 423-429.CrossRefPubMed
32.
Zurück zum Zitat Cohen J. Weighted kappa: nominal scale agreement provision for scaled disagreement or partial credit. Psychol Bull. 1968; 70: 213.CrossRefPubMed Cohen J. Weighted kappa: nominal scale agreement provision for scaled disagreement or partial credit. Psychol Bull. 1968; 70: 213.CrossRefPubMed
33.
Zurück zum Zitat Gwet KL: Handbook of Inter-Rater Reliability: The Definitive Guide to Measuring the Extent of Agreement Among Multiple Raters: Advanced Analytics Press, 2012. Gwet KL: Handbook of Inter-Rater Reliability: The Definitive Guide to Measuring the Extent of Agreement Among Multiple Raters: Advanced Analytics Press, 2012.
34.
Zurück zum Zitat Gwet K: Inter-rater reliability: dependency on trait prevalence and marginal homogeneity. Statistical Methods for Inter-Rater Reliability Assessment Series, 2002. Gwet K: Inter-rater reliability: dependency on trait prevalence and marginal homogeneity. Statistical Methods for Inter-Rater Reliability Assessment Series, 2002.
35.
Zurück zum Zitat van Beurden, S. B., Greaves, C. J., Smith, J. R. & Abraham, C. (under review). Techniques for managing impulsive processes associated with unhealthy eating: A systematic review. Health Psychology. van Beurden, S. B., Greaves, C. J., Smith, J. R. & Abraham, C. (under review). Techniques for managing impulsive processes associated with unhealthy eating: A systematic review. Health Psychology.
36.
Zurück zum Zitat Hovland CI, Janis IL, Kelley HH: Communication and persuasion; psychological studies of opinion change. 1953. Hovland CI, Janis IL, Kelley HH: Communication and persuasion; psychological studies of opinion change. 1953.
37.
Zurück zum Zitat Durantini MR, Albarracin D, Mitchell AL, et al. Conceptualizing the influence of social agents of behavior change: A meta-analysis of the effectiveness of HIV-prevention interventionists for different groups. Psychol Bull. 2006; 132: 212-248.CrossRefPubMed Durantini MR, Albarracin D, Mitchell AL, et al. Conceptualizing the influence of social agents of behavior change: A meta-analysis of the effectiveness of HIV-prevention interventionists for different groups. Psychol Bull. 2006; 132: 212-248.CrossRefPubMed
38.
Zurück zum Zitat Dombrowski SU, Sniehotta FF, Avenell A, et al. Identifying active ingredients in complex behavioural interventions for obese adults with obesity-related co-morbidities or additional risk factors for co-morbidities: A systematic review. Health Psychol Rev. 2010; 6: 7-32.CrossRef Dombrowski SU, Sniehotta FF, Avenell A, et al. Identifying active ingredients in complex behavioural interventions for obese adults with obesity-related co-morbidities or additional risk factors for co-morbidities: A systematic review. Health Psychol Rev. 2010; 6: 7-32.CrossRef
Metadaten
Titel
Reliability of Identification of Behavior Change Techniques in Intervention Descriptions
verfasst von
Charles Abraham, PhD
Caroline E Wood, PhD
Marie Johnston, PhD
Jill Francis, PhD
Wendy Hardeman, PhD
Michelle Richardson, PhD
Susan Michie, PhD
Publikationsdatum
01.12.2015
Verlag
Springer US
Erschienen in
Annals of Behavioral Medicine / Ausgabe 6/2015
Print ISSN: 0883-6612
Elektronische ISSN: 1532-4796
DOI
https://doi.org/10.1007/s12160-015-9727-y

Weitere Artikel der Ausgabe 6/2015

Annals of Behavioral Medicine 6/2015 Zur Ausgabe