INTRODUCTION
ONE-DAY WORKSHOPS
Method
Design
Participants
Workshops | Tutorials | ||
---|---|---|---|
N = 109 |
N = 52 | ||
Age (mean (SD)) | 32.31 (9.27) | 37.04 (7.82) | |
Gender | Female | 103 | 35 |
Male | 6 | 17 | |
Professiona
| Practitioner | 12 | 7 |
Student | 57 | 3 | |
Academic | 40 | 40 | |
Highest qualification | BA/BSc | 23 | – |
MA/MSc | 46 | 10 | |
PhD | 35 | 33 | |
Clinical | 4 | 9 | |
Nationality | UK | 72 | 38 |
European (non-UK) | 22 | 8 | |
America | 8 | 4 | |
Asia | 5 | – | |
Australia | 1 | 1 | |
South Africa | 1 | – | |
Previous experience of taxonomy use N (%) | Coding Describing BCIs | 26 (24) 35 (32) | 28 (54) 36 (69) |
Expertise associated with BCIs (mean (SD))b
| Designing | 2.38 (1.10) | 3.60 (1.00) |
Delivering | 2.46 (1.22) | 3.19 (1.04) | |
Reporting | 2.45 (1.16) | 3.51 (0.87) | |
Reviewing | 2.46 (1.13) | 3.45 (1.08) | |
Using behaviour change theories | 3.30 (0.90) | 3.70 (0.77) |
Materials
Content | Brief description | Learning objectives | BCTs used | |
---|---|---|---|---|
Presentation | Background to Behaviour Change Techniques | Outlines the goals for the day, defines and conceptualises the term ‘BCT’ and communicates need for agreed standard list of BCTs in behavioural medicine | • To understand aims, objectives and learning outcomes • To learn need for precise labels and definitions | • Credible source • Social reward • Pros and cons • Comparative imagining of future outcomes |
Assessment | Using the taxonomy | Trainees work individually to identify presence/absence of 12 BCTs in an intervention description | • To assess pretraining use of BCTs | • Instruction on how to perform the behaviour • Behavioural practice/rehearsal |
Task | Ready, steady, point! | Trainees shown a short excerpt on screen and, when prompted, asked to point left BCT1, right for BCT2 or to the ceiling if unsure | • To learn BCTs 1–2 labels and definitions • To learn appropriate levels of inference and discrimination | • Social comparison • Salience of consequences • Graded task • Behaviour practice/rehearsal • Feedback on behaviour |
Morning break | ||||
Presentation | Identifying behaviours and BCTs | Defines behaviour and the distinction between behaviour and behaviour outcome | • To learn what a behaviour is and the difference between a behaviour and a behaviour outcome | • Behaviour practice/rehearsal • Feedback on behaviour • Generalisation of target behaviour • Social comparison • Feedback on behaviour • Social reward |
Task | Identifying behaviours and BCTs | Trainees work in pairs to highlight exact words showing behaviour and BCT in two short excerpts | • To learn how to identify BCT 3–6 in written text • To consider descriptions in detail | • Behaviour practice/rehearsal • Feedback on behaviour |
Task | Identifying BCTs in reports | BCTs 7–12 cards are placed around the room. Trainees shown five excerpts taken from real interventions; for reports one and two, trainees asked when prompted, to point at the correct BCT card. For reports three to five, trainees asked to identify presence of BCTs 7–12 | • To consolidate previous learning of BCTs 1–12 • To learn how to reliably identify BCTs in real and increasingly complex reports | • Social reward • Instruction on how to perform the behaviour • Behaviour practice/rehearsal |
Task | Providing examples of BCTs | Trainees work in groups of four to generate their own examples of BCTs 7–12 and then feedback to the rest of the group | • To learn BCTs through detailed consideration of examples | |
Lunch break | ||||
Task | Role play | Expert tutors act out two role plays with six of BCTs 13–24 in each. Trainees asked to identify presence of BCTs | • To learn BCTs 13–24 labels and definitions and recognise them as delivered in practice | • Behaviour practice/rehearsal |
Task | Coding published descriptions | Trainees work in pairs to identify presence of BCTs 1–24 in two longer excerpts | • To consolidate previous learning of BCTs 1–24 • To consolidate previous learning of coding for presence of BCTs and making inferential judgements in real reports | • Graded tasks • Feedback on behaviour • Demonstration of the behaviour • Social reward • Feedback on outcome |
Afternoon break | ||||
Presentation | Moving from a list to a taxonomy | Introduces the idea of a hierarchical structure and outlines how it was developed | • To become familiar with hierarchical structure of the taxonomy and the 24 BCTs within their clusters | • Problem solving |
Assessment | Using the taxonomy | Trainees work individually to identify presence/absence of 12 BCTs in an intervention description | • To assess post-training use of BCTs | • Feedback on behaviour (if requested) |
Measures
Procedure
DISTANCE GROUP-BASED TUTORIALS
Method
Design
Participants
Materials
Tutorial session | Learning principle introduced in the session | Learning objectives |
---|---|---|
1 | Only code BCTs that are directly applied to the target behaviour(s) and population(s) | • To understand and accurately apply General coding instructions (8 preliminary steps) and Learning principle 1 • To reliably identify the presence/absence of BCTs 1–10 |
2 | Do not infer the presence of a BCT. The description must correspond to the definition of the BCT given in the taxonomy. If you are unsure, do not code the BCT as present | • To consolidate understanding and accurate application of General coding instructions (8 preliminary steps) and Learning principle 1 • To understand and accurately apply Learning principle 2 • To reliably identify the presence/absence of BCTs 1–20 in longer, more complex pieces of text |
3 | Take care distinguishing between BCTs that only differ in terms of their behaviour change type (i.e. behaviour vs. outcome) | • To consolidate understanding and accurate application of general coding instructions (eight preliminary steps) and learning principle 1 and 2 • To understand and accurately apply Learning principle 3 • To understand the need for clear BCT labels and definitions • To reliably identify the presence/absence of BCTs 1–32 |
4 | Code technical terms and packages of BCTs that map onto BCTs in the taxonomy | • To consolidate understanding and accurate application of General coding instructions (eight preliminary steps) and learning principle 1, 2 and 3 • To understand and accurately apply Learning principle 4 • To reliably identify the presence/absence of BCTs 1–44 in longer more complex pieces of text |
Measures
Procedure
Analysis
RESULTS
Evaluating effectiveness of training in increasing coding competence
BCT number and label | Before training | After training | ||||||
---|---|---|---|---|---|---|---|---|
(BCTs ordered according to mean PABAK inter-coder agreement between trainees, after training) |
N trainees identifying BCT (max = 109) | Mean PABAK agreement between trainees | Mean PABAK trainee agreement with expert consensus | % trainee identifications with high confidence ratings (i.e. ++) |
N trainees identifying BCT (max = 109) | Mean PABAK agreement between trainees | Mean PABAK trainee agreement with expert consensus | % trainee identifications with high confidence ratings (i.e. ++) |
2.3. Self-monitoring of behaviour | 49 | .49 | −.10 | 22 | 101 | .96 | .85 | 88 |
2.2. Feedback on behaviour | 56 | .49 | .03 | 57 | 93 | .93 | .71 | 92 |
8.1. Behavioural practice/rehearsal | 81 | .42 | .49 | 80 | 98 | .70 | .80 | 90 |
10.3. Nonspecific reward | 74 | .48 | .36 | 86 | 75 | .56 | .38 | 88 |
1.3. Goal setting (outcome) | 60 | .64 | .22 | 89 | 84 | .56 | .54 | 87 |
10.2. Material reward (behaviour) | 104 | .56 | .91 | 85 | 105 | .48 | .93 | 88 |
9.1. Credible source | 68 | .20 | .25 | 57 | 75 | .44 | .38 | 87 |
1.2. Problem solving | 82 | .45 | .50 | 89 | 71 | .33 | .30 | 89 |
6.1. Demonstration of the behaviour | 76 | .27 | .39 | 89 | 100 | .30 | .83 | 93 |
5.1. Information about health consequences | 86 | .67 | .58 | 91 | 77 | .19 | .41 | 87 |
1.1. Goal setting (behaviour) | 86 | .93 | .58 | 89 | 62 | .19 | .14 | 78 |
3.1. Social support (unspecified) | 89 | .78 | .63 | 86 | 47 | −.11 | −.13 | 94 |
BCT number and label (ordered according to mean PABAK inter-coder agreement between trainees, post-training) | Before training | After training | ||||||
---|---|---|---|---|---|---|---|---|
N trainees identifying BCT (max = 52) | Mean PABAK inter-coder agreement between trainees | Mean PABAK trainee agreement with expert consensus | % Trainee identifications with high confidence ratings (i.e. ++) |
N trainees identifying BCT (max = 52) | Mean PABAK inter-coder agreement between trainees | Mean PABAK trainee agreement with expert consensus | % Trainee identifications with high confidence ratings (i.e. ++) | |
10.2. Material reward (behaviour) | 47 | .62 | .81 | 85 | 49 | .77 | .88 | 82 |
4.1. Instruction on how to perform behaviour | 19 | .00 | −.27 | 63 | 44 | .69 | .69 | 82 |
2.3. Self-monitoring of behaviour | 47 | .62 | .81 | 91 | 48 | .69 | .85 | 92 |
8.1. Behavioural practice/rehearsal | 16 | .08 | −.38 | 63 | 47 | .62 | .81 | 66 |
2.4. Self-monitoring of outcome(s) of the behaviour | 45 | .46 | .73 | 86 | 45 | .46 | .73 | 91 |
1.3. Goal setting (outcome) | 42 | .38 | .62 | 88 | 45 | .46 | .73 | 91 |
1.2. Problem solving | 49 | .77 | .88 | 78 | 42 | .38 | .62 | 71 |
1.1. Goal setting (behaviour) | 49 | .77 | .88 | 76 | 40 | .38 | .54 | 78 |
12.5. Adding objects to the environment | 6 | .54 | −.77 | 33 | 36 | .38 | .38 | 72 |
6.1. Demonstration of the behaviour | 27 | −.31 | .04 | 78 | 40 | .38 | .54 | 83 |
10.3. Nonspecific reward | 11 | .46 | −.58 | 27 | 10 | .38 | −.62 | 50 |
2.5. Monitoring of outcome(s) of behaviour without feedback | 37 | .31 | .42 | 51 | 41 | .31 | .58 | 71 |
3.1. Social support (unspecified) | 10 | .54 | −.62 | 50 | 43 | .31 | .65 | 72 |
5.3. Information about social and environmental consequences | 4 | .85 | −.85 | 25 | 30 | .23 | .15 | 60 |
5.1. Information about health consequences | 50 | .85 | .92 | 84 | 41 | .15 | .58 | 83 |
9.1. Credible source | 28 | −.38 | .08 | 43 | 39 | .15 | .50 | 90 |
2.2. Feedback on behaviour | 27 | −.31 | .04 | 74 | 19 | .00 | −.27 | 58 |