Background
Implementation strategies, determinants, and mechanisms
Beliefs and attitudes for successful implementation in schools
Evaluations of previous versions of BASIS
Study aims
Methods
Participants
Total | BASIS group N = 12 | Control group N = 13 | χ2 |
p
| ||||
---|---|---|---|---|---|---|---|---|
N
| % |
N
| % |
N
| % | |||
Gender | ||||||||
Female | 20 | 80.0% | 10 | 83.3% | 10 | 76.9% | 0.031 | 0.859 |
Male | 5 | 20.0% | 2 | 16.7% | 3 | 23.1% | ||
Race | ||||||||
Asian | 1 | 4.0% | 1 | 8.3% | 0 | 0.0% | 2.72 | 0.605 |
Black | 5 | 20.0% | 2 | 16.7% | 3 | 23.1% | ||
Hispanic | 1 | 4.0% | 0 | 0.0% | 1 | 7.7% | ||
Native | 0 | 0.0% | 0 | 0.0% | 0 | 0.0% | ||
White | 16 | 64.0% | 8 | 66.7% | 8 | 61.5% | ||
Multi-racial | 2 | 8.0% | 1 | 8.3% | 1 | 7.7% | ||
Age | ||||||||
18 to 24 years old | 1 | 4.0% | 0 | 0.0% | 1 | 7.7% | 2.62 | 0.624 |
25 to 34 years old | 5 | 20.0% | 2 | 16.7% | 3 | 23.1% | ||
35 to 44 years old | 7 | 28.0% | 4 | 33.3% | 3 | 23.1% | ||
45 to 54 years old | 7 | 28.0% | 2 | 16.7% | 5 | 38.5% | ||
55 to 64 years old | 3 | 12.0% | 2 | 16.7% | 1 | 7.7% | ||
Missing | 2 | 8.0% | 2 | 16.7% | 0 | 0.0% | ||
Grade-level | ||||||||
Middle school | 13 | 52.0% | 6 | 50.0% | 7 | 53.8% | 0.04 | 0.582 |
High school | 12 | 48.0% | 6 | 50.0% | 6 | 46.2% |
Procedures
Study conditions
Attention control
Basis
BASIS implementation strategy
Component | Content |
---|---|
Strategic education (attitudes) | 1. Connecting EBP to student success 2. Recognizing vulnerabilities to adopt non-EBPs 3. Address common myths about EBP 4. Evaluating evidence for practices 5. Promoting understanding of fidelity of EBP |
Social influence (social norms) | 1. Providing normative information 2. Testimonials from experts 3. Testimonials for similar others 4. Evoking public commitments |
Motivational intervention (perceived behavioral control) | 1. Professional values clarification 2. Pros and cons activity to elicit change talk 3. Anticipate implementation barriers 4. Values-directed implementation goals 5. “Ruler questions” (e.g., how confident?) |
BASIS component 1: strategic education about EBP and intervention fidelity to improve attitudes toward EBP
BASIS component 2: social influence techniques to alter perceptions of subjective norms
BASIS component 3: motivational interviewing techniques to enhance perceived behavioral control
CBITS training and consultation
Measures
Attitudes
Perceived social norms
Perceived behavioral control
Implementation citizenship
Behavioral intentions to implement
BASIS fidelity
Consultation engagement
Adoption
Implementation climate
Data analytic approach
Results
Hypothesis 1: pre- to post-training change in mechanisms
Measures | Condition |
n
| Baseline | Post | Follow-up | Baseline to post regression | Post to FU Regression | |||||
---|---|---|---|---|---|---|---|---|---|---|---|---|
Mean | SD | Mean | SD | Mean | SD | Beta | 95% CI | Beta | 95% CI | |||
Attitudes toward EBPs (EBPAS) | ||||||||||||
Requirement | BASIS | 11 | 8.85 | 2.40 | 9.45 | 2.81 | 9.89 | 1.17 | .106 | − .211, .423 | .396 | − .010, .802 |
Attention | 13 | 9.69 | 1.65 | 9.54 | 2.26 | 7.31 | 4.39 | |||||
Appeal | BASIS | 11 | 12.74 | 3.35 | 14.18 | 1.78 | 13.33 | 2.18 | .489 | .158, .820 | − .026 | − .379, .327 |
Attention | 13 | 13.54 | 1.94 | 12.08 | 2.72 | 12.00 | 3.06 | |||||
Openness | BASIS | 11 | 11.76 | 2.20 | 13.73 | 1.74 | 12.22 | 1.72 | .488 | .174, .802 | − .121 | − .405, .163 |
Attention | 13 | 13.00 | 2.48 | 12.00 | 2.83 | 11.62 | 3.15 | |||||
Divergence | BASIS | 11 | 12.53 | 1.85 | 12.27 | 2.37 | 13.00 | 2.18 | − .105 | − .517, .307 | .481 | .261, .701 |
Attention | 13 | 13.31 | 1.44 | 13.00 | 1.83 | 12.08 | 1.38 | |||||
Fit | BASIS | 11 | 23.03 | 3.76 | 24.18 | 2.93 | 22.56 | 3.88 | .473 | .180, .766 | .191 | − .271, .653 |
Attention | 13 | 22.31 | 3.84 | 19.77 | 4.51 | 19.31 | 3.99 | |||||
Burden | BASIS | 11 | 10.70 | 2.45 | 10.18 | 3.46 | 9.11 | 3.95 | .277 | − .143, .697 | .074 | − .361, .509 |
Attention | 13 | 11.08 | 2.25 | 8.62 | 3.97 | 7.92 | 3.48 | |||||
Social norms | ||||||||||||
Injunctive norms | BASIS | 11 | 0.90 | 1.14 | 1.36 | 1.04 | 0.81 | 1.48 | .309 | .721, − .103 | .357 | .102, − .817 |
Attention | 13 | 1.00 | 0.82 | 0.81 | 0.75 | 1.42 | 0.62 | |||||
Descriptive norms | BASIS | 11 | 1.11 | 1.26 | 1.45 | 0.76 | 0.64 | 0.90 | .474 | .859, .089 | .348 | .102, − .798 |
Attention | 13 | 1.21 | 0.89 | 0.60 | 1.04 | 0.69 | 0.90 | |||||
Self-efficacy | BASIS | 9 | 35.11 | 6.07 | 35.44 | 4.28 | 31.78 | 5.45 | .360 | − .020, .740 | − .297 | − .667, .073 |
Attention | 13 | 34.85 | 4.76 | 31.08 | 5.81 | 32.08 | 5.62 | |||||
Implementation citizenship behaviors (ICBS) | ||||||||||||
Helping others | BASIS | 11 | 2.73 | 0.65 | 2.55 | 1.11 | 2.15 | 1.26 | .166 | − .185, .517 | − .082 | − .424, .260 |
Attention | 13 | 1.95 | 0.97 | 1.85 | 0.95 | 1.82 | 1.21 | |||||
Keeping informed | BASIS | 11 | 2.85 | 0.70 | 2.91 | 0.67 | 2.41 | 0.98 | .102 | − .163, .366 | − .275 | − .569, .020 |
Attention | 13 | 2.51 | 1.18 | 2.49 | 1.22 | 2.64 | 1.13 | |||||
Taking initiative | BASIS | 11 | 3.11 | 0.65 | 2.86 | 0.81 | 2.44 | 1.16 | .087 | − .254, .428 | − .271 | − .493, −.050 |
Attention | 13 | 2.60 | 0.90 | 2.48 | 0.89 | 2.58 | 0.98 | |||||
Advocacy | BASIS | 11 | 3.36 | 0.54 | 3.15 | 0.84 | 2.69 | 1.24 | − .053 | − .434, .327 | − .218 | − .439, .003 |
Attention | 13 | 2.75 | 0.82 | 2.77 | 0.79 | 2.78 | 0.97 | |||||
Mean total | BASIS | 11 | 3.01 | 0.51 | 2.87 | 0.79 | 2.42 | 1.09 | .066 | − .244, .376 | − .252 | − .489, − .016 |
Attention | 13 | 2.45 | 0.87 | 2.40 | 0.85 | 2.46 | 0.98 | |||||
Intentions to implement CBITS | BASIS | 9 | 31.00 | 5.68 | 30.89 | 4.91 | 24.78 | 7.17 | .339 | .007, .671 | − .154 | − .597, .289 |
Attention | 13 | 29.54 | 4.82 | 24.08 | 8.37 | 24.08 | 7.92 |
Hypothesis 2: intentions to implement
Hypothesis 3: consultation participation, engagement, and CBITS adoption
Exploratory research question: post-training to end-of-year follow-up change in mechanisms
Measure | Condition |
n
| Post | Follow-up | Post-training independent T test | Post to FU regression | ||||
---|---|---|---|---|---|---|---|---|---|---|
Mean | SD | Mean | SD |
t
|
p
| Beta | 95% CI | |||
ICS focus | BASIS | 11 | 2.67 | 0.87 | 2.33 | 1.02 | − .905 | .375 | − .065 | − .522, .392 |
Attention | 13 | 2.33 | 0.92 | 2.33 | 0.77 | |||||
ICS education | BASIS | 11 | 2.52 | 0.89 | 2.23 | 0.85 | − .961 | .347 | − .125 | − .596, .346 |
Attention | 13 | 2.18 | 0.82 | 2.33 | 0.58 | |||||
ICS recognition | BASIS | 11 | 2.73 | 0.61 | 2.10 | 0.74 | − 1.136 | .268 | − .299 | − .754, .156 |
Attention | 13 | 2.41 | 0.73 | 2.46 | 0.89 | |||||
ICS reward | BASIS | 11 | 1.24 | 0.83 | 0.80 | 0.77 | − .907 | .374 | − .139 | − .591, .313 |
Attention | 13 | 0.97 | 0.62 | 0.90 | 0.77 | |||||
ICS data | BASIS | 11 | 2.36 | 0.74 | 1.58 | 0.76 | − 1.080 | .292 | − .160 | − .625, .305 |
Attention | 13 | 1.94 | 1.10 | 1.73 | 1.02 | |||||
ICS support | BASIS | 11 | 2.21 | 1.00 | 1.70 | 1.01 | − .133 | .896 | − .067 | − .532, .398 |
Attention | 13 | 2.15 | 1.13 | 1.82 | 1.07 | |||||
ICS integrate | BASIS | 11 | 2.18 | 0.85 | 1.53 | 1.06 | − 1.160 | .258 | − .141 | − .600, .318 |
Attention | 13 | 1.77 | 0.88 | 1.62 | 0.80 | |||||
ICS total | BASIS | 11 | 2.28 | 0.62 | 1.73 | 0.73 | − 1.175 | .252 | − .149 | − .635, .337 |
Attention | 13 | 1.96 | 0.71 | 1.87 | 0.61 |