Background
Methods
Goals and specific aims
Design
Context
Setting and facility selection
Randomization
Sample size
Project activities
Domain | Original RE-AIM definition | Measurement level | Project-specific outcome measures |
---|---|---|---|
Reach | Reach is the absolute number, proportion, and representativeness of individuals who are willing to participate in a given initiative | Individual | ▪ Number of at-risk persons initiated on PrEP ▪ Demographic and behavioral characteristics of PrEP initiators |
Clinic | ▪ Characteristics of implementing clinics ▪ Demand creation strategies ▪ Retention strategies | ||
Effectiveness | The impact of an intervention on outcomes, including potential negative effects, quality of life, and economic outcomes. | Individual | ▪ Incident HIV infection among PrEP users ▪ Proportion of random blood samples with detectable tenofovir levels ▪ Frequency of adverse clinical events related to PrEP use |
Program | ▪ Cost and cost-effectiveness outcomes: unit cost, HIV infections averted, ICER, DALYS | ||
Adoption | Absolute number, proportion, and representativeness of settings and intervention agents who are willing to initiate a program | Individual | ▪ PrEP continuation rates ▪ Barriers/facilitators for PrEP initiation and use |
Clinic | ▪ Number of clinics implementing PrEP in HIV clinics ▪ Number of MOH clinical staff trained on delivering PrEP ▪ % of trained MOH staff scoring > 80% on post-test ▪ % of trained clinical staff who delivered PrEP at least once ▪ Internal and external factors influencing PrEP implementation | ||
Implementation | The intervention agents’ fidelity to the various elements of an intervention’s protocol | Clinic | ▪ Number and % of users appropriately initiated on PrEP ▪ % of trained staff who delivered PrEP at least once ▪ Clinic innovations and adaptions ▪ Consistency of implementation across staff |
Maintenance | The extent to which a program or policy becomes institutionalized or part of the routine organizational practice | Individual | ▪ 6-month PrEP continuation rates |
Clinic | ▪ Number of clinics implementing PrEP in HIV clinics ▪ Number of clinics that have integrated PrEP delivery in HIV clinics as an on-going part of their regular activities (i.e., have PrEP goals and targets, PrEP in service charter, routine health talks, regular staff training, implementation, PrEP data for monitoring and evaluation) ▪ Internal and external factors influencing PrEP implementation ▪ Number of clinics regularly completing PrEP M & E tools and report PrEP indicators to MOH | ||
National program | ▪ PrEP delivery in HIV clinic continuing as part of Kenya MOH program ▪ M & E tools supplied to clinics ▪ PrEP indicators defined expected |
PrEP technical assistance
Data abstraction
Evaluation of PrEP adherence
Qualitative interviews and exit surveys to understand delivery
Outcome measures and data sources
Data source | Description | Purpose |
---|---|---|
Data abstraction | ▪ Data abstracted from clinical delivery tools | ▪ Define who is initiating PrEP and whether persons are appropriately put on PrEP |
Technical assistance | ▪ TA reports prepared at baseline and 6-monthly | ▪Document details of the process of adoption and integration of PrEP delivery and track changes in PrEP implementation processes. ▪ Rapid cycle analysis to convey to facilities for quality improvement |
Qualitative interviews: user and provider | ▪ Purposefully sampled patient and key informants involved in the delivery | ▪ Gain deep understanding of process of adoption and integration of PrEP delivery and track changes in PrEP implementation processes. |
Time and motion studies | ▪ Primary data collection | ▪ Economic evaluation |
Exit interviews | ▪ Random on spot user structured surveys at the end of clinic visit | ▪ User experiences and satisfaction |
Random blood draw | ▪ Dried blood spots collected at ~ 10% visits on persons using PrEP | ▪ Objective assessment of PrEP adherence (tenofovir levels), resistance surveillance |
Observation | ▪ Informal | ▪ Track changes in PrEP implementation processes. |
Data management and confidentiality
Analysis
Quantitative data
Qualitative data
CFIR domains/definitions | Respective project-specific codes |
---|---|
1. Innovation characteristics | 1. Oral prep for HIV prevention |
Innovation Source: Perception of key stakeholders about whether the innovation is externally or internally developed | ▪ Ownership of the PrEP program at: National, clinic, and provider level, e.g., provider perception of MOH/NASCOP work vs project. |
Adaptability: The degree to which an innovation can be adapted, tailored, refined, or reinvented to meet local needs. | ▪ Adaptations—clinic level: PrEP eligibility PrEP baseline lab requirements Visit schedules |
Complexity Perceived difficulty of the innovation, reflected by duration, scope, radicalness, disruptiveness, centrality, and intricacy and number of steps required to implement. | ▪ Perceived difficulty of delivering PrEP: Perceived ease/complexity of counseling and delivering PrEP: time, labs, steps; challenges counseling about counseling about viral suppression |
2. Outer setting | 2. External influence of prep implementation |
External policy and incentives A broad construct that includes external strategies to spread innovations including policy and regulations (governmental or other central entity), external mandates, recommendations and guidelines, pay-for performance, collaborative, and public or benchmark reporting. | ▪ External enablers and policy: MOH policy framework and guidance MOH tools MOH supervision County government involvement |
Peer pressure Mimetic or competitive pressure to implement an innovation, typically because most or other key peer or competing organizations have already implemented or are in a bid for a competitive edge. | ▪ Clinic-level peer pressure: Motivation/pride from being the first to implement PrEP |
3. Inner setting | 3. Clinic-level factors |
Structural characteristics The social architecture, age, maturity, and size of an organization | ▪ Infrastructure and staff: Patient volume, space, staffing |
Relative priority Individuals’ shared perception of the importance of the implementation within the organization | ▪ Clinic-level priority: Tension between PrEP implementation (healthy person) vs ART services at the clinic (sick person) |
Leadership engagement Commitment, involvement, and accountability of leaders and managers with the implementation of the innovation. | ▪ Leadership engagement: Facility/HIV clinic manager involvement in PrEP implementation |
Access to knowledge and information | ▪ Staff training: Adequacy of training, models of PrEP training |
Available resources | |
4. Characteristics of individuals | 4. Health care provider factors |
Knowledge and beliefs about the innovation Individuals’ attitudes toward and value placed on the innovation, as well as familiarity with facts, truths, and principles related to the innovation. | ▪ Provider adoption and experience: Knowledge and attitudes about PrEP |
Self-efficacy Individual belief in their own capabilities to execute courses of action to achieve implementation goals. | ▪ Self-efficacy: Staff confidence in counseling and delivering PrEP, staff confidence in counseling about PrEP and condoms, confidence in viral undetectable=no transmission (u=u) |
5. Process | 5. Prep implementation process |
Engaging Attracting and involving appropriate individuals in the implementation and use of the innovation through a combined strategy of social marketing, education, role modeling, training, and other similar activities. | ▪ Demand creation strategies: Successful and unsuccessful demand creation strategies ▪ Retention strategies Successful and unsuccessful engagement/retention strategies ▪ Stakeholder engagement |
Champions Individuals who dedicate themselves to supporting, and “driving through” an [implementation], overcoming indifference or resistance that the innovation may provoke in an organization | ▪ PrEP champions: Types, roles, and how they have emerged, challenges, and how to harness champions |
External change agents Individuals who are affiliated with an outside entity who formally influence or facilitate innovation decisions in a desirable direction. | ▪ External change agents: Roles and impact of PrEP technical advisors, county/sub county AIDS and STI coordinators involvement, other implementing partners |
Execution Carrying out or accomplishing the implementation according to plan | ▪ Fidelity, clinic innovations, and adaptations—PrEP provision: Clinical encounter form completeness, same-day PrEP initiation, requirements for baseline creatinine and hepatitis B testing, assessment of acute HIV symptoms, PrEP visit frequency/schedule, quantity of PrEP dispensed, PrEP vs condom disconnect between providers and patients, demand creation, and retention strategies ▪ Demand creation strategies ▪ Opportunities for efficient PrEP delivery |
Innovation participants Individuals served by the organization that participate in the innovation, e.g., patients in a prevention program in a hospital. | ▪ Patient experiences: Confidence in health system, stigma of coming to an HIV clinic, facilitators and barriers to access to PrEP, benefits/challenges of integrating PrEP in IV clinics, confidence in stopping PrEP when HIV partner achieves viral suppression |
Reflecting and evaluating Quantitative and qualitative feedback about the progress and quality of implementation accompanied with regular personal and team debriefing about progress and experience | ▪ M & E activities: Best practices, role of technical assistance, rapid cycle analysis, adoption of PrEP delivery, quality improvement activities, M & E measures to assess progress |