Assessment of training and technical assistance needs of Colorectal Cancer Control Program Grantees in the U.S.

A large proportion of CRCCP grantees expressed the need for training with regards to specific EBIs, especially system-level EBIs and provider-directed EBIs to promote CRC screening. Grantees rated these EBIs as more difficult to implement than client-oriented EBIs and fewer grantees reported use of these EBIs. Grantees also reported a moderate need for training regarding many aspects of EBI implementation, from identifying EBIs and assessing organizational capacity to implement selected EBIs to conducting a process and outcome evaluation. CDC has provided webinars to grantees on many of these topics, but the moderate satisfaction rating of grantees with CDC training and TA suggests that there is room for improvement. CDC may benefit from gathering specific information from grantees on how to improve their training and TA efforts. Meeting grantees’ training and TA needs is important, as their capacity to implement EBIs will be crucial for meeting the program goal of increasing levels of CRC screening population-wide. Generally, the CRCCP grantees were using EBIs to increase colorectal cancer screening recommended by the CDC; however, they desired training and TA on the specific interventions that require organizational or systems changes, such as provider assessment and feedback and reducing structural barriers. Research-tested Intervention Programs (R.T.I.P.s) may be a useful resource for grantees to locate specific interventions with their implementation protocols and materials [20]. To assist public health organizations in correctly implementing EBIs, it is critical to offer intervention-specific guidance in addition to general instructions on how to use evidence as suggested by the Interactive Systems Framework [14]. For EBIs that demand changes to organizational procedures or processes, support of administrators is often needed. Toolkits, such as the American Cancer Society’s How to Increase Colorectal Cancer Screening Rates in Practice [21] may be useful in guiding organizations and clinics to engage relevant administrators and adopt those provider-oriented evidence-based strategies [14]. Further training and TA on these provider-oriented strategies are needed.

For general capacity building, we found that grantees desired training and TA on specific topics regarding EBIs such as identifying evidence-based strategies, assessing organizational capacity, adapting EBIs, and assessing the fit of potential strategies with their population. This is consistent with findings of previous research assessing training needs to increase the use of EBIs among other health professionals [22]. CDC’s Comprehensive Cancer Program staff has also reported topics of adapting EBIs and maintaining fidelity as desired training areas [11]. And, among health department staff, translating EBIs and evaluation competencies were rated as intermediate or advance competencies for training [23]. Several models of adoption of effective interventions emphasize the need for conducting a fit assessment to determine if an evidence-based program, policy, or practice matches the community’s capacity, resources, or readiness to act in order to implement an intervention correctly [24,25]. Likewise, organizational capacity checklists exist that could help organizations assess their resources and readiness to implement an EBI [26-28]. Training for public health professionals can focus on these content areas to assist organizations with these specific tasks within using EBIs. Our results also suggest that CRCCP grantees are active disseminators of EBIs in that 40-50% of them offer training and TA to other organizations. These grantees represent active prevention support to others in terms of sharing their how-to’s of EBI implementation, facilitators and barriers, and lessons learned.

Many grantees preferred training formats that were interactive with content experts such as onsite training, webinars or expert consultants around the implementation of systems approaches for increasing screening; however, resource constraints often limit CDC staff from offering onsite or in-person training. While training is necessary, individualized TA may be more suitable to help organizations overcome the training barriers identified in this study (e.g., need for examples, more advanced information). Individualized TA can provide more in-depth information on how to implement a specific strategy and also address unique contextual factors (e.g., organizational systems such as paper records or electronic medical records, staffing, resources). These combinations of prevention support reported by grantees match the common strategies found in other studies that promote the adoption of EBIs such as in person training and TA [29,30], packaged materials or recommendations [31,32], and conference calls [33]. These prevention supports have been proven to increase adoptions of evidence-based prevention strategies [31,32,34].

In addition to systems approaches for increasing screening, the needs for training and TA around partnership development and program and data management were most frequently reported by grantees as critical training topics. Because there are still disparities in cancer screening, building grantees’ and other community organizations’ capacity to leverage or build partnerships such as those between clinical and community preventive services would promote screening [35]. In qualitative interviews with over 100 stakeholders from the Colorectal Cancer Screening Demonstration Program, data revealed that partnership development and collaborations were critical to the success of the demonstration sites [36].

These findings present some practical implications for CDC and other organizations supporting the use of EBIs. The diversity inherent in the aforementioned categories of training needs and preferences can be challenging for a systematically designed program such as the CRCCP. Recognizing this potential challenge, CDC proactively implements a four-pronged effort for training and TA which 1) establishes a Program Consultant for each grantee to provide in-person and/or telephonic individual, tailored TA on an ongoing basis, 2) establishes training and TA workgroups on specific topics (e.g., education and targeted outreach, quality assurance and patient navigation) that offer webinars and in-person training, 3) supports development of training or TA materials (e.g., action guides such as Increasing Quality Colorectal Cancer Screening: An Action Guide for Working with Health Systems [37], Make It Your Own [MIYO] [38], and 4) provides in-person training at conferences. These efforts aim to provide systematic, universal training as part of the overall capacity building effort for all CRCCP grantees.

Program Consultants provide individual TA and consultation to assigned grantees to support their planning, implementation and evaluation of each of their program components. TA and consultation includes individual assistance with the design and implementation of grantee program components and data monitoring and feedback to support quality assurance, program improvement, and program evaluation. These activities represent the types of support strategies recommended by the Evidence-based System for Innovation Support to increase adoption of EBIs: training, TA, tools and quality improvement [15]. Universal training provided by CDC during the 2012–2013 program year included a range of activities in response to grantee’s requests from the 2012 survey (Table 5) and involved real-time webinars and on-site training for expanding grantee’s capacity in systems approaches/EBI implementation, program management, data management, and partnership development. In addition, the webinars and on-site training provided by CDC often include presentations developed by grantees in order to highlight their successes with EBI implementation. These examples from the field have proven useful for grantees still having difficulty with program implementation and encourage collaboration and knowledge sharing among grantees.

CDC’s approach of establishing a Program Consultant for individualized TA and an education and targeted outreach team for universal training allows for greater responsiveness to the needs of grantees and also encourages grantees to continually keep the agency informed of their challenges and training desires. This level of communicative feedback is integral so that continual improvement can be made in overall CRCCP program outreach and management. In addition, because CDC instituted a performance-based grants management system in 2012 for annual funding of CRCCP grantees, CDC is able to integrate training and TA efforts with evaluation of grantee performance. CDC is then able to follow up with programs in need of assistance to increase their capacity.

This study has several limitations. Our findings are based on self-reported data from grantees who are funded for promoting CRC screening at the population level using EBIs and that have received a significant amount of training related to program implementation in general and related to specific EBIs. It is possible that training and TA needs are different, possibly greater, for other organizations or clinics that focus on colorectal screening promotion. In addition, we limited the focus of the desire for training and TA to currently recommended evidence-based practices. Grantees may also need guidance on other cancer promotion activities such as mass media campaigns, reducing screening costs, and group education, where the evidence has not been established or is insufficient.

Future research can explore the outcomes of training and TA on short-term changes such as knowledge and skills gained on how to implement EBIs. Further long-term evaluation can examine the adoption of recommended cancer prevention EBIs by public health organizations and subsequent impact on screening. While general training on the use of EBIs exists [16,39], few evaluations are published that present critical data in terms of what knowledge and competency areas are important to address for dissemination of evidence-based practices for cancer control.