Background
Methods
Country | Partners involved | Catchment area | Health system strengthening intervention components
(Informed by the six WHO building blocks of a health system framework)
| Recommendable innovative programs/models/component |
---|---|---|---|---|
Ghana (Awoonor et al. 2013) [13] | Ghana Health Service Policy, Planning, Monitoring and Evaluation Division Navrongo Health Research Centre University of Ghana School of Public Health Columbia University Mailman School of Public Health | 500,000 people (District health system in Upper East Region, Ghana) | Extended Newborn Service; IMCI; use of community health; data utilization; strengthening project leadership at all levels of the District health system | Community Health Nurse program Improvement of transport of obstetric emergencies from the community health posts to higher level facilities able to provide expanded emergency obstetric care |
Mozambique (Sherr et al. 2013) [3] | University of Washington Health Alliance International University of Eduardo Mondlane Mozambique Ministry of Health | 1,500,000 people (13 districts in Sofala Province) | Strengthening district health management systems and improving delivery of integrated primary health care | Beira Operations Research Center district−/facility-level data quality assessments Data utilization tools for district-level performance review process |
Rwanda (Drobac et al. 2013) [6] | University of Rwanda College of Medicine and Health Sciences Rwanda Ministry of Health Harvard Medical School Brigham and Women Hospital Partners In Health | 560,000 people: one and one-half rural districts | Targeted support for health facilities, quality improvement initiatives, strengthened the network of community health workers and improved monitoring and evaluation | Clinical Mentorship and Quality Improvement (MESH-QI model) Integrated mentoring and QI Collaborative to reduce Neonatal Mortality Operational/Implementation research capacity/skills building program |
Tanzania (Ramsey et al. 2013) [15] | Ifakara Health Institute Columbia University Mailman School of Public Health Tanzania Training Center for International Health Council Health Management Teams | 857,000 people (Kilombero, Ulanga and Ufiji Districts, Murogoro Region, Tanzania) | Introduction of a new cadre of Community Health Agents (CHAs) into a general program of health systems strengthening and referral. Supervisory systems to support the CHA. District-wide emergency referral strengthening intervention | Community Health Agent program |
Zambia (Stringer et al. 2013) [16] | Zambart Centre for Infectious Disease Research in Zambia | 559,000 people (Lusaka Province) | Clinical protocols for health care quality improvement. Community health workers to actively improve the referral system | Clinic supporters as trained CHWs Standardized Protocols and forms for patient screening Forms for patients consultations |
Data collection
Data analysis
CFIR domains | Facilitators | Key informants’ quotes | Barriers | Key informants’ quotes |
---|---|---|---|---|
Intervention characteristics | Embeddedness in the public system and close integration into national strategies; |
“Because it is an opportunity that we have been looking for a long time. We had a program that went through a rigorous research as far back as 1994 that proved the intervention that if you put nurses in the community and work closely with the community members and putting all the structures and equipment, everything, you will improve health outcomes.”
| Difficult to adapt to context due to evaluation framework (RCT or other fixed designs) |
“Because to actually work through the health system would’ve prevented us from being able to conduct an experiment. That tension was salient throughout the project, even from when we were working with the local government authorities because it was like why are you setting it up this way?”
“The spirit of PHIT is very much one of implementation. Our project is a research project and I sense that that has put us always at a disadvantage compared to other PHIT projects which were directly go in and improve this.”
|
Innovation |
“…that was the situation that we had, this project came as a first project that was looking the entire health system, how do we make the system stronger …this is a project that will sit…right in the middle of the health system.”
| |||
Built on existing partnerships |
“I think you have to subordinate the global expertise and technocratic input to context about what might work in that setting because to influence a system, you have to have people on board and you have to adapt their perspectives and their perceptions.”
| |||
Plan to utilize data and adaptability |
“We were in equipoise (questionable vocabulary) [sic] and as researchers the best thing is to put the concept to the test, get results, and then see if it works, start now working towards implementation. I think that it is reasonable to say that it was our scientific intent to generate evidence before we recommend.”
| |||
Rigorous evaluation framework |
“…based on our understanding of the need to have evidence- based recommendations and adjustments to the system; we didn’t want to say, 'We have this great quality improvement idea, let’s implement!' No, we said, 'We have these great ideas. Do they really work? We don’t know. Can they really contribute to improved quality improvement and improved mortality eventually?'”
| |||
Outer setting | Local individual expertise |
“The second thing was that we always concentrated on putting nurses in the community. We never talked about midwives…The midwife focuses also to address the inherent cultural practices that every community, every home, every clan in the district, in the community has a midwife.”
| Intermittent change in national policies priorities. |
“I think one of the challenges of working with the government is they have a lot of priorities and sometimes the national will say on a Monday, “You need to do this by Wednesday!” So all their planning kind of goes out the door. So understanding that they have pressures on their time so that they couldn’t always do it exactly how we had planned to do it. And I think I mentioned before that it just takes longer to do anything with the government. In some ways it’s sometimes easier to do something completely separate, so it takes longer and you have to have more patience, so I think that was a challenge.”
|
Local policies and management structure strength; |
“...it is not our decision, we do not decide where the facilities or nurses should be; it’s the community that decides because we also expect some responsibility from the community.”
| Public sector and other funding fluctuations | “The … health system has tremendous logistics and stock out problems. From the very beginning of the study, we were required … to conduct integrated community case management of childhood illness, meaning that the CHWs had to provide antibiotics and antimalarials. There was no way through the health system that they could procure and deliver supplies to CHWs.”
| |
Existing stakeholder capacity |
“…this is the program that also deals with a lot of NGOs. For instance, in our community health program the major stakeholder was…who have been already in the community and deal with many issues. So, in training community health nurses to work with the community, they were the people that we used.”
| Diseases prevalence |
“So, we recognize that the under 5 mortality was dropping but neonatal mortality wasn’t, it’s something that we recognize that a lot of the interventions were not actually addressing the needs of the babies.” | |
Human resources in the wider health System (attrition and shortage) |
“One of the challenges could be that there was a lot of staff movement. Not necessarily people leaving… So a health worker might move from one health center to another. So they would have been exposed to some of the activities but they are now in a different place. We had a couple key leadership people leave the project: the Chief Medical Officer at the provincial level, there was two of them throughout. So that’s a little challenge because you have to re-explain it.”
| |||
Inner setting (academic and NGO implementing organizations) | Internal on the job mentorship and Capacity building |
“The goal behind that was that because this was a grant that was both implementation and research we really want to grow the capacity of people from…to actually participate in the research part of it but then I think recognizing the value of people being able to consume research and knowledge management and not just necessarily just produce research.”
“I think expediently research capacity building beyond what was focused in the school of public health is something that was much broader. I think that was an adaptation, one [sic] was sort of really remarkable [sic] successful”
| Intra PHIT project Leadership Change; and Staff turnover requiring constant training Consistently training new staff due to turnover |
“I think changes in the statistical officers at the district level, that was a challenge because you have to keep going and re-training: it’s not linear, you can’t start something and keep gone [sic].”
|
Interdisciplinary team including National and International staff, and Expertise in local context |
“The institution I work for has been in existence since 2001, so certainly PHIT project was coming to fit into an institution that was already running. In fact, the institution had been doing a lot of health systems work before PHIT, but that was completely focused on ART, anti-retroviral therapy. In fact, my institution, I think it is fair to say that we shared data and championed the introduction of ART in...”
| |||
Collaborative research approach | Increased research productivity and local and international collaboration. (Hedt-Gauthier, B. et al. 2017. BMC Health Services Research, 2017. Vol 17 Suppl 3. S3) | |||
Multidisciplinary teams Strong content specific technical skills (PhD and implementation research track record; Academic partners) | “…Strong Technical team. Statisticians and Epidemiologist as well as clinicians…”
| |||
Implementation process | Data use to inform iterations on intervention and implementation design |
“…the neonatal mortality reduction was definitely something we added on when we recognize [sic] that the under 5 mortality is [sic] dropping but neonatal mortality was not dropping.”
| Local intermittent change in data tools and methods. |
“It’s amorphous. Then it is in the system, the data systems for the ministry are constantly being updated and changing. So that’s a static thing. So, part of the project was to get, kind of started first making sure the data was okay, and try to figure out how to help them use it to make decisions, that would lead to management decisions is [sic] at the health facility but at the same time the data system will be updated and changed. So we have [sic] constantly kind of re-train people in their system, so it is not very linear.”
|
Cross intervention peer learning; | “That year limiting was also a platform for us to know what is happening here, what is happening there, not only for the project itself in a hotel discussion but also field visits. I remember very well that the field visit was so exciting for us because we went there, we saw things that were happening, we learned, we pick lessons.”
“We went to the field and we spent a whole day in the field to look at how the CHWs are working in the community. When we came back we had to talk about some of the findings, the challenges, the approach and that was changing the way because we were coming from a background with some experience. So for me, these interactions were not only for the benefit of each country but the entire PHIT program.”
|
Results
Intervention design and implementation
Influence of context on intervention design
Intervention implementation and evolution
“Talking about learning, in the initial approach, we were trying to help the community without including them. What we learned from the Community Conversations process was that we need to work with the community in order to help them help themselves. The role of the community originally was less emphasized and originally it was much more around the CHWs that we are going to train, are coming from those communities so they know their communities well … But I think later we began to engage more with the entire community structure from the chief headman and structures within the community and challenge them to pick on activities that would address their health problems.” – Key informant
“The … health system has tremendous logistics and stock out problems. From the very beginning of the study, we were required … to conduct integrated community case management of childhood illness, meaning that the CHWs had to provide antibiotics and antimalarials. There was no way through the health system that they could procure and deliver supplies to CHWs…” – Key informant
“Well, I just think the whole thing is kind of learning by doing, it’s like a cycle thing. That’s kind of embedded in our project, everything from the readiness of the health worker to understand their data, so in some cases we had to spend more time with them, in other cases we could spend less, but constantly adapting. We refined the presentations [of facility readiness and local performance]… as we went along, taking some indicators out, putting some indicators in-----we had to kind of refine how we help them frame the problems and the solutions because at first, the solution was something that was completely undoable like ‘build a new health center!’ … So all those little adaptations were constantly happening to those activities…”– Key informant
PHIT project cross-site interactions and influence on country-specific interventions
Perspective for future HSS interventions
“If the ministry is going to allocate resources, priorities may be different: it may be equipment and rehabilitation of infrastructure and new infrastructure, and the service delivery component may be something which would be second tier in terms of funding. But if you are working in a resource-constrained environment, I think sustainability from a financial perspective, it’s a bit naïve to think about it that way.” – Key informant