Background
Maternal mortality in India remains among the highest in the world, despite a reduction from 570 in 1990 to less than 200 per 100,000 in 2013 [
1]. The main causes of maternal mortality are postpartum haemorrhage, sepsis, obstructed labour, abortion and hypertensive disorders [
2], with the first four accounting for 60% of maternal deaths [
3]. It has been observed that a key barrier to safe delivery is timely and appropriate emergency obstetric care once women have reached a facility in labour, sometimes referred to as the “third delay”, and that 86% of the cause of the this delay is inadequate staff training, drug procurement issues, lack of equipment, staff shortages and low staff motivation [
4]. Basic obstetric skills at the first level of care are essential for preventing maternal deaths [
5].
India also has a high neonatal mortality rate, at 35 per 1000 live births (42.5 in rural areas) [
6]. In 2005, there were 2.3 million child deaths in India, 20% of all child deaths in the world [
7], and 900,000 neonatal deaths [
8]. One-third of neonatal deaths occur on the first day [
9,
10], when infants are often still in health institutions. Seventy-eight percent of neonatal deaths are attributed to three main causes: prematurity and low birth weight; neonatal infections; and birth asphyxia [
6,
8].
Birthing in health facilities has increased over the last few years (there was a 57% rise in institutional deliveries between 2005 and 2008) since the creation of the National Rural Health Mission (NRHM) in 2005 (now called the NHM – National Health Mission) and its Janani Suraksha Yojana (JSY) cash incentives scheme. Nevertheless, maternal and neonatal mortality rates remain high [
11]; there was only a 2.5% drop in perinatal maternal mortality in the 2005–2011 period leading to the suggestion that the quality of care in those facilities is poor [
11,
12]. George, in a study in Karnataka state also concluded that women seek care but are often inappropriately diagnosed and/or managed [
12]. A cornerstone of the NHM effort to improve labour and delivery has been the appointment of new staff nurses to conduct services at “24x7” primary health centres (PHCs), providing them with three-week intensive skilled birth attendant (SBA) training, in addition to basic training [
13]. However, there is no specific midwife cadre; this means that nurses have been described as “circumstance driven midwives” where they have to do midwifery among all other jobs, have little specific training, little authority, power or responsibility, lack professional satisfaction and basically cope with the situation [
14]. There is also poor follow-up or support after this training and little documentation of how nurses recognize and manage obstetric and neonate problems [
15]. In the developed world, clinical mentoring is viewed as essential for the training of health workers [
16,
17], and in other contexts studies have pointed to the need for high quality supportive supervision and mentoring of staff after training, particularly where basic training may be inadequate [
18,
19]. A survey of nurses in northern Karnataka, India, showed a poor grasp of basic labour and delivery issues and concluded that supportive supervision and enhanced clinical mentoring should be implemented, as well as user-friendly case sheets or checklists that could be used as job-aids and also for documentation [
20]. This paper summarizes a study of the effect of case sheets with and without mentoring on nurse knowledge and skills in a randomized trial of 108 PHCs over a one year period in Karnataka, India.
Methods
Two districts in northern Karnataka state, south India, with 108 PHCs, were selected for the study. All sites were provided with a supply of newly developed comprehensive patient case sheets introduced at a three-day orientation session for staff nurses before the start of the main mentoring intervention. The case sheet was designed for use with women in labour from arrival to discharge. It includes sections on initial assessment, labour monitoring, delivery and postpartum care. It also has a set of sheets for identification and pre-referral management of complications that detail appropriate drugs and essential actions. Then stratifying by district, half of the PHCs were randomly assigned to be intervention sites and provided with regular mentoring visits (with case sheets integrated as a job and teaching aid) and half to be control sites, where no support was provided. By providing case sheets and/or on-site mentoring, it was hypothesized that the knowledge and skills of providers to conduct normal deliveries and to identify and manage complications would improve, over and above their basic government skilled birth attendant (SBA) training.
The mentoring intervention addressed improvements in both clinical practice and service delivery through a dedicated cadre of nurse mentors (NMs). Eleven nurse mentors, each responsible for 5–6 intervention PHCs, were recruited and trained for 5 weeks in essential clinical competencies and in how to effectively mentor PHC staff in clinical knowledge and skills, team building, problem solving and service delivery improvement. The NMs visited each of their assigned intervention PHCs for 2–3 days every two months starting in August 2012 for a total of six times during the first year. They used tools and approaches such as self-assessments, observations, clinical and case sheet audits, and interviews as aids to make an assessment of capacities in the facilities. They attempted to upgrade staff nurse knowledge and skills through case reviews, demonstrations and modeling of good practice, bed-side case discussions, and small group teachings on such issues as partograph use, management of normal labour and complications management. Apart from clinical mentoring, the mentors focused on team building and self-assessment problem-solving around all aspects of the provision of quality maternal, neonatal and child health (MNCH) services.
Data collection involved interviews with all available staff nurses (SNs) in all 108 facilities. A questionnaire was designed and field tested twice for a total of 8 days before being finalized (Additional file
1). Closed ended questions on key aspects of labour, delivery and the postpartum period, focused on identification and pre-referral management of critical complications: some aspects of knowledge were tested using case studies (such as asking staff to read and interpret 23 questions about a filled partograph) and some questions required them to demonstrate a skill, such as neonatal resuscitation with an ambu bag and mask. Simultaneous data collection was carried out in both study districts over a period of one month in April 2012 (before the 3 day case sheet orientation) and again in August 2013 (12 months after the actual start of the main mentoring intervention). Data were entered and analyzed using IBM SPSS version 22 (IBM Corporation, Armonk, New York, 2013).
Sample size calculation
Assuming that 10% of staff nurses had correct knowledge (of all three steps of active management of third stage of labour) at the time of baseline and that the intervention would improve it to at least 20%, setting alpha level error at 0.05 (95% confidence limits), beta level error set at 0.2 (80% power) and intra class correlation at 0.4, the study required an estimated sample of 54 clusters and 162 staff nurses per arm. The two study districts had 109 functional 24/7 PHCs at the time of study. One facility was under renovation at the time of the study, and so 108 were included in the study, of which 54 were randomly allocated into an intervention arm and 54 into a control arm. Within the facilities, all nursing staff available were interviewed in the study and were the unit of evaluation.
Statistical analyses
Main analyses
First we conducted basic univariate analyses comparing staff and site characteristics at both time periods, examining explanatory variables associated with exposure to interventions (use of case sheets with and without mentoring), and other potential confounding factors (client caseload, nursing experience and district).
Sub analyses
In order to more fully understand improvements in the follow-up time period, we selected several variables for grouping into three major domains: Normal Labour, Complicated Labour and Neonatal Issues, based on their association with maternal and neonatal mortality in India. Composite indices for the three knowledge domains were created by entering relevant test items into a principal components analysis (PCA); due to the binary nature of all test items, polychoric PCA was used. PCA is a variable reduction technique that reduces a set of observed variables into a smaller set of uncorrelated components (i.e. principal components) which account for most of the variance in the observed variables. Thus, each component is a linear combination of the observed variables optimally weighted to account for the maximum amount of variance. For each knowledge domain, all components with an eigenvalue of greater than 1 (>1) were kept as outcome variables for further analyses.
Following PCA, and for each index developed, linear regression using generalized estimating equations (GEE) was used to assess the association between type of support received and performance on the index. Thus, separate multivariable regression models were estimated for each of the knowledge domains. GEE was used to correct for clustering by the facility from which each individual was recruited. Available confounders added to multivariable models included average number of deliveries in the facility per month (21 or more vs. fewer than 21); the districts (Bellary vs. Gulbarga); and the number of years since basic nurse training (1–5 years vs. 6 or more years). Stata V12 (College Station, TX) was used for PCA and regression analyses.
Ethical approval for the study was obtained from the Institutional Ethical Review Board of the St John’s Medical College and Hospital, Bangalore, India. Written informed consent was obtained from all participants before interview.
Discussion
Supervision plays a key role in performance but is frequently characterized by periodic inspection and control rather than support and feedback to improve performance [
21]. However, for the last few years, there has at least been an understanding that
supportive supervision should emphasize joint problem solving, mentoring and two way communication, address weaknesses in the supporting health systems, provide professional development, job satisfaction and motivation, model good practice, and give information about guidelines and standards of practice. In turn, supervisors need to be well trained, equipped and have transport [
17,
19]. Implementing such an intensive quality improvement programme is not easy, especially in a large country like India with thousands of health facilities, a largely rural population, isolated health workers and poor infrastructure. There have been few randomized trials of such initiatives [
19]. Our study of 108 facilities and almost 300 nurses in two large rural districts showed that in the space of one year and only 6 visits, the supervision/mentoring project had a demonstrable effect on knowledge and skills. We attribute this to a well-trained cadre of sensitive, non-threatening nurse mentors, good central support and funds for travel, a philosophy of teamwork, self-assessment and problem solving, and good quality on the job training and mentoring, with use of the case sheet as a central hook on which to hang teachings and case reviews [
22]. The study confirmed that staff in busier PHCs were in fact not as knowledgeable as staff in smaller centres, and this allowed us to change the mentoring strategy and focus more attention there in year two of the programme.
In many countries it has been assumed that poor health worker performance reflects inadequate knowledge and skills. As a result most interventions have focused on training, with mixed and sometimes disappointing long term-results [
19]. Training is clearly important, but most now acknowledge that there is a need to move beyond training with multi-faceted interventions [
19]. Certainly our 2012 baseline data showed that SBA training without additional inputs appeared to have had a limited effect on nurses’ knowledge and skills, although the additional programmatic inputs in 2013 did seem to have strengthened knowledge of those who had the SBA training over those who had not.
In a study reviewing 15 studies of interventions to improve health worker performance, it was concluded that the dissemination of written guidelines (or case sheets) alone without added interventions is also ineffective [
19]. Our study showed clearly that although provision of case sheets and a 3 day orientation, added to the knowledge of nurses in univariate analysis, it did not make them perform significantly better than those who had only had SBA training, when controlling for other factors in the multivariable analysis. This was not unexpected as the case sheets are of necessity long and detailed. Without proper training they might be somewhat difficult to follow, and without adequate encouragement, might appear cumbersome. Furthermore, the case sheets offer guidance/protocols in how to manage complications and much of this guidance actually differs from long standing practices. In the mentoring sites, the case sheets were used as job aids, but also as teaching tools during every mentoring visit, so that their use over time was understood to be relevant and important for proper patient management. Some have suggested that short reminder-based checklists might be useful, and one study found they could be successfully implemented in a sub-district hospital in India [
23]. We would argue that without good basic knowledge, these checklists still might not be understood or provide sufficient guidance, and without mentoring, their use would not be reinforced.
We do not know for sure why knowledge and skills improved among staff in the control sites in 2013, albeit not to the same extent as staff from the intervention sites. However, it is possible that a combination of factors might explain this effect: more staff receiving basic SBA training; improved government SBA training; attendance at a 3 day case sheet orientation; some case sheet use; cross-pollination of ideas between staff in different PHCs; or encouragement by district officials who discussed the mentoring and case sheet in district meetings attended by staff from all PHCs.
There is evidence that women in India are now opting for delivery in facilities; the proportion of institutional deliveries increased from 42% in 2004 to 69% in 2009 [
24]. However, Rao [
25] and Prasad [
26] note that nursing education in India has suffered neglect. A survey showed 61% of nursing colleges were unsuitable for teaching, with an acute shortage of faculty and facilities [
27]: inadequate libraries and demonstration rooms, overworked teaching staff, little practical experience for students and few opportunities for in-service training for teaching staff [
28]. Training institutions in many states have even shut down even as NHM seeks to induct more nurse midwives [
29]. While improvements to pre-service training are needed in the longer term, innovations to enhance the knowledge and practices of those nurses already in situ are urgently needed.
The study had some limitations. First it should be noted that outcomes are measured at the individual knowledge level within sites; thus, the overall performance of intervention versus control sites, with respect to reductions in maternal and neonatal mortality, was not assessed. Second, we did not assess actual nurse practices as this was beyond our scope and budget. Certainly knowledge is a precursor to good practice and without it we might assume practice is thus poor. However more research is needed to know what should be the key areas for focus in training and mentoring programs and their measurement.
Acknowledgements
We would like to thank all the staff of St John’s Medical College who conducted weeks of training and follow up visits. We would also like to thank all the KHPT district staff for managing the mentors in the field. We are grateful to the mentors and to staff of the PHCs who work hard every day in difficult settings. Thanks to the Bill & Melinda Gates Foundation for funding the study.