A national research agenda for pre-hospital emergency medical services in the Netherlands: a Delphi-study

Research is essential to direct and underpin the delivery of care, and to contribute to better patient outcomes [1, 2]. In pre-hospital Emergency Medical Services (EMS) the principles of evidence-based practice are also supported. However, compared to other healthcare settings, conducting research in this field is difficult partly because research capacity and expertise are limited. Furthermore, a lack of high quality EMS research is related to the fact that randomized controlled trials are difficult to conduct in this setting [3‐5]. Therefore, research in EMS is currently often small scale [6‐8] and findings are frequently of limited applicability in the specific context of pre-hospital care [6, 7]. Many national and international researchers, professionals, and stakeholders advocate and encourage an increase of high quality research in the pre-hospital emergency services setting [2‐7, 9].

Various promising developments in the (Dutch) pre-hospital EMS arena are contributing to increase the evidence-base and the quality of emergency care delivery, such as projects to develop performance measures, the implementation of national guidelines, and the implementation of patient safety programs [10‐14]. Moreover, research capacity and research expertise in ambulance care services is increasing due to more paramedics gaining postgraduate qualifications [4]. In the Netherlands, a recent survey identified that 64 unique research projects were conducted in ambulance care organisations in the period 2012–2014 [15]. The majority of these identified research projects focused on cardiac topics. Moreover, only one third of the projects were coordinated by ambulance care organisations themselves. This indicates that mostly others related to the EMS field took the initiative to conduct research on certain topics [15].

In view of these developments, the Dutch National Sector Organisation for Ambulance Care (Ambulancezorg Nederland) supports the development of a national research agenda for pre-hospital EMS to further advance and focus research efforts.

From other healthcare professions and domains we learn that a research agenda can be very helpful to target research efforts and to provide a framework for future investments [16‐20]. Canada, the USA, Australia, the UK and Ireland already set an agenda to prioritize research efforts in the field of EMS [21‐23]. However, since pre-hospital emergency care is very diversely organised, research priorities in Canada or Australia are not necessarily one-to-one transferrable to the Netherlands. The Dutch EMS context is characterised by regional EMS ambulance organisations who employ ambulance nurses. These are all registered nurses (RN) who have a mandatory bachelor education with ample experience in intensive care or emergency care. Additionally, they are qualified as emergency medical technician level four.

To produce research that informs and directs evidence based practice and policy in the Netherlands, priorities are preferably related to the (country) specific context and care system. In order to develop a research agenda that can count on support and commitment from practitioners, research priorities are preferably determined by representatives from all the disciplines working in the field of pre-hospital EMS and related professional organisations (e.g. medical specialists; The Dutch College of General Practitioners) and interest groups (e.g. the Ministry of Health, Welfare and Sports; the Advisory board for Ambulance EMS) in the Netherlands. The aim of this study was therefore to develop a national pre-hospital EMS research agenda, with representatives of the EMS field, to determine future research priorities in the Netherlands.

The response on the Delphi-survey was high: 95 % (n = 59; Delphi I); 97 % (n = 60, Delphi II); 94 % (n = 58, Delphi III); 97 % (n = 60, Delphi IV). Non-response was random, and reasons for non-response were: lack of time, being abroad, or quit working for the EMS organisation at the time of one of the rounds.

The panel selected 25 topics in Delphi I, and further reduced these to 12 topics for the EMS research agenda in Delphi III. Table 3 presents the ranking of topics in Delphi II and III. The topic ‘non-conveyance’ was the topic most frequently selected in the first three rounds.

Arguments given in round II and III to select topics for the national pre-hospital EMS research agenda were very diverse. In Table 4 some examples of arguments are illustrated.

Next to arguments, the panel proposed several suggestions of research questions (in Delphi II and III) to be addressed in future studies (see Table 5). For ‘Non-conveyance to hospital’, the panel reported various research questions to assess the incidence of non-conveyance; to investigate characteristics of this specific population who was not transported to the hospital (after the 911 call); to investigate adverse events and risks related to the decision of non-transport; and, to identify determinants that influence the decision of the paramedic not to transport the patient to the emergency department (ED).

The results of Delphi IV are presented in Table 6. The disagreement index, the measure for consensus, was lower than 1 for all topics. This indicated that the panel had an adequate level of agreement with respect to all topics. In Delphi IV, nine out of twelve topics were rated as appropriate for the national pre-hospital EMS research agenda because these topics were rated a median of 7 or higher. Median scores were all between 6 and 9, indicating that no single topic was regarded as not appropriate. The topic ‘non-conveyance’ received the highest rank. Two research topics had decimal medians (6.5 for the topics Immobilisation and Open/secure airway), due to an even number of people in the panel. In order to favour the expert opinion, these topics were included in the appropriateness category and thus added to the research agenda. Three research topics had a median score of 6 and were therefore considered somewhat appropriate (category 2), these topics were not added to the national pre-hospital EMS research agenda.

In this study a national pre-hospital EMS research agenda was developed with a multidisciplinary group working in the field of pre-hospital EMS in the Netherlands. In a four-round Delphi study 48 research topics were prioritized, of which nine were considered appropriate and met criteria for adequate levels of agreement. Additionally, a variety of arguments and suggestions for research questions were collected, giving insight in reasons why research on these topics in the near future is needed. The development of a research agenda is a valuable first step to further increase the evidence-base in pre-hospital emergency care delivery, and produces research that informs and directs practice and policy.

Other countries have launched similar initiatives to identify EMS research priorities [3‐5, 21, 23, 26‐29]. All these studies clearly promote and encourage more scientific research in the pre-hospital emergency care setting. Comparing the research priorities of this study with topics of other studies gives insight in similarities and differences between the research topics.

Our study demonstrates a high level of interest in the topic Non-conveyance. In both Canada and the UK, non-conveyance was mentioned as research topic, but was no priority [21, 28]. The topic was formulated as ‘Safety, costs and benefits of alternatives to conveyance to hospital’ in the UK, and ‘Destination decisions, non-transport and alternatives to referrals by EMS providers’ in Canada. This might indicate that pre-hospital services across countries feel the pressure to deal with scarce resources and an increase in calls. One possible explanation why non-conveyance was ranked highest in the Netherlands but not in other countries is the relative autonomy of ambulance nurses in The Netherlands. Another argument could be that access to the emergency health care system differs between countries. In the Netherlands, a patient can receive urgent emergency care from different organisations : the general practitioner (GP) during office hours; an out of hours primary care cooperative; the emergency department (ED), and furthermore a 911-call provides access to emergency care provision of an ambulance [30]. Due to a shift in the accessibility of primary care (long waiting times), people might more often make a 911-call. While probably they could have called the out of hours primary care service. According to the expert panel of this study, non-transport occurs frequently in current practice, however the exact rates are yet unknown. Other research questions related to non-conveyance were gaining insight into characteristics, determinants, and risks and (cost saving) benefits of the decision not to transport the patient to the hospital.

The other research priorities determined in our study resembled those in other countries. The topic ‘Performance measures for quality of care’ was reported in Canada, the UK and the USA [4, 21, 28, 31]. As pointed out by Snooks et al., response time is often used as the single performance measure, while research has shown that this measure is not sufficiently adequate to measure quality of ambulance services [28]. The topic ‘Hand over/registration/exchange of patient data’ was reported as priority in Canada, Australia and the UK [21, 28, 29]. Remarkably, this topic was also identified as barrier for conducting research [27]. Electronic standardised patient care reports and reliable databases are needed to conduct high quality research, but these are often not available. Furthermore, the topic ‘care and task substitution’ was also reported in other studies, such as: the effects of regionalisation of care for specific conditions [21]; the role of the paramedics in various health settings [21, 29]; the role and benefit of advanced practitioners (physician manned ambulances) [3, 26]; and the relationship between skill level and outcome [3, 29]. Other similar priority topics concerned specific interventions for which the evidence in the pre-hospital field is scarce. Examples of such knowledge gaps were given with respect to airway management, immobilisation, and resuscitation and devices [3, 26, 28, 29]. Furthermore, the topics triage and protocol-adherence were also identified as priorities in other studies [3, 21, 26, 27].

There were a number of research priorities in other countries not identified in our study. First, one study reported the need for evidence on introducing pre-hospital ultra sound [26], research with respect to ergonomics, workforce, lifting and equipment [21, 29]. Furthermore, Cone et al. recommended more research how the field adopts new scientific evidence, and the role of (commercial) advertising in this process– in particular when evidence is scarce or conflicting [3]. Next to research priorities, previous studies identified barriers for conducting scientific research in the field of emergency medicine [27‐29, 32]. Several recommendations to solve these barriers were suggested, such as improving training opportunities for EMS researchers, stimulating increases in available funding sources, and facilitation of protected time for staff to conduct research.

Apparently, many countries feel the need to develop a research agenda and to encourage conducting scientific research in the field of EMS. Despite some differences between countries and systems, we identified many similarities in future research topics. This could stimulate researchers to collaborate internationally with respect to high priority research questions, and thereby increase the evidence for pre-hospital patient care delivery.

The Dutch national pre-hospital EMS research agenda contains broadly defined research topics. To take this agenda further, we need to translate these potential research priorities to actual research questions. A literature study should be conducted to summarize the evidence and existing body of literature on the research priorities of the national agenda. Dissemination and implementation of the national research agenda deserves careful attention, taking into account barriers and facilitators influencing these processes. From the initiatives in other countries, we learn that the pre-hospital EMS field needs to be facilitated to implement the research agenda [3, 21‐23, 27]. Research skills need to be introduced into the working environment and the education system. A research community needs to be created where knowledge translation and application is facilitated. Senior management should encourage and support research. And, additional funding of research in the pre-hospital emergency setting is necessary.

This is the first study in the Netherlands that developed a national pre-hospital EMS research agenda. A strength of this study is the high response of the multidisciplinary expert panel in all rounds of the Delphi study. This indicates enthusiasm, commitment and broad support for the national research agenda. Furthermore, the rich qualitative data from this study is very useful to understand why topics are research priorities, and what specific research questions are suggested to focus future research on. This combination of quantitative and qualitative data is valuable, and we recommend other researchers to also collect qualitative data when they want to develop a research agenda.

Some limitations of this study should also be discussed. In Delphi IV we used the RAND/UCLA appropriateness method [25], taking into account agreement within the panel. In hindsight, it would have been better to use the same criteria for selecting research topics in each Delphi round. But, considering the high level of agreement on the topics in the final Delphi round, we assume that results would have been the same anyway. Another limitation of the study is that we did not succeed in including the patient perspective in the expert panel. Although a patient representative was invited to take part in the expert panel, the invitation was not (or could not be) accepted. The patient perspective should be included in the implementation of the research agenda, for instance when formulating actual research questions, commissioning a call for research or decisions on funding research proposals.

A multidisciplinary expert panel identified pre-hospital EMS research priorities in the Netherlands. The research topics include: Non-conveyance; Performance measures for quality of care; Hand over/registration/exchange of patient data; Care and task substitution; Triage; Assessment of acute neurologic signs & symptoms; Protocols and protocol adherence; Immobilisation; and Open/secure airway. These topics provide a focus for future research efforts to improve the evidence base and clinical practice of pre-hospital emergency medical services. Dissemination and implementation of this national EMS research agenda deserves careful attention.