Emergency call-handing for ‘999’
Prior to the introduction of the CDSS in the ambulance service, 999 emergency calls were handled by non-clinical staff using a basic classificatory system (Criteria Based Dispatch) which meant taking a name and address and, usually, dispatching an ambulance. In contrast, the CDSS offered a comprehensive triaging system built on a clinical evidence base, for use –by call-handlers who receive 12 days training on using the computer system and are not required to have clinical training. The CDSS was promoted by the Department of Health, who had trialled it and vouched for its safety but it was also supported by ambulance service managers, and call-handlers themselves, keen to dispatch ambulances more appropriately:
The benefits for me were not taking some people to hospital and only responding vehicles to people who really needed it. (Control room manager)
It wasn’t that long ago a good ambulance service took everyone to hospital but now it’s all changed. Now it’s about how many patients we can keep out of hospital safely. (Senior Manager)
These beliefs were tied to imperatives for rationing, in the face of rising demand and seen as an opportunity to discipline patients, especially ‘inappropriate’ callers with non-emergency problems, and also to support for ‘evidence based medicine’ – whereby formal knowledge bases (systematic reviews, expert systems, etc.) based on the accumulation of good practice replaces knowledge vested in and accumulated by individual clinicians. Trust in the system was high, because it was built on this externalised expert knowledge, making it safe for non-clinicians to use:
Call-handler explains that the CDSS has been designed by ‘a huge group of people…non-clinicians, clinicians - lots of input…it’s a very safe system to use, used correctly’. (Observation notes)
Drawing on NPT we can say that the combined rhetorics of safety, rationing and medical expertise meant that the
coherence of the innovation was strong: it made sense for the range of participants involved, from policy makers to individual call-handlers. However, coherence alone does not explain why the technology was successfully brought into everyday use: in principle support for innovation has to be translated into participation and action. Interestingly, despite the general communal specification of coherence, each of the actors participating in the implementation of the CDSS did so for distinctive reasons. For the Department of Health, the CDSS offered the chance of a high profile technological success – much needed given all the promises about harnessing technology to achieve NHS modernisation. This general goal was shared by the CDSS developers, but they were keen – of course – to see their particular CDSS used, and were prepared to work very hard to make it work in this site. The Ambulance Trust managers also had specific local ambitions:
We’ve always been in the forefront of new things, new initiatives … projects. …you can guarantee if something’s going to happen, we will be at the forefront of that and we’ve got a reputation for that, of wanting to try new things and wanting to push the boundaries a little bit further, so, it didn’t surprise us when we won the pilot for [the CDSS]. (Senior Manager)
For the call-handlers, there was less choice about participation – their use of the CDSS was imposed on them by their managers. However, we know from previous studies that this is not always sufficient to make an intervention work e.g. [
54]. The active buy-in of the call-handlers was important to successful implementation. In practice, this was achieved because of a strong commitment amongst the call-handlers to disciplining ‘time-wasters’ (the inebriated and those with minor ailments who should not be calling 999), although alongside this the call-handlers had some concerns that the CDSS might ‘de-skill’ them (something that we return to shortly). In addition to the human actors enrolled at 999 the CDSS had to link to other technological devices systems and geographical and demographic databases – for example maps showing incident and ambulance locations - in order to ‘perform’ the work of 999 call-handling. To summarise in NPT terms, we can see how
cognitive participation – the enrolment of the actors necessary to make the intervention work – took place in this case. Notably, attention to cognitive participation shows that diverse motivations for participation were contained within the broader discursive formation of coherence.
So far, so good, strong coherence and cognitive participation were established around the intervention. However, bringing the CDSS into use required concerted action from all the actors involved, particularly the call-handlers who had to use the system in their everyday practice. Here we found that whilst the system was effectively brought into use, it was not in the way envisaged at the start: making it work involved some surprising compromises. Specifically, whilst the CDSS ‘promised’ a combination of Evidence Based Medicine and de-skilling, in practice the call-handlers’ experienced up-skilling – learning to navigate multiple information systems, and engaging in extended and often very difficult conversations with callers:
[The CDSS] is harder, and it’s easier, if you know what I mean. It’s harder because you’re having to get a lot more information and you seem to, sort of, everything’s on top of you … (Duty Manager)
Furthermore, while the CDSS was expected to control the knowledge in play the call-handlers continued to draw on and develop experiential knowledge and exercise discretion around personal and organisational values not programmed into the software. In the following example, a call-handler over-rode the CDSS disposition, to allow an ambulance dispatch where none was indicated. She says:
… “that was naughty…sometimes you let your heart rule your head”. […] There were two main reasons why she overrode the disposition 1) she was an elderly lady who was anxious, 2) there were difficulties in communicating - both her speech and her hearing - was making it a lengthy procedure. The patient had already spoken to [another service] and to the ambulance service. If the call was referred on the patient would be required to speak to a third agency. She felt that this call was going to take a long time to resolve, potentially leading to further distress for the patient. She [the call-handler] justified her actions by saying “I haven’t done an override recently…” (Observation notes)
The development of experiential expertise and the use of tacit knowledge and discretion has of course been highlighted in other organisational research such as the call centre studies noted earlier, and in classic studies like Suchman’s analysis [
55] of how creative improvisational reasoning underpins ‘plans and situated actions’ . What is novel here is that this CDSS offered these
non-clinical staff an opportunity to perform
clinical identity and gain some additional status and authority. Despite the introduction of an extensive auditing system, these discretionary practices and outcomes were tolerated. In NPT terms, we see the importance of the wider institutional setting within which the collective action is taking place: how implementation takes place at the point of interaction between established and emergent rules, practices and identities. The call-handlers effectively operationalized the innovation and built shared understandings of how this could be done, but this was not exactly as expected. Indeed, tolerance for unanticipated outcomes and willingness to moderate expectations and processes was key to embedding the CDSS in this site.
Throughout the implementation process, the Department of Health, the developers and the Ambulance Trust were attentive to the need for incremental adjustments, a process referred to as reflexive monitoring within NPT. For example, whilst extensive call-audit procedures were introduced alongside the CDSS, which could have been used to ‘police’ the call-handlers very closely, in practice these procedures operated with a tolerance that allowed call-handlers to adapt phrasing and use some of their ‘own’ knowledge in managing calls. This call-handler discretion helped make the system work and possibly also reduced staff turnover by making the job more satisfying. The managers also found it necessary to introduce new ‘clinical supervisors’ (typically a nurse or paramedic) to support the call-handlers in dealing with complex or non-standard cases. Whilst the developers tried to accommodate these kinds of cases within the software, this proved ineffective, and the presence and actions of clinical supervisors effectively legitimised ‘fuzzy logic’ in the day-to-day operation of the CDSS. The Trust also provided additional clinical training for the call-handlers to help them understand symptoms (e.g. explaining what happened when someone had a stroke). This, combined with the presence of clinicians reinforced the sense that call-handling work has a strong clinical component, making their work both possible and rewarding. The interactions between these human actors and the technology and interpretive flexibility in everyday use of the CDSS led to continual evolution of the system. We know from Science and Technology Studies [
37,
38] that technologies are never fixed or finished and this was true at 999 where the CDSS developers continued, some 2–3 years into deployment, to upgrade and adapt the system.
Single point of access to urgent and unscheduled care
Single Point of Access (SPA) was a new service, using the CDSS to triage callers and direct them to the relevant primary care services. The call-handler was able to book appointments with appropriate care professionals (commonly a GP) and could also book patient transport for this. The call-handler could also offer self-care advice, prescribed within the CDSS, if indicated. The service was operated by the same ambulance trust as 999 above, as a new venture – both for them (this was the first time they had delivered non-emergency services) and more generally (this was the first attempt to link primary care services in this way).
As for 999, the CDSS was seen as a way to improve healthcare delivery, specifically as a way to integrate and rationalise out-of-hours services. This was an important Department of Health priority that resonated with local managers:
…we’d already realised that, … the whole health care model’s becoming so complicated it’s difficult to navigate your way, way through it; it’s not the patient’s fault that they don’t know how to, how to access and who to access and that the NHS… should get its act together and make this as easy as possible. (Senior manager)
Based on their experience with 999 the managers were confident in the CDSS and, indeed, believed that they could employ staff with the same skill set as 999, and that this would – eventually - enable staff to work flexibly across urgent and emergency care, maximising effective workforce management.
I would like to think that they would all …be skilled to take all levels of calls. I think if we start to carve out different types of calls coming to different, then you sort of lose that, the capacity. If they are all trained to take the 999 calls, then when they’re not doing an urgent call, they can pick up a 999 call and vice versa. So I think it’s, you know, you have better use of resources if they’re all trained up to take all calls. (Senior manager)
For the developers SPA was an opportunity to extend the use of their system, to demonstrate its value more widely. For senior managers, the advantages of the CDSS were even greater than in emergency care:
The big prize will be to apply it to those callers who would previously have phoned their GP in-hours because they had an unscheduled care need or they would have phoned their doctor out of hours…or they would have phoned NHS Direct… And my belief is that [the CDSS’s] true worth will then be… truly exhibited. (Senior manager)
Again, framing this using the domains of NPT, the intervention made sense to the key actors in SPA because of commitment to integrated care. But the need for coherence and buy-in was rather different in this case, compared with 999. First, because successful implementation required buy in from primary care and community services and, as part of this, integration of the CDSS with a range of external technological systems (e.g. appointment booking). And second, because the service recruited new call-handlers, who – by default – did not share any of the 999 call-handlers’ reservations about the CDSS and had no pre-existing practices to be adjusted or accommodated.
Nonetheless, the everyday practice of SPA call-handling using the CDSS proved to be highly complicated as different pathways through the CDSS algorithms resulted in different dispositions (e.g. call an ambulance, wait and see your GP) so that achieving an agreed outcome with the caller could be difficult:
… the final disposition was a 19 minute ambulance. The call-handler explained that an ambulance was going to be on its way but the patient did not want an ambulance: she refused it. So the call-handler called the clinical supervisor and clicked on early exit. He then arranged an appointment at one of the primary care centres at 6.50pm, by selecting a PCC from the list and clicking on the option book appointment. He confirmed the appointment to the caller and then filled in a box on care details with some brief comments on the case. (Observation notes)
A conversation between a developer, clinical supervisor and researcher comparing 999 and SPA. The clinical supervisor mentions that she thinks that the work requires a “different skill set”. The developer thinks that, in some ways, the out-of-hours work is more difficult, and describes it as having “more complexity”. She says that some call-takers might be suited to one type of work rather than the other. She characterises the difficulties of the different types of work broadly as: on the one hand emergency work is stressful/requires thinking on your feet/acting quickly/confidently, on the other hand, out-of-hours work is complex, less straightforward, and more time consuming – requires patience. She notes that “there are some fantastic [999] call-takers” but she says that she think some of them might find out-of-hours work “a bit boring” in contrast to the “adrenaline” involved in 999 work. (Observation notes)
The everyday work that it takes to make the intervention work is different in these two different cases. In NPT terms, the collective action is shaped by contextual factors, including the skills required for specific forms of work, and the teamwork required to link aspects of the work (particularly important in SPA).
In the initial phase of SPA, considerable resources were allocated to ensure that problems which arose were dealt with swiftly. For example managers and developers worked shifts alongside the call-handlers during the initial implementation phase to ‘trouble shoot’ and fix problems as they arose. SPA also benefitted from the lessons learnt in 999 – for example the introduction of clinical supervisors and the handling of the audit process. In this sense, the reflexive monitoring processes, highlighted by NPT were transferrable across settings. The clinical supervisor role was also added in the SPA setting; indeed it was seen, in this context as a necessity, providing clinical input, partly because the system was viewed as necessarily over-cautious:
if you are uncertain, … you can go to a supervisor and be reassured that you are doing the correct thing. Whereas, I think, if you didn’t have a clinical supervisor you would always err on the side of caution… perhaps, sending an ambulance when you wouldn’t necessarily need one. [ …] So it's really good to have somebody who has the medical knowledge in the room, should you need them. (Call-handler)
Whilst at 999 the introduction of new practices to enable reflexive monitoring occurred alongside the introduction of the CDSS, many of the audit and monitoring practices were firmly in place when the SPA service commenced and were easily accepted by call-handlers. They reported deriving a sense of competency, of being ‘good at what they do’, from passing audits, although it is worth noting that the SPA call-handlers did not have target rates for dispositions, a particularly unpopular aspect of auditing in 999.
Thus we see that coherence about the technology had to be established at SPA, in part built on the foundational sense-making achieved in 999, but also built around new service integration and delivery. New staff had to be enrolled into bringing the CDSS into everyday use, and this entailed longer and more complex negotiations with patients, a broader range of dispositions than found at 999 and some subtly different ways of auditing and monitoring practice. Turning to our final case study, our theoretical framework allowed us to systematically examine similarities and differences once more.
General practitioner out of hours service
Located in a different Trust, on the other side of England, the Out of Hours (OOH) service introduced the CDSS in response to new national care standards. Satisfaction with the existing system was high amongst the managers, GPs and call-handlers:
we were very happy with it; it worked very well. Like I said, we won an award … because it was so effective. The PCTs locally were very happy and they’ve audited it. And we have a clinical governance system that reviews calls and the outcomes of the calls, and the performance of the operators, the GPs, nurses, etc. (General Practitioner)
The positive, with using that system, was that the calls used to take on average 2 minutes …. with the old system, they didn’t need as many operators, so it was more cost effective. (Call-handler)
This presented a different challenge for those promoting the new system – to achieve coherence they had to persuade the relevant actors that the new system would be as good, if not better, in a context where there was little ‘shop-floor’ imperative to make a change. Consequently, the new CDSS was not presented as an alternative but as a similar way of doing the task, but in a way that met new bureaucratic requirements.
The main advantage is that it’s a nationally recognised system. It’s obviously gone through all the Royal Colleges, it’s been agreed, and so from a litigation perspective, a medico-legal perspective, it’s very safe and secure. So that gives us real security, the fact that it’s good. [ … ] But, basically, [it] is very, very similar. It works in a similar way to the way we do our [old] protocols. (Senior Manager)
In this way, the managers attempted to build on coherence around the old system to build support for the new one. This said, they were also keen to reduce demands on doctors’ time and to direct callers to alternative dispositions or offer self-care advice and this entailed additional roles for the call-handlers’ and led to some ambivalence about the CDSS:
There's nothing that I can say that I think it is better than the way we were doing it, not at the moment. It is, first line triage done by non-clinical staff, for half the price that you're going to have to pay a nurse. If that’s good, if that’s saving people money, that’s fine, but they're asking people who have 60 hours training and not a medical background at all, to do what they're doing, and sometimes I think, oh dear [laughs]. (Call-handler)
Also, unlike the other settings, the CDSS was introduced in OOH before all the call-handlers had been trained and so ran alongside the existing system for 6 months. This made buy-in more problematic – why change when there is a functioning system in place? In response the CDSS developers (themselves anxious to secure an exemplar of the CDSS in use in OOH) provided significant additional support at this site. Meanwhile, a key player from the Department of Health took it upon himself to actively promote the CDSS to key stakeholders, lending additional credibility. Nonetheless, there was resistance from call-handlers here, some of whom were concerned about how much buy-in there was amongst the range of actors implicated in delivery:
Quite often there’ll be a heated discussion going on somewhere of people really that are just running it down, and probably people that have never used it. I mean, the doctors obviously haven’t… they don’t have to use it because we’re using it, but there’s a lot of negativity about it. I don’t know what the answer is to that one, but it’s the old saying: you need to get the people in charge or the right… the people at the top need to be in, trained and confident with it before we start pushing it up at the bottom. (Call-handler)
In the everyday practice of using the CDSS, these call-handlers also had to implement extended questioning, and the time taken for each call went up. Whilst the demands were not as heavy as for the other two sites – 999 call-handers dealing with life and death emergencies and SPA call-handlers with multiple primary care services - the call-handlers in OOH still required an increased level of understanding:
You’ve got to drive it and you’ve got to have the knowledge and the background to work with that because you’ve got to understand the inference of what it is that you’re asking. If you don’t understand what you’re asking, you’re not going to be able to use it effectively. (Call-handler)
Notably, the call-handlers here had a strong commitment to one particular outcome: giving callers access a GP. This was what they had done before, and it was what they expected to do now. Whilst the CDSS was supposed to triage, and therefore deny access to some callers, the call-handlers would work ‘around’ the system, often exiting the CDSS before the final disposition:
Call-handler: If it's children’s coughs, colds and flu and things, then fine, I will […] let it go where it wants to go. And if it goes ‘to pharmacy within three days’, then that’s fine, but that’s not what the patient wants to hear. The patient has rung us up because they want to see a doctor or a nurse, not because they can see a pharmacy in three days. But I will let it take me and then they will say well no, I want to see somebody. So that’s wrong.
Q: You have an early exit and you will…
Call-handler: Yeah, give the patient an appointment. But then you know it's taking you where it's supposed to take you but the patients don’t want that, they have expectations other than seeing the pharmacist in Tesco’s in three days. (Call-handler)
Reflexive monitoring at OOH was somewhat different to 999 and SPA because existing audit systems were less developed and there were fewer staff resources. Initially there was only one member of staff responsible for all training and auditing (compared to the 999 and SPA setting, which had a team of about six trainers/auditors). Whilst all OOH call-handlers were audited in the same way as SPA and 999 they only received feedback on their performance if they failed an audit. As a consequence, some call-handlers seemed unaware whether or not they had been audited. However, despite this emphasis on using monitoring to identify bad practice, there was still acceptance of flexibility in using the CDSS. Interpretive flexibility was legitimated by general practitioners and managers, and was most apparent in call-handler decisions to not use the CDSS for certain types of calls (e.g. palliative care patients):
…for the patient who’s at end of life, [where it’s] not possible to answer questions on the telephone, and you’re asking for a specific type of pain or, and they’re obviously, they can’t answer you. It’s not appropriate to put them all the way through questioning when you wouldn’t be leaving them for two hours or six hours anyway. You would want them to be seen as quickly as possible. So there’s no point in putting them through the torment of taking a load of questions, for them to be asked all over again by the doctor. So in areas like that, it’s not really appropriate to assess them. (Manager)
As a coda to this case, towards the end of our research the OOH service took on reception work at the local Urgent Care Centre located in an acute hospital, using the CDSS to triage face-to-face encounters. Initially it was assumed that the work that would be required to implement the system in the new setting was well understood from the original OOH experience, but this was not the case. Face to face work required additional skills, including negotiating with more than one person simultaneously - often a patient came to the desk with a carer or family member, or using visual and non-verbal cues (e.g. establishing the amount of blood loss without asking the patient) to support assessment; in effect coherence and participation had to be established and reprised once again in this new environment.
Discussion
Our analysis shows how the ‘same technology’ was used distinctively in different settings reflecting important differences in the nature of the service and care provided and the social interactions between workers, stakeholders and service users. Previous research has alerted us to the fact that the implementation of technologies depends on the interplay of technology and the workforce in everyday practice [
55‐
57]. Our study has extended this understanding by using a theoretical framework to enable cross-case comparison and identification of the mechanisms underpinning successful implementation. We have shown, using NPT how
coherence was achieved around the CDSS despite local context variation. Across all three sites there was agreement that the CDSS was suitable for the (varied) tasks and that appropriate resources were in place to enable effective implementation, although these varied between settings. There were differences between settings where the CDSS replaced an established system with existing staff and where the service and/or the staff were new and the work of establishing coherence had to be altered to reflect this. It was clear that knowledge, experience and work identities built through doing call-handling work influenced the coherence of the CDSS for staff in the different settings. What is especially interesting in the wider policy context – where this same CDSS is now being used to support a national ‘111’ urgent care service [
58] is that coherence was not just a local ‘problem’, it was necessarily underpinned by wider understandings and discourses for example about the necessity of rationing and the need to modify caller/patient behaviour and beyond that the very legitimacy of evidence based medicine and the kinds of expert knowledge which underpinned the CDSS.
In all three settings key players were successful in enrolling a diverse network of people and technologies to bring the CDSS into use. We have shown that managers in 999 and OOH had to work harder to enrol call-handlers because of their prior use of a different technology, and the CDSS developers had higher engagement with the 999 setting which built trust and fostered enrolment and legitimation of the CDSS. Considerable effort was expended in enrolling staff although not all were in the same position regarding the CDSS – for example call-handlers had little power to resist its introduction if they wanted to retain their employment. What is important however is that the technology was implemented despite, or even because of, the emergent processes by which the call-handers and stakeholders understood, engaged with and reinterpreted implementation – a finding that is supported by a previous study of a similar healthcare decision support system [
59].
Again, referring to the framework provided by NPT, we have seen how implementing and using the CDSS required collective purposive action. In 999 call-handlers used the CDSS in the management, categorisation and prioritisation of emergency calls and it was viewed positively despite the apparent
intensification of their work. In SPA the CDSS facilitated the management of urgent care calls, sorting by urgency and enabling referral to services and/or the giving of health advice but it also
extended this work beyond that done in 999; calls were longer and required more probing questions. In OOH the CDSS managed calls to out-of-hours care and face-to-face attendees at an Urgent Care Centre and here their work was extended and had become more
scripted. Earlier studies of call centre operators – largely in non-healthcare settings - identified similar features and noted the demanding nature of call centre work, but this research has tended to focus on issues of management and surveillance (see for example [
60,
61]) rather than implementation. For the purposes of understanding implementation what is important is that deployment of this CDSS and embedding it in practice, changed the work and the workers in each setting. Call-handling used expertise based on discretion, negotiation and translation skills and required emotional labour. The skills created and sustained by introducing the CDSS included experiential, embodied and clinical expertise, and in turn this work offered an identity as ‘health workers’ and not as generic call centre operatives. This identity appears key to the recruitment and retention of these staff [
62]. Deployment of the CDSS also disrupted some existing divisions of labour and hierarchies, for example, at 999 and SPA a new role – clinical supervisor – was introduced.
Although similar monitoring, appraisal and adaptation mechanisms keep the CDSS in place across the three settings, there were once again, differences in how these mechanisms were operationalised. For example the formal audit processes were undertaken differently in OOH, where the processes were more covert and focussed on identifying poor practice, compared with 999 and SPA where audit was seen more as a positive learning tool. Successful deployment of the CDSS entailed significant and long-term involvement from the developers including the need to adapt the system for each setting. One of the questions for further roll out of the CDSS will be how much this input can be reduced to implement the system at scale. It is worth noting that all three sites devoted considerable additional staff resources to support call-handlers, including clinical supervision (999 and SPA only) and audit and training staff.