Preventable trauma deaths: from panel review to population based-studies

Increasing expectancy of health care provided by public or private institutions have promoted a number of programs under the generic title of quality assessment. In recent years these programs have been increasingly directed toward optimization of care based on accepted standards with an attention to costs containment. Emergency trauma care has not been excluded from this process of evaluation. Initially, during the 1960s and 1970s it became apparent, for many reasons, that trauma care in the North America was suboptimal and even inadequate. On the basis of this collective feeling, many surgeons decided that they should evaluate quality of care and translate it into health policy changes.

In the classic description trauma deaths have a tri-modal distribution [1, 2]. Immediate deaths occur immediately after trauma and are due to non-salvageable injuries like rupture of the heart or great vessels. Early deaths occur during the first six hours and are due to evolving conditions like hemorrhagic injuries of abdominal organs or expanding intracranial mass lesions. Late deaths occur after days or weeks and are due to sepsis and multiple organ failure. Early deaths are commonly considered preventable because they may be avoided if injuries are promptly identified and treated. Therefore, surgeons turned to the traditional mortality and morbidity methodology, frequently used in modern teaching to critically analyze failures of care, with particular attention to deaths of the second peak. Reviews of hospital charts by panel of experts, comparison of observed survival with probability of survival obtained from national registries, and population-based epidemiological studies are the three models which have been used during the past twenty years for quality assessment of trauma care. Following paragraphs summarize methodological aspects and results of various preventable trauma deaths studies.

The preventable death rate (PDR) is the proportion of deaths judged to be preventable if optimal trauma care has been delivered. A trauma death defined as preventable needs to meet three criteria: 1. the injuries produced by trauma and its sequelae must be survivable, 2. the care which has been delivered must be suboptimal when compared with standards, 3. the identified errors in the delivery of care have directly or indirectly contributed to patient outcome [3]. The methodology used to establish PDR of a given population has been at the beginning the review of charts (usually autopsy studies) by one or two independent personalities. These early studies were criticized because of subjectivity based in many instances on the judgment of a single reviewer of autopsy reports, while hospital administrators and doctors were reluctant to have their charts analyzed. Subsequently, outcomes of trauma care and performance of emergency organizations were reviewed by multidisciplinary panels of experts with a larger effort to introduce more explicit criteria of judgment. The most used method has been to examine the relationship between deaths and appropriateness of delivered care, when compared to given standards. Table 1 shows the most used standards to evaluate adequacy of trauma care. Traditionally, evaluation of preventability of a trauma death has been translated into three categories[4]:

a. the non-preventable death (NP), when injuries are not survivable and not currently curable or reversible. Any patient dead with at least one injury scored 6 at the abbreviated injury scale (AIS) [5], like a rupture of the heart or a crash injury of the head, belongs to this category.

Critical to the reliability of these studies is the case mix of the study population, the information available for review, the composition of panel and process used to make final judgment.

Ideally, all trauma deaths occurred in a definite geographical region should be considered because magnitude of PDR may be influenced by a selected case population.

Bias may also derive from the amount of available data: pre-hospital reports, hospital records and autopsy study should be all considered for consultation (compared to clinical records autopsy reports often describe more severe injuries thus decreasing preventability).

Composition of the panel may influence results of the discussion: trauma or general surgeon, orthopaedic surgeon, neurosurgeon, anaesthesiologist, emergency physician, epidemiologist, pathologist, nurses, have been usually included in panels to provide the range of clinical expertise necessary to evaluate all the aspects of patient care.

Regarding the process of evaluation, four types of judgment methods have been followed in various studies[6]:

Methods 1 and 4 are more conservative and provide an estimate of the lower bound of PDR. Methods 2 and 3 allow a panel discussion where panelists influence each other increasing the number of deaths judged to be preventable and providing the upper bound of PDR. Analysis of reliability of panel studies includes evaluation of agreement between single panelists and between different panels. Kappa-type statistics [7] have been used to assess the amount of agreement with k=1 when there is complete agreement and k=0 when agreement is only by chance. Agreement in published studies was extremely variable, being higher for non central nervous system deaths and for DP deaths, but generally not exceeding the 50%. In general, physicians agreed about the nature of inadequacy of care (i.e. delay in diagnosis, delay in surgery), but disagreement concerned the extent to which inadequacy of care contributed to death.

Owing to these limitations and because of subjectivity involved in the methodology, panel studies represent structured case series studies and are classified as Class III evidence [8]. Table 2 shows the most important published studies about preventable trauma deaths. These investigations, when properly designed using predefined standards of care which are compared with delivered treatment, may generate information regarding the compliance of the system under study with the generally accepted principles of appropriateness of trauma care [9]. In general, panel studies evaluated a number of deaths from 42 to 255, showing a PDR from 35% to 45% in absence of organized trauma care with a reduction to 15%–20% after trauma system and trauma center implementation [9‐15]. Two italian studies in different urban areas without an organized trauma care showed respectively a PDR of 37% and 43%[9, 15]. Errors and delays during the first phases of in-hospital assessment and care were identified in these researches as the main failures of treatment.

Other studies compare observed survival with expected probability of survival derived from large specialized registries. The popular TRISS method calculates probability of survival (Ps) of a trauma patient from anatomy of injury scored with Injury Severity Score (ISS), physiologic severity at admission described by Revised Trauma Score (RTS), age and mechanism of trauma, as described in fig. 1. Coefficients B0-B3 are derived from Major Trauma Outcome Study, a registry of several thousands of trauma patients used to generate predicted adult death rates[16, 17]. The use of TRISS formula removes subjectivity in the calculation of Ps and it has been suggested [13] to consider DP the deaths occurred with a Ps higher than 0.50 and PP the deaths occurred with a Ps between 0.50 and 0.25. Deaths in patients with a calculated Ps less than 0.25 have to be considered NP.

It is possible to obtain a graphic representation of DP, PP and NP deaths (fig. 1): patients who die with not severe injuries (low ISS and high RTS), are easily identified in the lower-left part of the panel and these unexpected deaths may be analyzed by experts in a quality assessment program [18‐22]. In general, these studies show an increased observed survival, compared with TRISS calculated Ps, after the organization of trauma systems and trauma centers. A limitation of this method may be inadequate coding of ISS and RTS and underestimation of concomitant chronic diseases. Moreover, the collection of data for MTOS (which ages more than 15 years) is not population-based and the norms derived reflect the standards of trauma centers that voluntary participated to that study and not international norms. Because of these considerations also registry comparison studies are classified as Class III evidence [23].

Earliest trauma systems analyses were limited to seriously injured patients treated in trauma centers who constitute only 15–20% of the population of injured patients treated in the hospitals of a nation. From the end of last century there was a call for trauma systems to be inclusive. Inclusive trauma systems intend to benefit all injured patients requiring hospital treatment and the benefit should start in the pre-hospital care, should continue during hospital care and should conclude with the phase of recovery and rehabilitation [24]. The wide scope of an expected benefit to all the population in terms of decreased preventable deaths suggests the need of studies based on representative samples of all patients in a region. Population-based studies include data derived from all injured patients of a country, those who die before hospital arrival, those hospitalized in trauma centers and non-trauma centers and those treated in rehabilitation centers. These studies use representative databases such as death certificates, police reports data, state registry of fatalities after motor vehicle collisions, hospital discharge data with injuries identified by International Classification of Diseases, Ninth Edition, Clinical Modification (ICD-9-CM). These databases differ from trauma registries in several ways. Trauma registries contain greater detailed information but this is offset by the limitation of including only most serious patients treated at trauma centers and only after the implementation of trauma systems. On the contrary, population based data have been recorded for years, contain readily available, alphanumerical-coded information and allow low-cost analyses[25].

For example, in table 3 the incidence rate of trauma deaths in Italy during 2002 calculated from death certificates (which are required by law for all decedents) is summarized. All national deaths due to intended or unintended injury are included and these numbers may be easily used for epidemiologic studies comparing regions with and without implemented trauma systems or periods before and after system implementation. Trauma death in Italy has an incidence rate 35.3 × 100,000 inhabitants/year (total: 20,332). Hospital trauma deaths from discharge registry (table 4) are 17.1 × 100,000 (total: 9,871): therefore, more than 50% of trauma deaths in Italy occur before hospital arrival. Trauma death incidence rate in the San Diego County, which has a mature trauma system, is 24.0 × 100,000 inhabitants/year and pre-hospital deaths are 40.5%[26]. It is possible to emphasize that more than 10 × 100,000 inhabitants of Italian trauma deaths could be prevented especially during pre-hospital care with the implementation of an organized trauma system.

Bias associated with the use of existing databases are those derived from using data which have been recorded for alternate purposes. In hospitals discharge databases only five or six injuries and procedures are coded and sequenced using ICD-9-CM, to provide maximal payment in the Disease-Related Groups model[27]. Stratification of severity of injury may be accomplished by conversion of ICD-9-CM codes into Abbreviated Injury Scale codes, using appropriate conversion programs[28].

Because of these limitations all these studies are classified as providing "high end" Class III evidence[24]. However, owing to the large sample size and the almost complete sample capture, population-based studies provide the strongest evidence regarding the effects of trauma systems and trauma centers on patient outcomes. Magnitude of benefit after trauma system implementation is an approximately 15% to 20% reduction in preventable trauma deaths, especially among patients with more serious injuries[29‐34]. Recently [35], using hospital discharge registries of 69 hospitals of United States, it has been confirmed that risk of death for severe trauma is significantly lower when care is provided in a trauma center than in a non-trauma center.

Trauma care is a serious, ubiquitous, and expensive health care problem for our society. Nowadays, funding for trauma is still low, especially in some European countries, when compared with other fields of medical research. A death following a traumatic event, as a car accident or a fall at work, is often perceived by population as an unavoidable fatality. Preventable death studies, using panel reviews, registry comparisons, or population-based registries, have uniformly and clearly demonstrated a significant decline in PDR after implementation of trauma systems organized on a regional base. Because of bias of various methodologies none of these researches has provided class I or class II evidence in support of trauma systems. But we should not apologize: preventable death studies are the best available methodology that we have in this field: they have been useful to create the collective conscience how to learn from our mistakes and have given impulse to the development of many organized trauma systems.