Original ArticleDiagnosis-dependent misclassification of infections using administrative data variably affected incidence and mortality estimates in ICU patients
Introduction
Evaluations of health care delivery and effective planning of clinical trials in intensive care require nationwide estimates of incidence rates and diagnosis-specific mortality. Specialized national databases of intensive care unit (ICU) patients exist, but this is a costly and labor-intensive method for these purposes. An alternative, low-cost approach would be to use readily available administrative databases to extract information required to calculate incidence rates and diagnosis-specific mortality. However, detailed knowledge of the nature and size of diagnosis misclassification is imperative for correct design and interpretation of such studies.
The accuracy of diagnoses in administrative databases has been found to be highly variable, and depend on the diagnosis and clinical setting, as well as the method used for evaluation [1], [2], [3], [4], [5], [6]. Severe infections are major issues in intensive care research but may be difficult to study using available sources of administrative data. Sepsis and pneumonia may be primary diagnoses, or they may be secondary complications of the patient's main condition. A previous study of the accuracy of hospital discharge diagnosis of sepsis for the identification of bacteremia in a general hospital population showed an excessively high degree of misclassification [7], whereas another study found high accuracy in identifying patients with meningococcal disease from two nationwide registers [8]. Different strategies can be applied to increase the accuracy of case definitions. Adjusting restrictions in the sample definition [9] or adding secondary data sources [5], [10] can improve the accuracy. It is also essential that patient transfer between departments and hospitals can be traced to avoid overestimation of disease frequency [11].
One way of increasing the accuracy of data from a national hospital discharge register (HDR) would be to study a defined subpopulation of patients, such as ICU patients. These patients most often suffer from dramatic and life-threatening diseases or complicating events, which are likely to be obvious to the person who is responsible for coding hospital discharge diagnoses. This restriction might increase accuracy, but it also reduces the external validity as compared to a population-based approach.
The aim of this investigation was to estimate the accuracy of a national HDR in identifying severe infections among intensive care patients, and to evaluate the influence of the source of diagnosis on estimates of 1-year mortality and incidence proportion.
Section snippets
Methods
The study was approved by the Human Ethics Committee of Uppsala University Hospital.
Infections of the CNS
Fifty admissions (0.7%) had an ICU diagnosis of CNS infection and 49 (98%) of these had a CNS infection as the main diagnosis. The HDR tended to overestimate the incidence proportion (Table 1). The overall accuracy in identifying these patients was very high (Table 2) and was not significantly improved (P = 0.07) by restricting the case definition to only the main diagnosis in the HDR.
Incidence proportion and mortality
Three hundred and sixty-five admissions (4.8%) had an ICU diagnosis of sepsis and 285 of these cases (78%) had
Discussion
The accuracy of hospital discharge diagnoses in identifying ICU patients with severe infections was found to depend on the diagnosis and case definition used. CNS infections were identified with very high accuracy, whereas sepsis and pneumonia were more difficult to capture. Positive likelihood ratios generally indicated acceptable accuracy, which could be enhanced by more restrictive case definitions, but often at the cost of substantial reductions in sensitivity and increased negative
Acknowledgment
The project was supported by a grant from the Department of Surgical Sciences at Uppsala University Hospital. The authors are also grateful for statistical advice from Biostatistician Johan Lindbäck at the Uppsala Clinical Research Center, Uppsala University Hospital.
References (32)
- et al.
International Classification of Diseases-9th revision coding for preeclampsia: how accurate is it?
Am J Obstet Gynecol
(2004) - et al.
The validity of the diagnosis of acute myocardial infarction in routine statistics: a comparison of mortality and hospital discharge data with the Danish MONICA registry
J Clin Epidemiol
(2003) - et al.
Local and national electronic databases in Norway demonstrate a varying degree of validity
J Clin Epidemiol
(2005) - et al.
Likelihood ratios with confidence: sample size estimation for diagnostic test studies
J Clin Epidemiol
(1991) - et al.
Prognosis factors and outcome of community-acquired pneumonia needing mechanical ventilation
J Crit Care
(2005) - et al.
Inclusion criteria for clinical trials in sepsis: did the American College of Chest Physicians/Society of Critical Care Medicine consensus conference definitions of sepsis have an impact?
Chest
(2005) - et al.
Refining clinical diagnosis with likelihood ratios
Lancet
(2005) - et al.
A systematic review of discharge coding accuracy
J Public Health Med
(2001) - et al.
Quality of data regarding diagnoses of spinal disorders in administrative databases. A multicenter study
J Bone Joint Surg Am
(1997) - et al.
A novel method for the assessment of the accuracy of diagnostic codes in general surgery
Ann R Coll Surg Engl
(1998)
A framework for evaluation of secondary data sources for epidemiological research
Int J Epidemiol
Can hospital discharge diagnosis be used for surveillance of bacteremia? A data quality study of a Danish hospital discharge registry
Infect Control Hosp Epidemiol
Identification of cases of meningococcal disease: data quality in two Danish population-based information systems during a 14-year period
Int J Risk Saf Med
Evaluating the role of patient sample definitions for quality indicators sensitive to nurse staffing patterns
Med Care
Validation study of the Victorian Birth Defects Register
J Paediatr Child Health
Comparing two diagnostic tests against the same “gold standard” in the same sample
Biometrics
Cited by (66)
Infectious and sepsis presentations to, and hospital admissions from emergency departments in Victoria, Australia
2024, EMA - Emergency Medicine AustralasiaRisk of infections in non-alcoholic fatty liver disease: A nationwide population-based cohort study
2023, Liver InternationalAdoption and Trends in Uptake of Updated ICD-10 Codes for Clostridioides difficile - A Retrospective Observational Study
2022, Open Forum Infectious DiseasesCeliac Disease and Serious Infections: A Nationwide Cohort Study From 2002 to 2017
2022, American Journal of Gastroenterology