Skip to main content
Erschienen in: Canadian Journal of Anesthesia/Journal canadien d'anesthésie 9/2012

Open Access 01.09.2012 | Reports of Original Investigations

Artifacts in research data obtained from an anesthesia information and management system

verfasst von: Nathalie P. Kool, MD, Judith A. R. van Waes, MD, Jilles B. Bijker, MD, Linda M. Peelen, PhD, Leo van Wolfswinkel, MD, PhD, Jurgen C. de Graaff, MD, PhD, Wilton A. van Klei, MD, PhD

Erschienen in: Canadian Journal of Anesthesia/Journal canadien d'anesthésie | Ausgabe 9/2012

download
DOWNLOAD
print
DRUCKEN
insite
SUCHEN

Abstract

Purpose

Artifacts in anesthesia information management system (AIMS) databases may influence research results. Filtering during data capturing can prevent artifacts from being stored. In this prospective study, we assessed the reliability of AIMS data by determining the incidence of artifactual values stored in the AIMS.

Methods

Vital parameter values regarding 86 surgical patients were collected in the AIMS both manually and automatically after filtering using the median value per minute. The percentage of artifactual values with a 95% confidence interval (CI) was calculated for each parameter. Secondary outcomes included the number of values that deviated from a predefined baseline, the percentage of these deviations that were caused by artifacts, the number of episodes across which these artifacts were distributed, and the most common causes of artifacts.

Results

Altogether, 9,534 min of anesthesia time were recorded. The overall percentages of artifacts were: 0.0 for heart rate (95% CI: 0.0 to 0.1), 0.3 for oxygen saturation (95% CI: 0.2 to 0.4), 4.7 for ST-segment (95% CI: 4.3 to 5.2), 2.3 for noninvasive blood pressure values (95% CI: 1.8 to 2.9), and 14 for invasive blood pressure values (95% CI: 12 to 15). Artifacts as a percentage of deviations from baseline were: 1.6 for heart rate (95% CI: 0.4 to 5.7), 24 for saturation (95% CI: 18 to 32), 83 for ST-segment (95% CI: 76 to 87), 3.3 for noninvasive blood pressure values (95% CI: 2.5 to 87), and 27 for invasive blood pressure values (95% CI: 24 to 31).

Conclusions

Storing a median value per minute to filter capturing of vital parameter values in an AIMS database provides reliable data for heart rate and oxygen saturation and acceptable reliability for noninvasive blood pressure data. Knowledge about the method of artifact filtering is essential in studies using AIMS data.
Hinweise
Author contributions Wilton A. van Klei designed and supervised the study. Nathalie P. Kool, Judith A.R. van Waes and Jilles B. Bijker were responsible for manual data collection in the operating room, for data analysis, and for drafting the manuscript. Leo van Wolfswinkel was responsible for automated data collection and management in the record keeping system. All authors contributed to the interpretation of the results and to the revision of the manuscript for important intellectual content.
This work was presented in part at the 2011 Annual Meeting of the International Anesthesia Research Society, Vancouver, BC, Canada, May 22, 2011.
This article is accompanied by an editorial. Please see Can J Anesth 2012; 59(9).
Anesthesia information and management systems (AIMS) are increasingly being adopted in anesthesia practice. Such automated patient records are considered superior to handwritten records as they are less time-consuming and retain comparable or higher accuracy.1-5 An AIMS is not only useful as an instrument to enhance anesthesia record-keeping or support clinical decisions, but it can also be useful as a resource to answer clinical research questions, and in particular to generate hypotheses for further research.6-13
Although the quality of data capturing and storage in the AIMS database is considered highly accurate, not all stored values are necessarily based on reliable measurements. In retrieving data from the monitoring systems, an AIMS cannot determine whether a certain value is a “true” value or an artifact that occurred while measuring the value (e.g., false low oxygen saturation caused by a dislocated pulse oximeter). Consequently, when using the data for research purposes, it may be difficult or even impossible to distinguish between true values and artifacts. Obviously, artifacts may influence research results. If the occurrence rate of artifacts is high, research results based on AIMS data may be unreliable estimates. Moreover, artifacts may introduce bias if certain artifacts are associated exclusively with certain procedures. To prevent the AIMS from storing artifacts as true values, intelligent filtering can be applied during data capturing. Still, this does not completely prevent artifacts from being stored as “real” values.
The incidence of artifacts in AIMS databases and the procedure or time-specific associations of artifacts which may influence research results are yet undetermined. In this study, we assessed the reliability of AIMS data for research purposes by estimating prospectively the occurrence rate of artifacts in the vital parameter values recorded in our AIMS database. Moreover, we recorded the causes of artifactual measures stored in the AIMS.

Methods

This prospective observational study included 86 adult patients who underwent ear-nose-throat (ENT), general, or neurosurgery requiring general anesthesia. The numbers of each type of procedure were allocated to approximate an even distribution of anesthesia time over the three types of surgery. All procedures were performed in a tertiary referral centre (University Medical Center, Utrecht, The Netherlands) within a six-week period in 2010. The need for written informed consent was waived by the Medical Research Ethics Committee of the University Medical Center, Utrecht (final approval October 5th, 2010). According to requirements of Dutch law, the anonymity and confidentiality of routinely collected clinical data were assured.
All patients were monitored by a Datex Ohmeda S/5™ monitoring system (GE Healthcare, Waukesha, WI, USA) that has a built-in filter for artifacts. The heart rate (HR) displayed on the monitor is derived from the electrocardiogram (ECG), the plethysmogram, or the invasive blood pressure (IBP) curve, and it is updated every five seconds by calculating the mean HR over the last ten seconds. The oxygen saturation is derived from the plethysmogram and displayed beat-to-beat. After the monitoring system automatically determines the J-point in the electrocardiogram, the ST-segment deviation (elevation or depression in millimetres) is updated every five seconds by calculating the mean ST-segment over the last eight QRS complexes. The noninvasive blood pressure (NIBP) is displayed each time it is measured, and the IBP curve is displayed beat-to-beat.
Values from the Datex monitoring system are stored automatically in a locally developed AIMS (Vierkleurenpen©, version 1.4.5, 2010) that samples data from the monitoring system every five seconds. In order to prevent the monitoring system from capturing artifacts, data are recorded in the database and displayed every minute, but only after a filter is applied. This means that the median value per minute is calculated and stored for HR, saturation, ST-segment, and IBP (systolic, diastolic, and mean), while the NIBP (systolic, diastolic, and mean) is recorded every time it is measured (no filtering). Storing the median value per minute was considered an effective method to prevent the AIMS from storing the majority of the artifacts caused, for example, by positioning the patient or electrocautery. Such artifacts are usually short in duration and thus seldom influence the median value of the twelve values captured per minute.
All data for HR, ST-segment, oxygen saturation, NIBP, and IBP were collected automatically by the institutional AIMS system and then collected manually in the operating room by the first author who was present for all procedures reported in this investigation and attended to the monitor as well as the values stored in the AIMS. We included three surgical types (ENT, general, and neurosurgical) in our study since artifacts are thought to be influenced by the type and location of surgery.
Data were collected from the time the monitoring system was connected to the patient until the monitor was disconnected. All data stored in the AIMS (i.e., those values displayed on screen) were evaluated as either reliable values or possible artifacts. An artifact was defined as any value that did not reflect the patient’s current physiologic state, as defined below.

Definition of an artifact

We defined an artifact a priori as one or all of the following:
1.
For purposes of this investigation, an artifact was defined as any value deviating outside a biologically plausible range (see Table 1). A fixed plausible range was used for HR and oxygen saturation. For the ST-segment, NIBP, and IBP, an individual baseline value was calculated immediately after induction of anesthesia, using all values before induction. The average (NIBP / IBP) or median (ST-segment) of these values was then defined as the normal range.
Table 1
Definition of baseline and deviating values
Variable
Baseline
Deviating value
HR
Not applicable
>100 beats·min−1 or < 40 beats·min−1
Oxygen Saturation
Not applicable
< 95%
ST-segment
Median of values before induction
>1 mm above or below baseline
Systolic NIBP
Mean of values before induction
< 80 mmHg or >180 mmHg or
> 30% above or below baseline
IBP
Mean of values before induction
< 80 mmHg or >180 mmHg, or
or mean of NIBP values before induction
> 30% above or below baseline
HR = heart rate; NIBP = noninvasive blood pressure; IBP = invasive blood pressure
 
2.
A value of NIBP or IBP was considered a possible artifact if it deviated ≥ 30% from the preceding value (Table 1).
 
3.
A value was considered an artifact, even if it was within a previously defined “normal” range, when it was clearly observed as being unreliable based on the investigator’s consultation with the anesthesiologist regarding observations in the operating room (e.g., if the surgeon leaned on the NIBP cuff).
 
A value that was considered a possible artifact was verified with the attending anesthesiologist or anesthetic nurse as to whether it reflected the patient’s physiologic state. Values considered artifacts were manually recorded together with their causes. The investigation only considered data that were stored in the AIMS, therefore, data filtered by the Datex monitoring system (e.g., electrocautery filtering) were not considered.
For purposes of this investigation, we expressed the number of artifacts for each parameter as a percentage of the total number of observations with the respective 95% confidence interval (CI). An episode was defined as a period of deviation that included one or more consecutive artifacts. The number of artifacts and deviating values per episode were calculated and expressed as medians with an interquartile range. In addition, frequencies of the different causes for artifacts were counted.

Outcome

The primary outcome was the percentage of artifacts for each of the included parameters with a 95% CI. Secondary outcomes included the number of values deviating from the predefined baseline value and the percentage of these deviations being caused by artifacts. In addition, we reported the number of episodes across which these values and artifacts were distributed. Finally, we determined the most common causes of artifactual values.

Analysis and statistics

To estimate the percentage of artifacts in the AIMS database, we performed a sample size calculation to determine the minimum number of values to include in the study. In this calculation, we assumed a maximum 4% incidence of artifacts, and we wanted to rule out a > 5% incidence with 95% certainty, implying that the width of the 95% CI should be a maximum 1% on each side. Furthermore, we assumed that the probability that each stored value was an artifact was independent of the occurrence of any other artifact, i.e., artifacts within patients were independent.
As the NIBP is the measurement performed least frequently, the sample size calculation was based on the assumption that 4% of the stored NIBP values would be an artifact. The further assumptions that the NIBP was being measured at least every five minutes and a 95% CI would not exceed 5% led to a required minimum of 1,850 NIBP measurements or 9,250 min (1,850 x 5 min) of “anesthesia time”.

Results

Eighty-six patients were included in the study over a period of 9,534 min of anesthesia time. Heart rate, ST-segment, oxygen saturation, and NIBP were measured in all patients; IBP was measured in 12 patients. Baseline characteristics are shown in Table 2. The mean (standard deviation; SD) age was 55.1 (17.9) yr with differences between specialties: ENT: 60.8 (16.9) yr; general surgery: 52.2 (17.6) yr; and neurosurgery: 49.7 (17.8) yr.
Table 2
Baseline characteristics
 
All patients, n = 86
Anesthesia time per procedure (minutes)
(mean (SD); range)
Mean age (SD)
55.1 (17.8)
 
Male sex
51 (59%)
 
Surgery type
 ENT (endoscopic)
22 (26%)
43 (13); 22-68
 ENT (other)
13 (15%)
86 (49); 24-175
 General (trauma)
11 (13%)
132 (31); 71-182
 General (abdominal)
10 (12%)
82 (65); 39-234
 General (other)
8 (9%)
124 (50); 26-163
 Neurosurgery (intracranial)
14 (16%)
210 (103); 65-452
 Neurosurgery (other)
8 (9%)
112 (61); 66-215
SD = standard deviation; ENT = ear, nose, and throat. Baseline characteristics of the research population are given as well as the length of anesthesia time for each type of surgical procedure
The number of values stored during the 9,534 min were: HR 9,442, oxygen saturation 9,415, ST-segment 9,026, and NIBP 2,754 (Table 3). Table 3 also provides stratification by specialty and the number of episodes over which the deviating values and artifacts were distributed. Overall, the percentage of artifacts was 0.0 for HR (95% CI: 0.0 to 0.1), 0.3 for oxygen saturation (95% CI: 0.2 to 0.5), 4.7 for ST-segment (95% CI: 4.3 to 5.2), 2.3 for NIBP (95% CI: 1.8 to 2.9) and 14 for IBP values (95% CI: 12 to 15).
Table 3
Results of analysis performed on all values during anesthesia
 
Variable
Observed Anesthesia time (min)
Number of values
Number of deviating values (%)
Number of episodes containing deviating values
Number of artifacts
Number of episodes containing artifacts
% of values being artifacts (95% CI)
% of deviating values being artifacts (95% CI)
Total
HR
9,534
9,442
125 (1.3)
40
2
1
0.0 (0.0 to 0.1)
1.6 (0.4 to 5.7)
Sat
 
9,415
128 (1.4)
47
31
20
0.3 (0.2 to 0.5)
24.2 (17.6 to 32.3)
ST
 
9,026
188 (2.1)
51
426
16
4.7 (4.3 to 5.2)
82.5 (76.4 to 87.2)
NIBP
 
2,754
1,335 (48.5)
252
62
26
2.3 (1.8 to 2.9)
3.3 (2.5 to 87.2)
IBP
2,748
2,469
615 (24.9)
57
333
23
13.5 (12.2 to 14.9)
27.0 (23.6 to 30.6)
ENT surgery
HR
2,241
2,205
17 (0.8)
10
2
1
0.1 (0.0 to 0.3)
11.8 (3.3 to 34.3)
Sat
 
2,201
35 (1.6)
11
12
7
0.6 (0.3 to 1.0)
34.3 (20.8 to 50.9)
ST
 
2,145
51 (2.4)
14
48
6
2.2 (1.7 to 3.0)
72.6 (59.1 to 82.9)
NIBP
 
884
441 (49.9)
93
2
2
0.2 (0.1 to 0.8)
0.5 (0.1 to 1.6)
IBP
0
0
-
-
-
-
-
-
General surgery
HR
3,427
3,421
96 (2.8)
23
0
0
0 (0.0 to 0.1)
0 (0.0 to 3.9)
Sat
 
3,411
68 (2.0)
25
14
9
0.4 (0.2 to 0.7)
20.6 (12.7 to 31.6)
ST
 
3,262
67 (2.1)
23
303
6
9.3 (8.3 to 10.3)
100 (94.6 to 100)
NIBP
 
1,116
560 (50.2)
111
51
22
4.6 (3.5 to 6.0)
6.4 (4.7 to 8.8)
IBP
432
309
191 (61.8)
20
105
5
34.0 (28.9 to 39.4)
44.0 (37.1 to 51.1)
Neuro-surgery
HR
3,866
3,816
12 (0.3)
7
0
0
0 (0.0 to 0.1)
0 (0.0 to 24.3)
Sat
 
3,803
25 (0.7)
11
5
4
0.1 (0.1 to 0.3)
20.0 (8.9 to 39.1)
ST
 
3,619
70 (1.9)
14
75
4
2.1 (1.7 to 2.6)
72.9 (61.5 to 81.9)
NIBP
 
754
334 (44.3)
48
9
2
1.2 (0.6 to 2.3)
1.8 (0.8 to 3.9)
IBP
2,316
2,160
424 (19.6)
37
228
18
10.6 (9.3 to 11.9)
19.3 (15.9 to 23.4)
CI = confidence interval; ENT = ear, nose, and throat; HR = heart rate; Sat = oxygen saturation; ST = ST-segment; NIBP = noninvasive blood pressure; IBP = invasive blood pressure. Anesthesia time represents the cumulative number of minutes the patients were under anesthesia. HR, Sat, ST, and NIBP have the same anesthesia times; IBP anesthesia time however is lower, because IBP was only measured in 12 cases. The number of values in HR, Sat, and ST differ slightly from the anesthesia time, although these parameters are calculated and stored every minute. This difference is caused by some missing parameters in the anesthesia information management system database, for example, caused by displacement of the pulse oximeter. The number of NIBP values is lower than the anesthesia time because it was generally measured with intervals of 2.5 or five minutes. The percentage of deviating values represents the percentage of the total amount of values
Artifacts as a percentage of total deviations represented 1.6 for HR (95% CI: 0.4 to 5.7), 24 for oxygen saturation (95% CI: 18 to 32), 83 for ST-segment (95% CI: 76 to 87), 3.3 for NIBP (95% CI: 2.5 to 87), and 27 for IBP values (95% CI: 24 to 31), as shown in the last column of Table 3.
We found that many of the artifacts occurred before incision and after surgical closing. Since these periods are known to be times of extreme variability, a sensitivity analysis was performed to exclude these specific periods (Table 4). The results for HR, oxygen saturation, ST-segment, and NIBP were minimally affected compared with the overall analysis. However, the incidence of artifacts and deviations in IBP was decreased from 14% to 3.9% and from 27% to 4.4%, respectively (Table 4). Furthermore, we found that relocation of the ECG electrodes was a major cause of ST-segment artifacts, occurring in only four patients undergoing procedures in the thoracic region or in procedures requiring the patient to be placed in a prone position (three general surgery patients and one neurosurgery patient). An additional analysis excluding these patients resulted in a decrease in the incidence of ST-segment values being artifacts to 0.8% (95% CI: 0.7 to 1.1) and a decrease in the incidence of deviating ST-segment values being artifacts to 61% (95% CI: 51 to 71).
Table 4
Results of sensitivity analysis performed on values between surgical incision and closure
 
Variable
Observed Surgery time (min)
Number of values
Number of deviating values (%)
Number of episodes containing deviating measure-ments
Number of artifacts
Number of episodes containing artifacts
% of values being artifacts (95% CI)
% of deviating values being artifacts (95% CI)
Total
HR
6,201
6,137
47
13
2
1
0.0 (0.0 to 0.1)
4.2 (1.2 to 14.3)
Sat
 
6,118
52
13
10
4
0.2 (0.1 to 0.3)
19.2 (10.8 to 31.9)
ST
 
6,027
131
42
304
10
5.0 (4.5 to 5.6)
77.1 (69.2 to 83.5)
NIBP
 
1,736
814
157
50
21
2.9 (2.2 to 3.8)
4.4 (3.1 to 6.1)
IBP
 
1,785
337
31
69
6
3.9 (3.1 to 4.9)
13.9 (10.7 to 18.1)
ENT surgery
HR
1,451
1,419
7
4
2
1
0.1 (0.0 to 0.5)
28.6 (8.2 to 64.1)
Sat
 
1,401
20
2
2
1
0.1 (0.0 to 0.5)
10.0 (2.8 to 30.1)
ST
 
1,340
34
9
27
3
2.0 (1.4 to 2.9)
67.6 (50.8 to 80.9)
NIBP
 
578
294
66
2
2
0.3 (0.1 to 1.3)
0.7 (0.2 to 2.5)
IBP
-
-
-
-
-
-
-
-
General surgery
HR
2,198
2,198
39
8
0
0
0.0 (0.0 to 0.2)
0.0 (0.0 to 9.0)
Sat
 
2,196
29
9
7
2
0.3 (0.1 to 0.7)
24.1 (12.2 to 42.1)
ST
 
2,188
52
20
230
4
10.5 (9.3 to 11.9)
100 (93.1 to 100)
NIBP
 
704
343
82
39
17
5.5 (4.1 to 7.5)
0.5 (5.7 to 11.6)
IBP
 
201
109
10
43
3
21.4 (16.3 to 27.6)
34.9 (26.6 to 44.2)
Neuro-surgery
HR
2,552
2,520
1
1
0
0
0.0 (0.0 to 0.2)
0.0 (0.0 to 79.4)
Sat
 
2,521
3
2
1
1
0.0 (0.0 to 0.2)
33.3 (6.2 to 79.2)
ST
 
2,499
45
13
47
3
1.9 (1.4 to 2.5)
57.8 (43.3 to 71.0)
NIBP
 
454
177
27
9
2
2.0 (1.1 to 3.7)
3.4 (1.6 to 7.2)
IBP
1,614
1,584
228
21
26
3
1.6 (1.1 to 2.4)
3.9 (2.1 to 7.3)
CI = confidence interval; ENT = ear, nose, and throat; HR = heart rate; Sat = oxygen saturation; ST = ST-segment; NIBP = noninvasive blood pressure; IBP = invasive blood pressure. This table represents the same results as shown in Table 3, but in this case, only measurements performed during the surgical procedure were included, i.e., the time of anesthesia induction and emergence from anesthesia were excluded. Anesthesia time represents the cumulative number of minutes the patients were under anesthesia. HR, Sat, ST, and NIBP have the same anesthesia times; IPB anesthesia time however is lower because IBP was only measured in 12 cases. The number of values in HR, Sat and ST differ slightly from the anesthesia time, although these parameters are calculated and stored every minute. This difference is caused by some missing parameters in the AIMS database, for example, caused by dislocation of the pulse oximeter. The number of NIBP values is lower than the anesthesia time because it was generally measured with intervals of 2.5 or five minutes. The percentage of deviating values represents the percentage of the total amount of values
Table 5 shows the direction of the deviating values (upwards or downwards) and the number of deviations per episode. Overall, 96% of the HR deviations were upwards (tachycardia), and only 2.7% of NIBP deviations were upwards (hypertensive) compared with 25% of the IBP deviations.
Table 5
Direction of deviations and number of deviations per episode
 
Variable
Number of deviations above baseline (%)
Number of deviations below baseline (%)
Number of deviations per episode mean(SD)
Number of artifacts per episode mean(SD)
Total
HR
112 (95.7)
5 (4.3)
3.2 (6.2)
2.0 (n.a.)*
Sat
0 (0.0)
128 (100)
2.7 (3.5)
1.6 (1.3)
ST
153 (84.1)
29 (15.9)
3.7 (5.4)
26.6 (41.4)
NIBP
36 (2.7)
1,292 (97.3)
5.3 (7.3)
2.4 (3.1)
IBP
28 (25.2)
83 (74.8)
10.8 (27.4)
14.5 (11.4)
ENT surgery
HR
9 (100)
0 (0.0)
1.7 (1.1)
2.0 (n.a.)*
Sat
0 (0.0)
35 (100)
3.2 (5.0)
1.7 (1.1)
ST
29 (56.9)
22 (43.1)
3.6 (5.1)
8.0 (9.3)
NIBP
14 (3.2)
427 (96.8)
4.7 (7.3)
1.0 (0.0)
IBP
-
-
-
-
General surgery
HR
92 (94.8)
5 (5.2)
4.2 (8.1)
-
Sat
0 (0.0)
68 (100)
2.7 (3.0)
1.6 (1.7)
ST
59 (96.7)
2 (3.3)
2.9 (3.6)
50.5 (57.4)
NIBP
20 (3.6)
534 (96.4)
5.0 (6.1)
2.3 (3.3)
IBP
2 (3.0)
64 (97.0)
9.6 (10.0)
21.0 (18.9)
Neuro-surgery
HR
11 (100)
0 (0.0)
1.7 (0.8)
-
Sat
0 (0.0)
25 (100)
2.3 (3.3)
1.3 (0.5)
ST
65 (92.9)
5 (7.1)
5.0 (7.7)
18.8 (31.6)
NIBP
2 (0.6)
331 (99.4)
7.0 (9.6)
4.5 (2.1)
IBP
26 (57.8)
19 (42.2)
11.5 (33.3)
12.7 (8.3)
SD = standard deviation; HR = heart rate; Sat = oxygen saturation; ST = ST-segment; NIBP = noninvasive blood pressure; IBP = invasive blood pressure; ENT = ear, nose, and throat
* This contains only one measurement, therefore, no SD can be calculated. Percentages indicate percentage of all deviations in the corresponding group. Number of deviations above baseline is 0 for oxygen saturation, as oxygen saturation cannot exceed 100%. IBP was not measured in ENT surgery patients. No HR artifacts were observed in general surgery and neurosurgery patients
The most common causes for artifacts in oxygen saturation, ST-segment, NIBP, and IBP were dislocation of the pulse oximeter (65%), relocation of ECG electrodes (83%), manipulation of the blood pressure cuff (84%), and relocation of either the IBP sensor or the patient (53%) (Table 6).
Table 6
Causes of artifacts
  
ENT surgery
General surgery
Neurosurgery
Total
HR
Electrocautery
0
0
0
0
Moving/movements of the patient
0
0
0
0
Double counting (P waves or T waves)
2 (100%)
0
0
2 (100%)
Sat
Dislocated pulse oximeter
5 (42%)
13 (93%)
2 (40%)
20 (65%)
Peripheral vasoconstriction
79 (58%)
1 (7%)
3 (60%)
11 (36%)
ST
Electrocautery
0
0
0
0
Moving/movements of the patient
48 (100%)
2 (1%)
8 (11%)
58 (14%)
Relocation of ECG electrodes
0
288 (99%)
66 (88%)
354 (83%)
Unknown
0
0
1 (1%)
14 (3%)
NIBP
Leaning against pressure cuff
1 (50%)
49 (94%)
3 (33%)
52 (84%)
Immeasurable low blood pressure
0
0
0
0
Abnormal positioning of arm (e.g. above the body)
0
0
6 (67%)
6 (10%)
Unknown
1 (50%)
3 (6%)
0
4 (7%)
IBP
Dampened curve
-
48 (46%)
9 (4%)
57 (17%)
Overshoot curve
-
0
0
0
Relocation of pressure sensor
-
55 (52%)
121 (53%)
176 (53%)
Pressure sensor not zeroed
-
2 (2%)
69 (30%)
71 (21%)
Pressure sensor already connected, but patient without arterial line
-
0
28 (12%)
28 (8%)
Flushing of pressure sensor
-
0
1 (0.4%)
1 (0.3%)
HR = heart rate; Sat = oxygen saturation; ST = ST-segment; ECG = electrocardiogram; NIBP = noninvasive blood pressure; IBP = invasive blood pressure; ENT = ear, nose, and throat. Values are number (%) of artifacts. Percentages represent the frequency of an artifact being caused by that situation for that specific specialty and parameter. For example, 58% of the artifacts in saturation during ENT surgery were caused by peripheral vasoconstriction. IBP was not measured during ENT surgery

Discussion

The aim of this study was to assess the reliability of the data in an AIMS database. We determined that the AIMS database provides reliable data for HR and oxygen saturation, whereas NIBP values show an error rate of up to 4.6%. For ST-segment and IBP values, the incidence of artifacts stored as values varied from 2-9% and from 11-34%, respectively, depending on the type of surgery. These results were obtained with application of a static one-minute median filter. As many other types of AIMS database filters exist, results may vary per system. This should be taken into account when using data from an AIMS database.
We chose to analyze records from patients undergoing general, ENT, or neurosurgical procedures. We considered these procedures to contain a substantial and meaningful variety of artifact incidences and respective causes as a consequence of their variations in anatomic localization, surgical approaches, and patient characteristics. This variation was reflected in our results, which show differences in the prevalence of artifacts when comparing the three specialties (Tables 3 and 4). Overall, we consider the incidence rate of artifacts in HR, oxygen saturation, ST-segment, and NIBP to be an acceptable error rate in an AIMS, hence, our opinion is that data regarding these parameters derived from an AIMS can be used for research purposes. It should be taken into account, though, that approximately 80% of the deviating ST-segment values appeared to be artifacts as well as approximately 25% of the deviating oxygen saturation and IBP values. When we excluded patients whose ECG electrodes were relocated, the overall incidence of ST-segment artifacts was decreased to 0.8%; nevertheless, approximately 60% of the deviating values were artifacts. The objective has to be carefully considered for research using blood pressure values. The IBP may seem more reliable than the NIBP because it is measured more frequently. On the other hand, the IBP contains more artifacts, mainly at the beginning and end of the procedure. However, by including only the period from incision to surgical closing, the percentage of artifactual deviating IBP values can be decreased to 4.4%. The occurrence of artifacts is important to consider when using AIMS data, depending on the goal of a particular study. When evaluating the causes of these artifacts, it seems that the most frequent ones (e.g., relocation of ECG electrodes, leaning against the blood pressure cuff, and relocation and delayed zeroing of the invasive pressure sensor) can easily be avoided.
It is difficult to compare the results from this study with the available literature. Although some studies have compared the number of incidences of artifacts derived from automated records with those derived from manual data entry, the aim of our study was to determine prospectively the number of artifacts stored in an anesthesia information and management system database. Moreover, in previous studies, the incidence was expressed as the number of cases (patients) containing artifacts rather than the number of artifacts that occur in a certain amount of values. Eden et al. 3 primarily investigated the potential of an AIMS and the accuracy of its data entry for 4,429 procedures, and they found that 12% of procedures contained at least one HR artifact and 2% contained at least five. Furthermore, they found that 1.5% of the cases contained at least four extreme values (HR < 20 or > 180 and oxygen saturation < 80%), 60% of which were artifacts. Edsall et al.4 compared manual and computerized anesthesia records with respect to time demands and record quality. They found two artifacts (one in oxygen saturation and one in expiratory carbon dioxide) in the computerized records, but they included only five AIMS-recorded patients. Gostt et al.14 developed an algorithm to annotate pulse oximetry artifacts automatically and tested its accuracy in routine surgical procedures. They designed the algorithm to label all oxygen levels < 90% in 20 surgical patients. Thirteen values < 90% were found, and nine (69%) of these were artifacts.
When looking at the causes of artifacts, Takla et al.15 provided a list of the most common causes for artifacts, but they did not quantify these causes. Görges et al. 16 studied the alarms in a medical intensive care unit and classified these as effective, ineffective, or actively ignored. They showed that the number of ineffective and ignored alarms, which can be interpreted as artifacts, could be decreased if the alarm presentation was delayed by 19 sec. This suggests that the duration of a deviation is important in differentiating between true deviations and artifacts. In our study, we had comparable observations, particularly in ST-segment and IBP measurements (Table 5).
In the present study, values deviating from the normal range were defined in accordance with clinically used definitions of tachy- and bradycardia, hypoxia, ST-elevation and ST-depression, and hypo- and hypertension.13 As such, definitions partially include individual baseline values (i.e., values obtained before induction of anesthesia) with a corresponding normal range; a normal range for each parameter in every individual patient was calculated immediately before surgery. The resulting normal range may not be fully representative of the physiologic state of the patient, since patients can be stressed before undergoing surgery. However, we do not think that this influenced the results because we registered artifactual values that deviated from the individual normal range and values that fell within this normal range. A second limitation is that values considered as being artifacts were not evaluated by a reference test to confirm whether they indeed were artifacts; they were only verified immediately with the attending anesthesiologist or anesthetic nurse. Third, we found a high artifact incidence in IBP values (Table 4); however, this was found in a small subset of the investigation (12 out of 86 patients). Importantly, all of these IBP artifacts occurred during positioning of the patient or during emergence from anesthesia, and in most cases, they were due to relocation of the pressure sensor. In addition, 17% (57 values) of the IBP artifacts were caused by a dampened curve, which can be caused by clotting of the arterial catheter, in which case it is considered an artifact, but it can also be caused by cardiogenic shock. In general, when analyzing IBP data, a post hoc analysis can be performed to determine whether the dampened curve was caused by clotting. This can be achieved by comparing the IBP values with the corresponding NIBP values. However, NIBP is mostly measured infrequently if continuous IBP measurements are in use. Finally, in our sample size calculation, we assumed that the artifacts would occur independently of each other. However, our results show that artifact episodes within a single patient often contained multiple values, especially in the ST-segment and IBP values, suggesting that the occurrence of artifacts is not “independent”. It can therefore be argued that we underestimated the required “anesthesia time” in our sample size calculation. Nevertheless, our sample size calculation was based on the least frequently measured parameter (NIBP) in which most artifacts actually did occur independently (i.e., episodes contained single artifacts).
In conclusion, we found that storing the median value per minute to filter capturing of continuous vital parameter values in an AIMS database provides reliable data for HR and oxygen saturation with artifact rates below 0.5% and provides acceptable reliability for NIBP data with a 2.3% artifact rate. The presence of artifacts should be taken into account in research using vital parameter data from AIMS databases, especially when using IBP values; data should also be checked for reliability. In this study, knowledge about the method of artifact filtering for both the monitoring system and the AIMS is essential, and studies using AIMS data should describe methods of data acquisition, filtering, and storage.

Financial support

Support was provided solely from departmental sources.

Competing interests

None declared.

Open Access

This article is distributed under the terms of the Creative Commons Attribution Noncommercial License which permits any noncommercial use, distribution, and reproduction in any medium, provided the original author(s) and the source are credited.
Open AccessThis is an open access article distributed under the terms of the Creative Commons Attribution Noncommercial License (https://​creativecommons.​org/​licenses/​by-nc/​2.​0), which permits any noncommercial use, distribution, and reproduction in any medium, provided the original author(s) and source are credited.

Unsere Produktempfehlungen

e.Med Interdisziplinär

Kombi-Abonnement

Für Ihren Erfolg in Klinik und Praxis - Die beste Hilfe in Ihrem Arbeitsalltag

Mit e.Med Interdisziplinär erhalten Sie Zugang zu allen CME-Fortbildungen und Fachzeitschriften auf SpringerMedizin.de.

e.Med Anästhesiologie

Kombi-Abonnement

Mit e.Med Anästhesiologie erhalten Sie Zugang zu CME-Fortbildungen des Fachgebietes AINS, den Premium-Inhalten der AINS-Fachzeitschriften, inklusive einer gedruckten AINS-Zeitschrift Ihrer Wahl.

Literatur
1.
Zurück zum Zitat Allard J, Dzwonczyk R, Yablok D, Block FE Jr, McDonald JS. Effect of automatic record keeping on vigilance and record keeping time. Br J Anaesth 1995; 74: 619-26.PubMedCrossRef Allard J, Dzwonczyk R, Yablok D, Block FE Jr, McDonald JS. Effect of automatic record keeping on vigilance and record keeping time. Br J Anaesth 1995; 74: 619-26.PubMedCrossRef
2.
Zurück zum Zitat Benson M, Junger A, Quinzio L, et al. Influence of the method of data collection on the documentation of blood-pressure readings with an anesthesia information management system (AIMS). Methods Inf Med 2001; 40: 190-5.PubMed Benson M, Junger A, Quinzio L, et al. Influence of the method of data collection on the documentation of blood-pressure readings with an anesthesia information management system (AIMS). Methods Inf Med 2001; 40: 190-5.PubMed
3.
Zurück zum Zitat Eden A, Grach M, Goldik Z, et al. The implementation of an anaesthesia information management system. Eur J Anaesthesiol 2006; 23: 882-9.PubMedCrossRef Eden A, Grach M, Goldik Z, et al. The implementation of an anaesthesia information management system. Eur J Anaesthesiol 2006; 23: 882-9.PubMedCrossRef
4.
Zurück zum Zitat Edsall DW, Deshane P, Giles C, Dick D, Sloan B, Farrow J. Computerized patient anesthesia records: less time and better quality than manually produced anesthesia records. J Clin Anesth 1993; 5: 275-83.PubMedCrossRef Edsall DW, Deshane P, Giles C, Dick D, Sloan B, Farrow J. Computerized patient anesthesia records: less time and better quality than manually produced anesthesia records. J Clin Anesth 1993; 5: 275-83.PubMedCrossRef
5.
Zurück zum Zitat Reich DL, Wood RK Jr, Mattar R, et al. Arterial blood pressure and heart rate discrepancies between handwritten and computerized anesthesia records. Anesth Analg 2000; 91: 612-6.PubMedCrossRef Reich DL, Wood RK Jr, Mattar R, et al. Arterial blood pressure and heart rate discrepancies between handwritten and computerized anesthesia records. Anesth Analg 2000; 91: 612-6.PubMedCrossRef
6.
Zurück zum Zitat Brenck F, Hartmann B, Katzer C, et al. Hypotension after spinal anesthesia for cesarean section: identification of risk factors using an anesthesia information management system. J Clin Monit Comput 2009; 23: 85-92.PubMedCrossRef Brenck F, Hartmann B, Katzer C, et al. Hypotension after spinal anesthesia for cesarean section: identification of risk factors using an anesthesia information management system. J Clin Monit Comput 2009; 23: 85-92.PubMedCrossRef
7.
Zurück zum Zitat Lanier WL. Using database research to affect the science and art of medicine. Anesthesiology 2010; 113: 268-70.PubMedCrossRef Lanier WL. Using database research to affect the science and art of medicine. Anesthesiology 2010; 113: 268-70.PubMedCrossRef
8.
Zurück zum Zitat Bijker JB, van Klei WA, Vergouwe Y, et al. Intraoperative hypotension and 1-year mortality after noncardiac surgery. Anesthesiology 2009; 111: 1217-26.PubMedCrossRef Bijker JB, van Klei WA, Vergouwe Y, et al. Intraoperative hypotension and 1-year mortality after noncardiac surgery. Anesthesiology 2009; 111: 1217-26.PubMedCrossRef
9.
Zurück zum Zitat Broussard DM, Couch MC. Anesthesia preparation time is not affected by the experience level of the resident involved during his/her first month of adult cardiac surgery. J Cardiothorac Vasc Anesth 2011; 25: 766-9.PubMedCrossRef Broussard DM, Couch MC. Anesthesia preparation time is not affected by the experience level of the resident involved during his/her first month of adult cardiac surgery. J Cardiothorac Vasc Anesth 2011; 25: 766-9.PubMedCrossRef
10.
Zurück zum Zitat Dexter F, Maguire D, Epstein RH. Observation study of anaesthetists’ fresh gas flow rates during anaesthesia with desflurane, isoflurane and sevoflurane. Anaesth Intensive Care 2011; 39: 460-4.PubMed Dexter F, Maguire D, Epstein RH. Observation study of anaesthetists’ fresh gas flow rates during anaesthesia with desflurane, isoflurane and sevoflurane. Anaesth Intensive Care 2011; 39: 460-4.PubMed
11.
Zurück zum Zitat Ehrenfeld JM, Walsh JL, Sandberg WS. Right- and left-sided Mallinckrodt double-lumen tubes have identical clinical performance. Anesth Analg 2008; 106: 1847-52.PubMedCrossRef Ehrenfeld JM, Walsh JL, Sandberg WS. Right- and left-sided Mallinckrodt double-lumen tubes have identical clinical performance. Anesth Analg 2008; 106: 1847-52.PubMedCrossRef
12.
Zurück zum Zitat Ehrenfeld JM, Epstein RH, Bader S, Kheterpal S, Sandberg WS. Automatic notifications mediated by anesthesia information management systems reduce the frequency of prolonged gaps in blood pressure documentation. Anesth Analg 2011; 113: 356-63.PubMedCrossRef Ehrenfeld JM, Epstein RH, Bader S, Kheterpal S, Sandberg WS. Automatic notifications mediated by anesthesia information management systems reduce the frequency of prolonged gaps in blood pressure documentation. Anesth Analg 2011; 113: 356-63.PubMedCrossRef
13.
Zurück zum Zitat Bijker JB, van Klei WA, Kappen TH, van Wolfswinkel L, Moons KG, Kalkman CJ. Incidence of intraoperative hypotension as a function of the chosen definition: literature definitions applied to a retrospective cohort using automated data collection. Anesthesiology 2007; 107: 213-20.PubMedCrossRef Bijker JB, van Klei WA, Kappen TH, van Wolfswinkel L, Moons KG, Kalkman CJ. Incidence of intraoperative hypotension as a function of the chosen definition: literature definitions applied to a retrospective cohort using automated data collection. Anesthesiology 2007; 107: 213-20.PubMedCrossRef
14.
Zurück zum Zitat Gostt RK, Rathbone GD, Tucker AP. Real-time pulse oximetry artifact annotation on computerized anaesthetic records. J Clin Monit Comput 2002; 17: 249-57.PubMedCrossRef Gostt RK, Rathbone GD, Tucker AP. Real-time pulse oximetry artifact annotation on computerized anaesthetic records. J Clin Monit Comput 2002; 17: 249-57.PubMedCrossRef
15.
Zurück zum Zitat Takla G, Petre JH, Doyle DJ, Horibe M, Gopakumaran B. The problem of artifacts in patient monitor data during surgery: a clinical and methodological review. Anesth Analg 2006; 103: 1196-204.PubMedCrossRef Takla G, Petre JH, Doyle DJ, Horibe M, Gopakumaran B. The problem of artifacts in patient monitor data during surgery: a clinical and methodological review. Anesth Analg 2006; 103: 1196-204.PubMedCrossRef
16.
Zurück zum Zitat Gorges M, Markewitz BA, Westenskow DR. Improving alarm performance in the medical intensive care unit using delays and clinical context. Anesth Analg 2009; 108: 1546-52.PubMedCrossRef Gorges M, Markewitz BA, Westenskow DR. Improving alarm performance in the medical intensive care unit using delays and clinical context. Anesth Analg 2009; 108: 1546-52.PubMedCrossRef
Metadaten
Titel
Artifacts in research data obtained from an anesthesia information and management system
verfasst von
Nathalie P. Kool, MD
Judith A. R. van Waes, MD
Jilles B. Bijker, MD
Linda M. Peelen, PhD
Leo van Wolfswinkel, MD, PhD
Jurgen C. de Graaff, MD, PhD
Wilton A. van Klei, MD, PhD
Publikationsdatum
01.09.2012
Verlag
Springer-Verlag
Erschienen in
Canadian Journal of Anesthesia/Journal canadien d'anesthésie / Ausgabe 9/2012
Print ISSN: 0832-610X
Elektronische ISSN: 1496-8975
DOI
https://doi.org/10.1007/s12630-012-9754-0

Weitere Artikel der Ausgabe 9/2012

Canadian Journal of Anesthesia/Journal canadien d'anesthésie 9/2012 Zur Ausgabe

Mehr Frauen im OP – weniger postoperative Komplikationen

21.05.2024 Allgemeine Chirurgie Nachrichten

Ein Frauenanteil von mindestens einem Drittel im ärztlichen Op.-Team war in einer großen retrospektiven Studie aus Kanada mit einer signifikanten Reduktion der postoperativen Morbidität assoziiert.

Delir bei kritisch Kranken – Antipsychotika versus Placebo

16.05.2024 Delir Nachrichten

Um die Langzeitfolgen eines Delirs bei kritisch Kranken zu mildern, wird vielerorts auf eine Akuttherapie mit Antipsychotika gesetzt. Eine US-amerikanische Forschungsgruppe äußert jetzt erhebliche Vorbehalte gegen dieses Vorgehen. Denn es gibt neue Daten zum Langzeiteffekt von Haloperidol bzw. Ziprasidon versus Placebo.

Eingreifen von Umstehenden rettet vor Erstickungstod

15.05.2024 Fremdkörperaspiration Nachrichten

Wer sich an einem Essensrest verschluckt und um Luft ringt, benötigt vor allem rasche Hilfe. Dass Umstehende nur in jedem zweiten Erstickungsnotfall bereit waren, diese zu leisten, ist das ernüchternde Ergebnis einer Beobachtungsstudie aus Japan. Doch es gibt auch eine gute Nachricht.

Darf man die Behandlung eines Neonazis ablehnen?

08.05.2024 Gesellschaft Nachrichten

In einer Leseranfrage in der Zeitschrift Journal of the American Academy of Dermatology möchte ein anonymer Dermatologe bzw. eine anonyme Dermatologin wissen, ob er oder sie einen Patienten behandeln muss, der eine rassistische Tätowierung trägt.

Update AINS

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.