Artifacts in research data obtained from an anesthesia information and management system.

PURPOSE: Artifacts in anesthesia information management system (AIMS) databases may influence research results. Filtering during data capturing can prevent artifacts from being stored. In this prospective study, we assessed the reliability of AIMS data by determining the incidence of artifactual values stored in the AIMS.
METHODS: Vital parameter values regarding 86 surgical patients were collected in the AIMS both manually and automatically after filtering using the median value per minute. The percentage of artifactual values with a 95% confidence interval (CI) was calculated for each parameter. Secondary outcomes included the number of values that deviated from a predefined baseline, the percentage of these deviations that were caused by artifacts, the number of episodes across which these artifacts were distributed, and the most common causes of artifacts.
RESULTS: Altogether, 9,534 min of anesthesia time were recorded. The overall percentages of artifacts were: 0.0 for heart rate (95% CI: 0.0 to 0.1), 0.3 for oxygen saturation (95% CI: 0.2 to 0.4), 4.7 for ST-segment (95% CI: 4.3 to 5.2), 2.3 for noninvasive blood pressure values (95% CI: 1.8 to 2.9), and 14 for invasive blood pressure values (95% CI: 12 to 15). Artifacts as a percentage of deviations from baseline were: 1.6 for heart rate (95% CI: 0.4 to 5.7), 24 for saturation (95% CI: 18 to 32), 83 for ST-segment (95% CI: 76 to 87), 3.3 for noninvasive blood pressure values (95% CI: 2.5 to 87), and 27 for invasive blood pressure values (95% CI: 24 to 31).
CONCLUSIONS: Storing a median value per minute to filter capturing of vital parameter values in an AIMS database provides reliable data for heart rate and oxygen saturation and acceptable reliability for noninvasive blood pressure data. Knowledge about the method of artifact filtering is essential in studies using AIMS data.

Anesthesia information and management systems (AIMS) are increasingly being adopted in anesthesia practice. Such automated patient records are considered superior to handwritten records as they are less time-consuming and retain comparable or higher accuracy.1-5 An AIMS is not only useful as an instrument to enhance anesthesia record-keeping or support clinical decisions, but it can also be useful as a resource to answer clinical research questions, and in particular to generate hypotheses for further research.6-13

Although the quality of data capturing and storage in the AIMS database is considered highly accurate, not all stored values are necessarily based on reliable measurements. In retrieving data from the monitoring systems, an AIMS cannot determine whether a certain value is a “true” value or an artifact that occurred while measuring the value (e.g., false low oxygen saturation caused by a dislocated pulse oximeter). Consequently, when using the data for research purposes, it may be difficult or even impossible to distinguish between true values and artifacts. Obviously, artifacts may influence research results. If the occurrence rate of artifacts is high, research results based on AIMS data may be unreliable estimates. Moreover, artifacts may introduce bias if certain artifacts are associated exclusively with certain procedures. To prevent the AIMS from storing artifacts as true values, intelligent filtering can be applied during data capturing. Still, this does not completely prevent artifacts from being stored as “real” values.

The incidence of artifacts in AIMS databases and the procedure or time-specific associations of artifacts which may influence research results are yet undetermined. In this study, we assessed the reliability of AIMS data for research purposes by estimating prospectively the occurrence rate of artifacts in the vital parameter values recorded in our AIMS database. Moreover, we recorded the causes of artifactual measures stored in the AIMS.

Methods

This prospective observational study included 86 adult patients who underwent ear-nose-throat (ENT), general, or neurosurgery requiring general anesthesia. The numbers of each type of procedure were allocated to approximate an even distribution of anesthesia time over the three types of surgery. All procedures were performed in a tertiary referral centre (University Medical Center, Utrecht, The Netherlands) within a six-week period in 2010. The need for written informed consent was waived by the Medical Research Ethics Committee of the University Medical Center, Utrecht (final approval October 5th, 2010). According to requirements of Dutch law, the anonymity and confidentiality of routinely collected clinical data were assured.

All patients were monitored by a Datex Ohmeda S/5™ monitoring system (GE Healthcare, Waukesha, WI, USA) that has a built-in filter for artifacts. The heart rate (HR) displayed on the monitor is derived from the electrocardiogram (ECG), the plethysmogram, or the invasive blood pressure (IBP) curve, and it is updated every five seconds by calculating the mean HR over the last ten seconds. The oxygen saturation is derived from the plethysmogram and displayed beat-to-beat. After the monitoring system automatically determines the J-point in the electrocardiogram, the ST-segment deviation (elevation or depression in millimetres) is updated every five seconds by calculating the mean ST-segment over the last eight QRS complexes. The noninvasive blood pressure (NIBP) is displayed each time it is measured, and the IBP curve is displayed beat-to-beat.

Values from the Datex monitoring system are stored automatically in a locally developed AIMS (Vierkleurenpen©, version 1.4.5, 2010) that samples data from the monitoring system every five seconds. In order to prevent the monitoring system from capturing artifacts, data are recorded in the database and displayed every minute, but only after a filter is applied. This means that the median value per minute is calculated and stored for HR, saturation, ST-segment, and IBP (systolic, diastolic, and mean), while the NIBP (systolic, diastolic, and mean) is recorded every time it is measured (no filtering). Storing the median value per minute was considered an effective method to prevent the AIMS from storing the majority of the artifacts caused, for example, by positioning the patient or electrocautery. Such artifacts are usually short in duration and thus seldom influence the median value of the twelve values captured per minute.

All data for HR, ST-segment, oxygen saturation, NIBP, and IBP were collected automatically by the institutional AIMS system and then collected manually in the operating room by the first author who was present for all procedures reported in this investigation and attended to the monitor as well as the values stored in the AIMS. We included three surgical types (ENT, general, and neurosurgical) in our study since artifacts are thought to be influenced by the type and location of surgery.

Data were collected from the time the monitoring system was connected to the patient until the monitor was disconnected. All data stored in the AIMS (i.e., those values displayed on screen) were evaluated as either reliable values or possible artifacts. An artifact was defined as any value that did not reflect the patient’s current physiologic state, as defined below.

Definition of an artifact

We defined an artifact a priori as one or all of the following:

For purposes of this investigation, an artifact was defined as any value deviating outside a biologically plausible range (see Table 1). A fixed plausible range was used for HR and oxygen saturation. For the ST-segment, NIBP, and IBP, an individual baseline value was calculated immediately after induction of anesthesia, using all values before induction. The average (NIBP / IBP) or median (ST-segment) of these values was then defined as the normal range.

Table 1

Definition of baseline and deviating values

Variable	Baseline	Deviating value
HR	Not applicable	>100 beats·min−1 or < 40 beats·min−1
Oxygen Saturation	Not applicable	< 95%
ST-segment	Median of values before induction	>1 mm above or below baseline
Systolic NIBP	Mean of values before induction	< 80 mmHg or >180 mmHg or
		> 30% above or below baseline
IBP	Mean of values before induction	< 80 mmHg or >180 mmHg, or
	or mean of NIBP values before induction	> 30% above or below baseline

HR = heart rate; NIBP = noninvasive blood pressure; IBP = invasive blood pressure

A value of NIBP or IBP was considered a possible artifact if it deviated ≥ 30% from the preceding value (Table 1).

A value was considered an artifact, even if it was within a previously defined “normal” range, when it was clearly observed as being unreliable based on the investigator’s consultation with the anesthesiologist regarding observations in the operating room (e.g., if the surgeon leaned on the NIBP cuff).

A value that was considered a possible artifact was verified with the attending anesthesiologist or anesthetic nurse as to whether it reflected the patient’s physiologic state. Values considered artifacts were manually recorded together with their causes. The investigation only considered data that were stored in the AIMS, therefore, data filtered by the Datex monitoring system (e.g., electrocautery filtering) were not considered.

For purposes of this investigation, we expressed the number of artifacts for each parameter as a percentage of the total number of observations with the respective 95% confidence interval (CI). An episode was defined as a period of deviation that included one or more consecutive artifacts. The number of artifacts and deviating values per episode were calculated and expressed as medians with an interquartile range. In addition, frequencies of the different causes for artifacts were counted.

Outcome

The primary outcome was the percentage of artifacts for each of the included parameters with a 95% CI. Secondary outcomes included the number of values deviating from the predefined baseline value and the percentage of these deviations being caused by artifacts. In addition, we reported the number of episodes across which these values and artifacts were distributed. Finally, we determined the most common causes of artifactual values.

Analysis and statistics

To estimate the percentage of artifacts in the AIMS database, we performed a sample size calculation to determine the minimum number of values to include in the study. In this calculation, we assumed a maximum 4% incidence of artifacts, and we wanted to rule out a > 5% incidence with 95% certainty, implying that the width of the 95% CI should be a maximum 1% on each side. Furthermore, we assumed that the probability that each stored value was an artifact was independent of the occurrence of any other artifact, i.e., artifacts within patients were independent.

As the NIBP is the measurement performed least frequently, the sample size calculation was based on the assumption that 4% of the stored NIBP values would be an artifact. The further assumptions that the NIBP was being measured at least every five minutes and a 95% CI would not exceed 5% led to a required minimum of 1,850 NIBP measurements or 9,250 min (1,850 x 5 min) of “anesthesia time”.

Results

Eighty-six patients were included in the study over a period of 9,534 min of anesthesia time. Heart rate, ST-segment, oxygen saturation, and NIBP were measured in all patients; IBP was measured in 12 patients. Baseline characteristics are shown in Table 2. The mean (standard deviation; SD) age was 55.1 (17.9) yr with differences between specialties: ENT: 60.8 (16.9) yr; general surgery: 52.2 (17.6) yr; and neurosurgery: 49.7 (17.8) yr.

Table 2

Baseline characteristics

	All patients, n = 86	Anesthesia time per procedure (minutes)(mean (SD); range)
Mean age (SD)	55.1 (17.8)
Male sex	51 (59%)
Surgery type
ENT (endoscopic)	22 (26%)	43 (13); 22-68
ENT (other)	13 (15%)	86 (49); 24-175
General (trauma)	11 (13%)	132 (31); 71-182
General (abdominal)	10 (12%)	82 (65); 39-234
General (other)	8 (9%)	124 (50); 26-163
Neurosurgery (intracranial)	14 (16%)	210 (103); 65-452
Neurosurgery (other)	8 (9%)	112 (61); 66-215

SD = standard deviation; ENT = ear, nose, and throat. Baseline characteristics of the research population are given as well as the length of anesthesia time for each type of surgical procedure

The number of values stored during the 9,534 min were: HR 9,442, oxygen saturation 9,415, ST-segment 9,026, and NIBP 2,754 (Table 3). Table 3 also provides stratification by specialty and the number of episodes over which the deviating values and artifacts were distributed. Overall, the percentage of artifacts was 0.0 for HR (95% CI: 0.0 to 0.1), 0.3 for oxygen saturation (95% CI: 0.2 to 0.5), 4.7 for ST-segment (95% CI: 4.3 to 5.2), 2.3 for NIBP (95% CI: 1.8 to 2.9) and 14 for IBP values (95% CI: 12 to 15).

Table 3

Results of analysis performed on all values during anesthesia

	Variable	Observed Anesthesia time (min)	Number of values	Number of deviating values (%)	Number of episodes containing deviating values	Number of artifacts	Number of episodes containing artifacts	% of values being artifacts (95% CI)	% of deviating values being artifacts (95% CI)
Total	HR	9,534	9,442	125 (1.3)	40	2	1	0.0 (0.0 to 0.1)	1.6 (0.4 to 5.7)
	Sat		9,415	128 (1.4)	47	31	20	0.3 (0.2 to 0.5)	24.2 (17.6 to 32.3)
	ST		9,026	188 (2.1)	51	426	16	4.7 (4.3 to 5.2)	82.5 (76.4 to 87.2)
	NIBP		2,754	1,335 (48.5)	252	62	26	2.3 (1.8 to 2.9)	3.3 (2.5 to 87.2)
	IBP	2,748	2,469	615 (24.9)	57	333	23	13.5 (12.2 to 14.9)	27.0 (23.6 to 30.6)
ENT surgery	HR	2,241	2,205	17 (0.8)	10	2	1	0.1 (0.0 to 0.3)	11.8 (3.3 to 34.3)
	Sat		2,201	35 (1.6)	11	12	7	0.6 (0.3 to 1.0)	34.3 (20.8 to 50.9)
	ST		2,145	51 (2.4)	14	48	6	2.2 (1.7 to 3.0)	72.6 (59.1 to 82.9)
	NIBP		884	441 (49.9)	93	2	2	0.2 (0.1 to 0.8)	0.5 (0.1 to 1.6)
	IBP	0	0	-	-	-	-	-	-
General surgery	HR	3,427	3,421	96 (2.8)	23	0	0	0 (0.0 to 0.1)	0 (0.0 to 3.9)
	Sat		3,411	68 (2.0)	25	14	9	0.4 (0.2 to 0.7)	20.6 (12.7 to 31.6)
	ST		3,262	67 (2.1)	23	303	6	9.3 (8.3 to 10.3)	100 (94.6 to 100)
	NIBP		1,116	560 (50.2)	111	51	22	4.6 (3.5 to 6.0)	6.4 (4.7 to 8.8)
	IBP	432	309	191 (61.8)	20	105	5	34.0 (28.9 to 39.4)	44.0 (37.1 to 51.1)
Neuro-surgery	HR	3,866	3,816	12 (0.3)	7	0	0	0 (0.0 to 0.1)	0 (0.0 to 24.3)
	Sat		3,803	25 (0.7)	11	5	4	0.1 (0.1 to 0.3)	20.0 (8.9 to 39.1)
	ST		3,619	70 (1.9)	14	75	4	2.1 (1.7 to 2.6)	72.9 (61.5 to 81.9)
	NIBP		754	334 (44.3)	48	9	2	1.2 (0.6 to 2.3)	1.8 (0.8 to 3.9)
	IBP	2,316	2,160	424 (19.6)	37	228	18	10.6 (9.3 to 11.9)	19.3 (15.9 to 23.4)

CI = confidence interval; ENT = ear, nose, and throat; HR = heart rate; Sat = oxygen saturation; ST = ST-segment; NIBP = noninvasive blood pressure; IBP = invasive blood pressure. Anesthesia time represents the cumulative number of minutes the patients were under anesthesia. HR, Sat, ST, and NIBP have the same anesthesia times; IBP anesthesia time however is lower, because IBP was only measured in 12 cases. The number of values in HR, Sat, and ST differ slightly from the anesthesia time, although these parameters are calculated and stored every minute. This difference is caused by some missing parameters in the anesthesia information management system database, for example, caused by displacement of the pulse oximeter. The number of NIBP values is lower than the anesthesia time because it was generally measured with intervals of 2.5 or five minutes. The percentage of deviating values represents the percentage of the total amount of values

Artifacts as a percentage of total deviations represented 1.6 for HR (95% CI: 0.4 to 5.7), 24 for oxygen saturation (95% CI: 18 to 32), 83 for ST-segment (95% CI: 76 to 87), 3.3 for NIBP (95% CI: 2.5 to 87), and 27 for IBP values (95% CI: 24 to 31), as shown in the last column of Table 3.

We found that many of the artifacts occurred before incision and after surgical closing. Since these periods are known to be times of extreme variability, a sensitivity analysis was performed to exclude these specific periods (Table 4). The results for HR, oxygen saturation, ST-segment, and NIBP were minimally affected compared with the overall analysis. However, the incidence of artifacts and deviations in IBP was decreased from 14% to 3.9% and from 27% to 4.4%, respectively (Table 4). Furthermore, we found that relocation of the ECG electrodes was a major cause of ST-segment artifacts, occurring in only four patients undergoing procedures in the thoracic region or in procedures requiring the patient to be placed in a prone position (three general surgery patients and one neurosurgery patient). An additional analysis excluding these patients resulted in a decrease in the incidence of ST-segment values being artifacts to 0.8% (95% CI: 0.7 to 1.1) and a decrease in the incidence of deviating ST-segment values being artifacts to 61% (95% CI: 51 to 71).

Table 4

Results of sensitivity analysis performed on values between surgical incision and closure

	Variable	Observed Surgery time (min)	Number of values	Number of deviating values (%)	Number of episodes containing deviating measure-ments	Number of artifacts	Number of episodes containing artifacts	% of values being artifacts (95% CI)	% of deviating values being artifacts (95% CI)
Total	HR	6,201	6,137	47	13	2	1	0.0 (0.0 to 0.1)	4.2 (1.2 to 14.3)
	Sat		6,118	52	13	10	4	0.2 (0.1 to 0.3)	19.2 (10.8 to 31.9)
	ST		6,027	131	42	304	10	5.0 (4.5 to 5.6)	77.1 (69.2 to 83.5)
	NIBP		1,736	814	157	50	21	2.9 (2.2 to 3.8)	4.4 (3.1 to 6.1)
	IBP		1,785	337	31	69	6	3.9 (3.1 to 4.9)	13.9 (10.7 to 18.1)
ENT surgery	HR	1,451	1,419	7	4	2	1	0.1 (0.0 to 0.5)	28.6 (8.2 to 64.1)
	Sat		1,401	20	2	2	1	0.1 (0.0 to 0.5)	10.0 (2.8 to 30.1)
	ST		1,340	34	9	27	3	2.0 (1.4 to 2.9)	67.6 (50.8 to 80.9)
	NIBP		578	294	66	2	2	0.3 (0.1 to 1.3)	0.7 (0.2 to 2.5)
	IBP	-	-	-	-	-	-	-	-
General surgery	HR	2,198	2,198	39	8	0	0	0.0 (0.0 to 0.2)	0.0 (0.0 to 9.0)
	Sat		2,196	29	9	7	2	0.3 (0.1 to 0.7)	24.1 (12.2 to 42.1)
	ST		2,188	52	20	230	4	10.5 (9.3 to 11.9)	100 (93.1 to 100)
	NIBP		704	343	82	39	17	5.5 (4.1 to 7.5)	0.5 (5.7 to 11.6)
	IBP		201	109	10	43	3	21.4 (16.3 to 27.6)	34.9 (26.6 to 44.2)
Neuro-surgery	HR	2,552	2,520	1	1	0	0	0.0 (0.0 to 0.2)	0.0 (0.0 to 79.4)
	Sat		2,521	3	2	1	1	0.0 (0.0 to 0.2)	33.3 (6.2 to 79.2)
	ST		2,499	45	13	47	3	1.9 (1.4 to 2.5)	57.8 (43.3 to 71.0)
	NIBP		454	177	27	9	2	2.0 (1.1 to 3.7)	3.4 (1.6 to 7.2)
	IBP	1,614	1,584	228	21	26	3	1.6 (1.1 to 2.4)	3.9 (2.1 to 7.3)

CI = confidence interval; ENT = ear, nose, and throat; HR = heart rate; Sat = oxygen saturation; ST = ST-segment; NIBP = noninvasive blood pressure; IBP = invasive blood pressure. This table represents the same results as shown in Table 3, but in this case, only measurements performed during the surgical procedure were included, i.e., the time of anesthesia induction and emergence from anesthesia were excluded. Anesthesia time represents the cumulative number of minutes the patients were under anesthesia. HR, Sat, ST, and NIBP have the same anesthesia times; IPB anesthesia time however is lower because IBP was only measured in 12 cases. The number of values in HR, Sat and ST differ slightly from the anesthesia time, although these parameters are calculated and stored every minute. This difference is caused by some missing parameters in the AIMS database, for example, caused by dislocation of the pulse oximeter. The number of NIBP values is lower than the anesthesia time because it was generally measured with intervals of 2.5 or five minutes. The percentage of deviating values represents the percentage of the total amount of values

Table 5 shows the direction of the deviating values (upwards or downwards) and the number of deviations per episode. Overall, 96% of the HR deviations were upwards (tachycardia), and only 2.7% of NIBP deviations were upwards (hypertensive) compared with 25% of the IBP deviations.

Table 5

Direction of deviations and number of deviations per episode

	Variable	Number of deviations above baseline (%)	Number of deviations below baseline (%)	Number of deviations per episode mean(SD)	Number of artifacts per episode mean(SD)
Total	HR	112 (95.7)	5 (4.3)	3.2 (6.2)	2.0 (n.a.)*
	Sat	0 (0.0)	128 (100)	2.7 (3.5)	1.6 (1.3)
	ST	153 (84.1)	29 (15.9)	3.7 (5.4)	26.6 (41.4)
	NIBP	36 (2.7)	1,292 (97.3)	5.3 (7.3)	2.4 (3.1)
	IBP	28 (25.2)	83 (74.8)	10.8 (27.4)	14.5 (11.4)
ENT surgery	HR	9 (100)	0 (0.0)	1.7 (1.1)	2.0 (n.a.)*
	Sat	0 (0.0)	35 (100)	3.2 (5.0)	1.7 (1.1)
	ST	29 (56.9)	22 (43.1)	3.6 (5.1)	8.0 (9.3)
	NIBP	14 (3.2)	427 (96.8)	4.7 (7.3)	1.0 (0.0)
	IBP	-	-	-	-
General surgery	HR	92 (94.8)	5 (5.2)	4.2 (8.1)	-
	Sat	0 (0.0)	68 (100)	2.7 (3.0)	1.6 (1.7)
	ST	59 (96.7)	2 (3.3)	2.9 (3.6)	50.5 (57.4)
	NIBP	20 (3.6)	534 (96.4)	5.0 (6.1)	2.3 (3.3)
	IBP	2 (3.0)	64 (97.0)	9.6 (10.0)	21.0 (18.9)
Neuro-surgery	HR	11 (100)	0 (0.0)	1.7 (0.8)	-
	Sat	0 (0.0)	25 (100)	2.3 (3.3)	1.3 (0.5)
	ST	65 (92.9)	5 (7.1)	5.0 (7.7)	18.8 (31.6)
	NIBP	2 (0.6)	331 (99.4)	7.0 (9.6)	4.5 (2.1)
	IBP	26 (57.8)	19 (42.2)	11.5 (33.3)	12.7 (8.3)

SD = standard deviation; HR = heart rate; Sat = oxygen saturation; ST = ST-segment; NIBP = noninvasive blood pressure; IBP = invasive blood pressure; ENT = ear, nose, and throat

* This contains only one measurement, therefore, no SD can be calculated. Percentages indicate percentage of all deviations in the corresponding group. Number of deviations above baseline is 0 for oxygen saturation, as oxygen saturation cannot exceed 100%. IBP was not measured in ENT surgery patients. No HR artifacts were observed in general surgery and neurosurgery patients

The most common causes for artifacts in oxygen saturation, ST-segment, NIBP, and IBP were dislocation of the pulse oximeter (65%), relocation of ECG electrodes (83%), manipulation of the blood pressure cuff (84%), and relocation of either the IBP sensor or the patient (53%) (Table 6).

Table 6

Causes of artifacts

		ENT surgery	General surgery	Neurosurgery	Total
HR	Electrocautery	0	0	0	0
	Moving/movements of the patient	0	0	0	0
	Double counting (P waves or T waves)	2 (100%)	0	0	2 (100%)
Sat	Dislocated pulse oximeter	5 (42%)	13 (93%)	2 (40%)	20 (65%)
	Peripheral vasoconstriction	79 (58%)	1 (7%)	3 (60%)	11 (36%)
ST	Electrocautery	0	0	0	0
	Moving/movements of the patient	48 (100%)	2 (1%)	8 (11%)	58 (14%)
	Relocation of ECG electrodes	0	288 (99%)	66 (88%)	354 (83%)
	Unknown	0	0	1 (1%)	14 (3%)
NIBP	Leaning against pressure cuff	1 (50%)	49 (94%)	3 (33%)	52 (84%)
	Immeasurable low blood pressure	0	0	0	0
	Abnormal positioning of arm (e.g. above the body)	0	0	6 (67%)	6 (10%)
	Unknown	1 (50%)	3 (6%)	0	4 (7%)
IBP	Dampened curve	-	48 (46%)	9 (4%)	57 (17%)
	Overshoot curve	-	0	0	0
	Relocation of pressure sensor	-	55 (52%)	121 (53%)	176 (53%)
	Pressure sensor not zeroed	-	2 (2%)	69 (30%)	71 (21%)
	Pressure sensor already connected, but patient without arterial line	-	0	28 (12%)	28 (8%)
	Flushing of pressure sensor	-	0	1 (0.4%)	1 (0.3%)

HR = heart rate; Sat = oxygen saturation; ST = ST-segment; ECG = electrocardiogram; NIBP = noninvasive blood pressure; IBP = invasive blood pressure; ENT = ear, nose, and throat. Values are number (%) of artifacts. Percentages represent the frequency of an artifact being caused by that situation for that specific specialty and parameter. For example, 58% of the artifacts in saturation during ENT surgery were caused by peripheral vasoconstriction. IBP was not measured during ENT surgery

Discussion

The aim of this study was to assess the reliability of the data in an AIMS database. We determined that the AIMS database provides reliable data for HR and oxygen saturation, whereas NIBP values show an error rate of up to 4.6%. For ST-segment and IBP values, the incidence of artifacts stored as values varied from 2-9% and from 11-34%, respectively, depending on the type of surgery. These results were obtained with application of a static one-minute median filter. As many other types of AIMS database filters exist, results may vary per system. This should be taken into account when using data from an AIMS database.

We chose to analyze records from patients undergoing general, ENT, or neurosurgical procedures. We considered these procedures to contain a substantial and meaningful variety of artifact incidences and respective causes as a consequence of their variations in anatomic localization, surgical approaches, and patient characteristics. This variation was reflected in our results, which show differences in the prevalence of artifacts when comparing the three specialties (Tables 3 and 4). Overall, we consider the incidence rate of artifacts in HR, oxygen saturation, ST-segment, and NIBP to be an acceptable error rate in an AIMS, hence, our opinion is that data regarding these parameters derived from an AIMS can be used for research purposes. It should be taken into account, though, that approximately 80% of the deviating ST-segment values appeared to be artifacts as well as approximately 25% of the deviating oxygen saturation and IBP values. When we excluded patients whose ECG electrodes were relocated, the overall incidence of ST-segment artifacts was decreased to 0.8%; nevertheless, approximately 60% of the deviating values were artifacts. The objective has to be carefully considered for research using blood pressure values. The IBP may seem more reliable than the NIBP because it is measured more frequently. On the other hand, the IBP contains more artifacts, mainly at the beginning and end of the procedure. However, by including only the period from incision to surgical closing, the percentage of artifactual deviating IBP values can be decreased to 4.4%. The occurrence of artifacts is important to consider when using AIMS data, depending on the goal of a particular study. When evaluating the causes of these artifacts, it seems that the most frequent ones (e.g., relocation of ECG electrodes, leaning against the blood pressure cuff, and relocation and delayed zeroing of the invasive pressure sensor) can easily be avoided.

It is difficult to compare the results from this study with the available literature. Although some studies have compared the number of incidences of artifacts derived from automated records with those derived from manual data entry, the aim of our study was to determine prospectively the number of artifacts stored in an anesthesia information and management system database. Moreover, in previous studies, the incidence was expressed as the number of cases (patients) containing artifacts rather than the number of artifacts that occur in a certain amount of values. Eden et al. 3 primarily investigated the potential of an AIMS and the accuracy of its data entry for 4,429 procedures, and they found that 12% of procedures contained at least one HR artifact and 2% contained at least five. Furthermore, they found that 1.5% of the cases contained at least four extreme values (HR < 20 or > 180 and oxygen saturation < 80%), 60% of which were artifacts. Edsall et al.4 compared manual and computerized anesthesia records with respect to time demands and record quality. They found two artifacts (one in oxygen saturation and one in expiratory carbon dioxide) in the computerized records, but they included only five AIMS-recorded patients. Gostt et al.14 developed an algorithm to annotate pulse oximetry artifacts automatically and tested its accuracy in routine surgical procedures. They designed the algorithm to label all oxygen levels < 90% in 20 surgical patients. Thirteen values < 90% were found, and nine (69%) of these were artifacts.

When looking at the causes of artifacts, Takla et al.15 provided a list of the most common causes for artifacts, but they did not quantify these causes. Görges et al. 16 studied the alarms in a medical intensive care unit and classified these as effective, ineffective, or actively ignored. They showed that the number of ineffective and ignored alarms, which can be interpreted as artifacts, could be decreased if the alarm presentation was delayed by 19 sec. This suggests that the duration of a deviation is important in differentiating between true deviations and artifacts. In our study, we had comparable observations, particularly in ST-segment and IBP measurements (Table 5).

In the present study, values deviating from the normal range were defined in accordance with clinically used definitions of tachy- and bradycardia, hypoxia, ST-elevation and ST-depression, and hypo- and hypertension.13 As such, definitions partially include individual baseline values (i.e., values obtained before induction of anesthesia) with a corresponding normal range; a normal range for each parameter in every individual patient was calculated immediately before surgery. The resulting normal range may not be fully representative of the physiologic state of the patient, since patients can be stressed before undergoing surgery. However, we do not think that this influenced the results because we registered artifactual values that deviated from the individual normal range and values that fell within this normal range. A second limitation is that values considered as being artifacts were not evaluated by a reference test to confirm whether they indeed were artifacts; they were only verified immediately with the attending anesthesiologist or anesthetic nurse. Third, we found a high artifact incidence in IBP values (Table 4); however, this was found in a small subset of the investigation (12 out of 86 patients). Importantly, all of these IBP artifacts occurred during positioning of the patient or during emergence from anesthesia, and in most cases, they were due to relocation of the pressure sensor. In addition, 17% (57 values) of the IBP artifacts were caused by a dampened curve, which can be caused by clotting of the arterial catheter, in which case it is considered an artifact, but it can also be caused by cardiogenic shock. In general, when analyzing IBP data, a post hoc analysis can be performed to determine whether the dampened curve was caused by clotting. This can be achieved by comparing the IBP values with the corresponding NIBP values. However, NIBP is mostly measured infrequently if continuous IBP measurements are in use. Finally, in our sample size calculation, we assumed that the artifacts would occur independently of each other. However, our results show that artifact episodes within a single patient often contained multiple values, especially in the ST-segment and IBP values, suggesting that the occurrence of artifacts is not “independent”. It can therefore be argued that we underestimated the required “anesthesia time” in our sample size calculation. Nevertheless, our sample size calculation was based on the least frequently measured parameter (NIBP) in which most artifacts actually did occur independently (i.e., episodes contained single artifacts).

In conclusion, we found that storing the median value per minute to filter capturing of continuous vital parameter values in an AIMS database provides reliable data for HR and oxygen saturation with artifact rates below 0.5% and provides acceptable reliability for NIBP data with a 2.3% artifact rate. The presence of artifacts should be taken into account in research using vital parameter data from AIMS databases, especially when using IBP values; data should also be checked for reliability. In this study, knowledge about the method of artifact filtering for both the monitoring system and the AIMS is essential, and studies using AIMS data should describe methods of data acquisition, filtering, and storage.