Laboratory-based clinical audit as a tool for continual improvement: an example from CSF chemistry turnaround time audit in a South-African teaching hospital.

INTRODUCTION: Timeliness of laboratory results is crucial to patient care and outcome. Monitoring turnaround times (TAT), especially for emergency tests, is important to measure the effectiveness and efficiency of laboratory services. Laboratory-based clinical audits reveal opportunities for improving quality. Our aim was to identify the most critical steps causing a high TAT for cerebrospinal fluid (CSF) chemistry analysis in our laboratory.
MATERIALS AND METHODS: A 6-month retrospective audit was performed. The duration of each operational phase across the laboratory work flow was examined. A process-mapping audit trail of 60 randomly selected requests with a high TAT was conducted and reasons for high TAT were tested for significance.
RESULTS: A total of 1505 CSF chemistry requests were analysed. Transport of samples to the laboratory was primarily responsible for the high average TAT (median TAT = 170 minutes). Labelling accounted for most delays within the laboratory (median TAT = 71 minutes) with most delays occurring after regular work hours (P < 0.05). CSF chemistry requests without the appropriate number of CSF sample tubes were significantly associated with delays in movement of samples from the labelling area to the technologist's work station (caused by a preference for microbiological testing prior to CSF chemistry).
CONCLUSION: A laboratory-based clinical audit identified sample transportation, work shift periods and use of inappropriate CSF sample tubes as drivers of high TAT for CSF chemistry in our laboratory. The results of this audit will be used to change pre-analytical practices in our laboratory with the aim of improving TAT and customer satisfaction.

Introduction

Laboratory-based clinical audit is an important process in obtaining feedback for continual improvement. It involves measuring laboratory performance using selected quality indicators and defined benchmarks (, ). Audits in the laboratory are used to determine the root cause of non-conformities and assess the effectiveness of changes made.

Timeliness of laboratory results as a quality indicator assesses the effectiveness and efficiency of the total testing process and is expressed as turnaround time (TAT) for laboratory tests (-). The impact of TAT on the hospital length of stay is well documented (, ). It is also crucial to clinicians’ and patients’ satisfaction as highlighted in College of American Pathologists (CAP) Q-probes surveys (, ).

An improvement of TAT may require increased manpower and use of sophisticated equipment with greater throughput and this is often not practical, especially in low income settings (-). Lean management of TAT, by redesigning the existing work flow to utilize time efficiently, is often necessary for addressing challenges of high TAT. Understanding the root causes of high TAT using evidence-based methods is therefore imperative for planning improvements. Consequently, regulatory and accrediting bodies advise clinical laboratories to target TAT in their continual improvement process (-).

The implications of untimely laboratory results are perhaps better observed with emergency tests such as potassium, cardiac troponins and cerebrospinal fluid (CSF) chemistry. Delayed CSF results may result in grave consequences, especially in the setting of acute neurological diseases. Additionally, concerns about the stability of CSF analytes further underscore the need for rapid analysis (-). Sample transport and other pre-analytical processes are known to affect TAT (, ). The origin of the sample, for example inpatient versus outpatient, may also influence the TAT ().

CSF chemistry presents a unique challenge for improvement of TAT, as it is one of the few panel tests ordered as an emergency request. CSF glucose, protein, chloride and microbiology are most often requested to diagnose suspected neurological infections (, ). The complete set of CSF results is usually required prior to reporting for sensible interpretation and this may affect the TAT. Samples are often shared between different sections of the laboratory such as microbiology and chemistry, leading to increased TAT.

Recent increases in our laboratory’s workload have had an expected adverse impact on TAT, including that of CSF chemistry requests. By means of a systematic audit, our goal was to use data spanning six months to identify the most important steps that cause high TAT for CSF chemistry analysis in our laboratory and investigate the factors responsible. The results of this study will be used as a basis for improving TAT.

Materials and Methods

Study design

This retrospective audit was conducted on requests for a CSF chemistry panel during a 6-month period from November 1st 2014 to April 30th 2015 at the chemical pathology laboratory of Tygerberg Hospital, a tertiary referral teaching hospital in Cape Town, South Africa. The laboratory provides diagnostic pathology services to the teaching hospital as well as regional hospitals and clinics and processes an average of 90,000 tests a month.

The laboratory offers CSF protein, glucose and chloride analysis routinely as a panel. Other biochemical tests such as lactate or adenosine deaminase are performed at special request. Requests for CSF chemistry and microbiology are often accompanied by the following CSF samples: one fluoride tube (glucose), one plain tube (protein and chloride) and another plain tube (microbiology). Occasionally, only one plain tube accompanies the request in which case microbiological analysis is given preference (due to potential contamination), after which the sample is retrieved for CSF protein and chloride analysis. These were recorded as non-conformities and data from these specimens were included in this study.

CSF samples from within the hospital are transported to the laboratory central reception by the pneumatic tube system or are brought directly by hospital porters, physicians or patients’ relatives. Samples from regional hospitals and clinics are brought by special couriers. Work hours in laboratory reception are divided into three shifts: (i) regular shift (8 am to 4:30 pm), (ii) evening shift (4:30 pm to 8 pm), and (iii) night shift (8 pm to 8 am).

Methods

Samples go through the processes of sorting, registration and labelling followed by immediate transport to the laboratory for analysis. The result of analysis is available for the clinicians after review and authorization through the laboratory information system (LIS). The laboratory aims to fast-track all STAT samples (including CSF samples) and to release the results within two hours. Emergency samples are marked as “STAT” and given preference through all the phases of the testing cycle.

The LIS, DISA*LAB® (Laboratory System Technologies (Pty) Ltd, Cape Town, South Africa) captures information at relevant time points determined by the operational workflow of the laboratory. The information extracted from the LIS was used to compute the TAT to reflect the four operational periods, described in Table 1.

Table 1

Description of operational periods for CSF

Operationalperiod	Period startpoint	Period endpoint
Sample transportation	Time request made on LIS	Time sample received in laboratory
Sample sorting and registration	Time sample received in laboratory	Time sample registered on LIS
Sample processing (labelling, movement to analyser and analysis)	Time sample registered on LIS	Time result authorised by technologist
Reporting	Time result authorised by technologist	Time result reported by chemical pathologist
LIS – laboratory information system.

Requests, especially from external hospitals and those with missing entries or errors in the date or time, were excluded. Missing entries or errors occurred whenever the laboratory staff at any operational point failed to register the appropriate sample details on the LIS. The total TAT refers to the time from collection of sample to the time of authorization in the laboratory, whereas the within-laboratory TAT refers to the time from receipt at laboratory reception to authorization of final result. The TATs of CSF chemistry (a STAT test) and plasma glucose (a routine test) were compared to determine if the measures put in place to fast track STAT samples in our laboratory were successful. Routine plasma glucose was used in this study since glucose is also a component of CSF panel. The agreed TAT for routine glucose in our laboratory is 120 minutes.

A focused group discussion (FGD), involving technologists and the laboratory manager, was used to identify potential reasons for the high TAT. Each participant was asked to give their views as to the cause of the high TAT and the three most common reasons were noted. Sixty cases with above median TAT for the identified operational period were randomly selected. Thereafter, an audit trail was conducted on the LIS to closely examine the selected cases by breaking down the TAT of the identified period into smaller operational phases.

The operational period with the highest TAT (“sample processing”) consisted of three sub-phases namely:

Labelling (sample registration time to the time the label was printed)

Transport to work area (time the label was printed to time of sample entry at workstation)

Actual analysis (time of sample entry at workstation to time result was authorized by technologist).

The time of entry at work station was missing for two samples, affecting calculation of TAT for “transport to work area” and “analysis” phases so these were excluded in the test for significance for the possible reasons for high TAT.

The study was approved by the Ethics Committee of the University of Stellenbosch (N15/05/039) and carried out according to the Declaration of Helsinki. A waiver of consent was obtained as the study was retrospective and no patient results were used. Patient confidentiality was maintained at all times.

Statistical analysis

Data from DISA*LAB was exported to Microscoft Excel® 2013, version 15.0. Thereafter, analysis was done using Statistical Package for Social Sciences (SPSS® version 15.0. SPSS inc Chicago, USA). Assessment of normality of data was done using the Shapiro-Wilk test at P < 0.05 significance level. TAT was expressed as median with interquartile range and 90% completion time (TAT within which 90% of tests are completed) (, ). The relationship between high TAT and the suggested responsible factors was tested for significance using Fisher’s exact test (). A P < 0.05 was considered significant.

Results

Within the period under review a total of 2093 CSF requests were received. After excluding 588 requests with missing entries or errors (involving time and date records), 1505 requests were analysed. The median total and within-laboratory TATs were 345 minutes and 147 minutes, respectively. As a percentage of the total and within-laboratory TAT, sample transportation accounted for most delays with a median of 53.4% of the total TAT, whilst the period of sample processing accounted for a median of 65.5% of the within-laboratory TAT. The distribution of the TAT is summarized in Table 2.

Table 2

Summary of the distribution of TAT across phases of work flow for 1505 CSF chemistry requests

	Transport	Registration	Processing	Reporting	Within laboratory TAT	Total TAT
Median (minutes)	170	37	86	4	147	345
Median % of total TAT	53	11	28	1	47	–
Median % of within-laboratory TAT	–	27	66	3	–	–
Interquartile range (minutes)	108–277	20–67	62–126	2–11	103–214	248–484
90% completion time (minutes)	421	113	188	30	305	666
TAT – turnaround time.

The median duration of each process across the operational workflow for CSF chemistry was compared to that of plasma glucose (Figure 1). Although CSF chemistry had higher median transportation and total TAT, registration and within-laboratory TAT was lower compared to plasma glucose. The median TAT for sample processing period however was almost identical.

Figure 1

Median TAT across phases of workflow for CSF chemistry and plasma glucose. TAT – turnaround time.

An audit trail of 60 randomly selected cases with above median sample processing TAT showed that labelling had the highest TAT with a median of 71 minutes whilst transport to work area had the lowest duration with a median of 10 minutes (Table 3).

Table 3

Summary of the distribution of TAT across the “sample processing” phases (for sixty requests with the highest TAT)

	LabellingN = 60	Transport to work stationN = 58*	AnalysisN = 58*
Median(minutes)	71	10	39
Interquartile range (minutes)	46–111	6–26	24–65
90% completion time (minutes)	174	86	158
*Two samples had no record of receipt time at work station and were excluded from this analysis

Sample processing at non-regular work hours (affecting labelling), sample sharing for chemistry and microbiological testing (affecting transport of sample to work station) and repeat testing for specimens with critical values (affecting the analytical phase) were the most common reasons given for the high sample processing TAT as obtained from the FGD. Amongst the 60 cases, repeat testing in 34 cases (34 / 60) and shared CSF sample in only 4 (4 / 60) cases were observed. Equal numbers of cases (26 / 60) occurred during regular hours and the night shift (Table 4).

Table 4

“Proposed reasons for long TAT” and the upper quartile of TAT for “labelling”, “transportation to work area” and “analysis” phases

	≤ 75th percentile TAT	> 75th percentile TAT	Total	P
I. Sample labelling
Work shift
Regular hours	24	2	26	0.012
Evening hours	4	4	8
Night hours	17	9	26
II. Transportation to work area
Work Shift
Regular hours*	17	8	25	0.369
Evening hours*	5	2	7
Night hours	22	4	26
Shared CSF sample
Shared sample*	0	3	3	0.001
No shared sample *†	38	10	48
III. Analysis phase
Work shift
Regular hours*	19	6	25	1.000
Evening hours*	5	2	7
Night hours	20	6	26
Repeat testing
Repeat testing*	19	6	25	1.000
No repeat testing*	25	8	33
*one of the two missing data for time of receipt at work station which affected computing of TAT for transport to work area and Analysis phases (see Table 2).† Seven requests missing record of number of tubes.TAT – turnaround time.P < 0.05 considered statistically significant.

The work shift was significantly associated with the highest quartile of TAT for the labelling process but not for “movement to work station” or “analysis” phases. Compared to the regular working shift, a higher proportion of CSF samples labelled during the evening and night shift were likely to be in the upper quartile for TAT of this work phase (Table 3). Also, all cases of shared CSF sample were in the upper quartile of TAT for the phase of “transport to work station” compared to 10 (10 / 48) to non-shared sample. Repeat testing was not significantly associated with the upper quartile TAT for analysis phase (Table 4).

Discussion

Our audit showed that the median within-laboratory TAT in our laboratory for CSF chemistry (147 min) and routine glucose (170 min) exceeded our target TAT (120 min). This is contrary to findings of a national survey on intra-laboratory TAT for some common routine and STAT laboratory analyses performed in 479 laboratories in China which found the median within-laboratory TAT for stat and routine glucose to be 45 min and 130 min, respectively ().

We applied a systematic outlier analysis to identify reasons for the high TAT in our laboratory by analysing the requests with the highest TATs (above the median within-laboratory TAT; 147 min). A CAP Q-Probes study applied a similar approach by analysing outlier TAT events to help determine the causes of delays in the TAT process for STAT tests from emergency departments and intensive care units. However, they used an arbitrarily chosen 70-minute TAT to define outliers ().

The breakdown of the TAT of CSF chemistry requests in our laboratory identified transport of sample to the laboratory as the main culprit for high total TAT. A delayed transport of samples to the laboratory impacts negatively on the quality of laboratory results (). The increasing need for laboratories to become more involved in pre-pre-analytical issues has been emphasized (). Furthermore, the role of inappropriate sampling on CSF chemistry TAT in this study underscores the importance of sample collection and handling on the quality of laboratory output, as highlighted in the recently harmonized list of quality indicators ().

Suggestions from interviews of laboratory staff identified the sharing of samples with the microbiology laboratory as the main cause of high TAT for CSF chemistry. Findings from this study revealed that whilst this is a contributory factor, it accounted for at most 7% of the cases of high TAT and only impacted on the “transport to work area” phase of “sample processing”. This highlights the fact that changes in laboratory operations that are not evidence-based may have little impact whilst damaging root causes may be missed. This phase of laboratory operation could be improved by educating clinicians on the need for appropriate sampling.

Our TAT for the reporting phase for CSF chemistry was within recommended 6 minutes suggested by Ricos et al. (). We also found that efforts to fast-track the pre-analytical handling of emergency samples like CSF are effective for the registration phase as evidenced by the shorter median duration of this period for CSF chemistry when compared with plasma glucose. The sample processing phase however, appears to have an identical TAT for both tests. We expected a considerably lower TAT for CSF chemistry, as this is a STAT test, when compared to a routine test such as plasma glucose. Our findings demonstrate that sample processing was responsible for most of the within-laboratory TAT.

Our process-mapping investigation of the “sample processing” phase TAT indicated that samples were processed more slowly during evening and night work hours. This is contrary to a study from Pakistan which found that more delays in TAT of STAT tests occurred in the morning shift (). The delays in TAT in relation to work schedule have been suggested to be due to an imbalance between workload and staffing (, ). In our laboratory, this is particularly noticeable as it affects labelling of samples which is a time-consuming manual process. Therefore, the TAT for labelling is closely related to the number of staff available to perform the task. Although the sample throughput is generally expected to be lower during evening and night shifts, this period also coincides with the arrival of samples from remote peripheral hospitals. Our findings suggest a review in workforce distribution is necessary.

Although the analytical phase TAT was not significantly affected by repeat testing for critical concentrations, the frequency of occurrence of repeat testing for CSF chemistry is a concern. Apart from the unnecessary consumption of reagents and extensive additional workload, the impact on TAT for an individual request may not be easily quantified. A previous study in our laboratory found that there was no significant difference between values obtained at initial testing and those from repeat testing for critical concentrations ().

A limitation of our study is that we were unable to objectively determine whether addressing the causes of high TAT identified in this study will reduce the TAT. This will require follow-up and re-audit after instituting the suggested changes. Additionally, the number of cases in the regular, evening and night shifts may have been disproportional given the difference in duration of the shifts. A further limitation is that due to time constraints, only 60 cases with high TAT were analysed. Analysis of a larger number may have revealed more causes of high TAT. The reliability of our results may have been affected by the exclusion of over a quarter of our samples due to missing entries or errors. Entry at work station time was recorded manually by the technologists on the bench. Non-conformities in entering this time point were responsible for some missing calculations. Also, the CSF chemistry TAT was not compared with TAT of other STAT tests.

Despite these limitations, our study has demonstrated how systematic laboratory audits can be applied as a tool for root-cause analysis of problems in the clinical laboratory, particularly as it relates to TAT. Our study provides evidence that can be used as a basis for making relevant changes to public laboratory services. The National Health Laboratory Service (NHLS) has established guidelines stating the acceptable TAT for all tests covered by their service. However, the NHLS did not specify TAT for analysis of CSF chemistry as a distinct sample, which could be useful considering the unique challenge of analysing of CSF chemistry as a panel.

In conclusion, we found that careful and methodical examination of the critical “operational” steps involved in the total testing process will reveal the drivers of high TAT that may have been obscured in the traditional methods of assessing TAT by only reporting the total or within-laboratory TATs. We found that the TAT for CSF chemistry testing was unacceptably high, even though this is a supposedly STAT test. Transport of the sample to the laboratory was identified to be the main cause of delay followed by delays in sample processing during the evening and night shifts. Causes such as sharing of sample and repeat testing were minor contributors. The results of this audit will be used to change pre-analytical practices in our laboratory with the aim of improving TAT and customer satisfaction.