The importance of having a flexible scope ISO 15189 accreditation and quality specifications based on biological variation--the case of validation of the biochemistry analyzer Dimension Vista.

INTRODUCTION: Technological innovation requires the laboratories to ensure that modifications or incorporations of new techniques do not alter the quality of their results. In an ISO 15189 accredited laboratory, flexible scope accreditation facilitates the inclusion of these changes prior to accreditation body evaluation. A strategy to perform the validation of a biochemistry analyzer in an accredited laboratory having a flexible scope is shown.
MATERIALS AND METHODS: A validation procedure including the evaluation of imprecision and bias of two Dimension Vista analysers 1500 was conducted. Comparability of patient results between one of them and the lately replaced Dimension RxL Max was evaluated. All studies followed the respective Clinical and Laboratory Standards Institute (CLSI) protocols. 30 chemistry assays were studied. Coefficients of variation, percent bias and total error were calculated for all tests and biological variation was considered as acceptance criteria. Quality control material and patient samples were used as test materials. Interchangeability of the results was established by processing forty patients' samples in both devices.
RESULTS: 27 of the 30 studied parameters met allowable performance criteria. Sodium, chloride and magnesium did not fulfil acceptance criteria. Evidence of interchangeability of patient results was obtained for all parameters except magnesium, NT-proBNP, cTroponin I and C-reactive protein.
CONCLUSIONS: A laboratory having a well structured and documented validation procedure can opt to get a flexible scope of accreditation. In addition, performing these activities prior to use on patient samples may evidence technical issues which must be corrected to minimize their impact on patient results.

Introduction

Continuous technological innovation requires the laboratory to deal with frequent changes in methodology and instruments. Some of these changes are motivated by manufacturer's improvements. Moreover, sometimes they are promoted by set requirements, which depend on the clinical needs of the diagnostic test.

According to Clauses 5.5.1 to 5.5.3 of ISO 15189 (1), accredited laboratories may modify methods. Such modifications require the accredited laboratory to have a flexible scope of accreditation. The main consequence of a flexible scope and the benefit to the laboratory is the flexibility to modify methods, validate the changes and apply them without having to ask the Accreditation Body for extensions to the scope as in the called fixed scopes of accreditation are required (2–4).

Historically, accreditation has been based on so called fixed scopes. This system for defining the scope obliges that an evaluation of laboratory competence should be carried out each time when an additional activity is added to the scope, even where competence in this general area has already been demonstrated.

Under flexible scope, laboratories are allowed to include additional activities in their scope of accreditation on the basis that their competence has been previously demonstrated to the Accreditation Body, not only to carry out activities according to previously evaluated procedures, but also for the development and validation of them following a pre-established system.

Recently, the Emergency Laboratory (EL) of the Department of Laboratory Medicine, Hospital Universitario La Paz, Madrid, Spain has renewed its biochemistry analyzers changing the Dimension RxL Max (RxL) to Dimension Vista 1500 (Vista), both from Siemens Healthcare Diagnostics®. This implies some methodological improvements such as LOCI technology for the cardiac Troponin I, NT-proBNP and HCG measurements, C-reactive protein (CRP) by nephelometric assay and the possibility for calibration for enzyme quantification (5). As a result of the flexible scope accreditation and prior to use on patients, the laboratory always applies a validation strategy. This is based on CLSI recommendations to assess performance reliability and to grant the comparability of patient results (6–10).

The aim of this study is to show how to perform a validation of an analytical system, in this case a biochemistry analyzer, when it is introduced in a flexible scope accredited laboratory to guarantee their capacity of ensuring that the results are traceable for each individual patient.

Validation procedure involved evaluating the main analytical performance (imprecision and systematic error) of two Dimension Vista analysers and to assess the comparability of patient results of one of them with the previous methodology Dimension RxL.

Materials and methods

Study design

The Hospital Universitario La Paz is a tertiary institution containing four hospitals: the General Hospital, Traumatology and Orthopaedics, Obstetrics and Gynaecology and Children’s Hospital. It has nine critical care units, four emergency departments and some outpatient activities.

The EL receives analytical requests from all these hospitals. The laboratory has been accredited by the Spanish Accreditation Body (ENAC), according to ISO 15189:2007 since 2005. It was the first Spanish laboratory to obtain this accreditation and also the first to have a flexible scope accreditation. This accreditation covers all the analytes that are available in the EL.

A rigorous procedure established by the laboratory before the technological change was followed. The whole process was completed prior to use on patient samples. The initial step was to evaluate the analytical performance of two Dimension Vista analysers (namely V-1 and V-2). Secondly, a comparison was made between patients’ results obtained using Dimension Vista and using Dimension RxL Max. The analytical performance evaluation was made of the two Dimension Vista instruments and the comparison with Dimension RxL Max was made using only the results from one Dimension Vista (V-1).

The evaluation procedure had been based on the CLSI EP5-A2 document (8) for precision and CLSI EP-15 document (9) for bias estimation. CLSI EP9-A2 document (10) was followed for verification of comparability of patient results.

Multiple reagents and calibrator lots for all tests and only a single lot of control material were used over the study period. All materials were handled according to manufacturer recommendations.

Statistical analysis was performed in the evaluation software package StatisPro (CLSI) for the evaluation of imprecision, bias and total error at the medical decision levels based on tables provided by Westgard (11). Biological Variation (BV) was used as the main acceptance criteria (12) following the hierarchy established by the Stockholm consensus (13).

Evaluation of analytical performance of Dimension Vista 1500

The scope of this study includes 30 analytes that were analyzed in the two Vista instruments and in the Dimension RxL Max. Principles of procedures of each parameter are shown in Table 1.

Table 1.

Principles of procedures of Dimension RxL Max and Dimension Vista.

Analyte	Abbreviation	Principles of procedure Dimension RxL Max and Vista
Albumin	Alb	Colorimetric bromocresol purple
Alkaline phosphatase	ALP	Substrate p-nitrophenyl phosphate
Alanine aminotransferase	ALT	L-alanine with phosphate pyridoxal
Ammonia	Amon	Glutamate dehydrogenase
Amylase	AMY	CNP-Triose CNPG3
Aspartate aminotransferase	AST	L-aspartate with pyridoxal phosphate
Urea nitrogen	BUN	Urease/glutamate dehydrogenase
Calcium	Ca	Colorimetric O-cresolftalein
Cholesterol	Chol	Cholesterol esterase, Cholesterol oxidase
Creatine kinase	CK	Creatine kinase. Modified Rosalki method
Creatinine	Cre	Modified Jaffe method. Non IDMS-traceable
γ-glutamyl transferase	GGT	G-Glutamyl carboxy nitroanilide
Lactate dehydrogenase	LD	Enzymatic lactate to pyruvate
Uric acid	UricA	Uricase
Direct bilirubin	DBil	Jendrassik-Grof
Total bilirubin	TBil	Jendrassik-Grof
Phosphorus	Phos	Phosphomolybdate
Glucose	Glu	Hexoquinase
Magnesium	Mg	Methyl thymol blue
Triglycerides	Tg	Enzymatic
Urinary/cerebrospinal fluid protein	UCFP	Red pyrogallol
Total protein	TP	Biuret endpoint
Potassium	K	Indirect potentiometry
Sodium	Na	Indirect potentiometry
Chloride	Cl	Indirect potentiometry
Lithium	Li	Colorimetric
Human chorionic gonadotropin	HCG	Heterogeneous immunoassay	Chemiluminescence (LOCI)
C-reactive protein	CRP	Immunoturbidimetric	Immunonefelometric
Cardiac troponin I	cTNI	Heterogeneous immunoassay	Chemiluminescence (LOCI)
N-terminal pro-brain natriuretic peptide	NT-proBNP	Heterogeneous immunoassay	Chemiluminescence (LOCI)

The selected test materials (Table 2) were reference materials from human serum or urine in order to be as similar as possible to the clinical samples. This quality control material was purchased from BioRad Laboratories Inc. (CA, USA). All of them were liquid, ready to use and they were stored and manipulated according to manufacturer recommendations. Vials which have been opened for more than two days were rejected.

Table 2.

Quality control materials and pooled patient samples.

Analyte	Study material
Alb, PT, Chol, Tg, TBil, DBil, Phos, Mg, LiGGT, CK, ALP, ALT, AST, AMY, LD	Liquid Assayed Multiqual (*)
Glu	Liquid Assayed Multiqual (*)
	Assayed Liquicheck Urine (#)
	Plasma Pool GLU (V)
BUN, Cre, UricA	Liquid Assayed Multiqual (*)
	Assayed Liquicheck Urine (#)
	Plasma Pool A, Plasma Pool B
	Urine Pool (V)
Ca, Na, K, Cl	Liquid Assayed Multiqual (*) Plasma Pool A and Pool B (V)
cTNI, NT-proBNP	Cardiac Marker Plus LT (I)
CRP	Cardiac Marker Plus LT(I) Elevated CRP (II)
	Plasma Pool CRP (V)
Amon	Etanol/Ammonia (III)
HCG	Immunoassay plus (IV)
UCFP	Assayed Liquicheck Urine (#) Urine Pool
	UCFP (VI)

Assayed Multiqual levels 1 and 3 (lot number 45580)

Assayed Liquicheck Urine levels 1 and 2 (lot number 62880)

Cardiac Marker Plus LT Trilevel (lot number 23470)

Elevated CPR level 3 (lot number 35260)

Ethanol/Ammonia levels 1 and 3 (lot number 51640)

Immunoassay plus levels 1 and 3 (lot number 40730)

Pool A (low concentration patients plasma samples pool), Pool B (high concentration patients plasma samples pool), Plasma Pool GLU (patients plasma samples pool), Pool plasma CRP (patients plasma samples pool)

Urine Pool (patients urine samples pool)

Alb - Albumin; ALP - Alkaline phosphatase; ALT - Alanine amino-transferase; Amon - Ammonia; AMY - Amylase; AST - Aspartate amino-transferase; BUN - Urea nitrogen; Ca - Calcium; Chol - Cholesterol; CK - Creatine kinase; Cre - Creatinine; GGT - γ-glutamyl transferase; LD - Lactate dehydrogenase; UricA - Uric acid; DBil - Direct bilirubin; TBil -Total bilirubin; Phos - Phosphorus; Glu - Glucose; Mg - Magnesium; Tg - Triglycerides; UCFP - Urinary/cerebrospinal fluid protein; TP - Total protein; K - Potassium; Na - Sodium; Cl - Chloride; Li - Lithium; HCG -Human chorionic gonadotropin; CRP - C-reactive protein; cTNI - Cardiac troponin I; NT-proBNP - N-terminal pro-brain natriuretic peptide.

Pooled patient samples from plasma and urine were used to complete the study for some constituents. Their concentrations were set near medical decision levels. After centrifugation at 3500 rpm for 10 minutes all plasma and urine pools were separated, aliquots were made and frozen at −20 °C until analysis (5 days). Prior to use, following the laboratory procedure, they had been laid at room temperature until they had thawed out and homogenized before analysis.

Laboratory acceptance criteria of analytical performance are shown in Table 3. Based on our former experience with Dimension RxL Max we assume the same criteria previously established as laboratory quality specifications. Imprecision and bias results should not exceed the respective acceptance criteria based on biological variation established by laboratory (13–15).

Table 3.

Analytical quality acceptance criteria (imprecision, bias and total error) established by the laboratory.

Acceptance criteria	Analyte
Biological variation Minimum	Alb, ALP, Ca, Cl, Cre, Mg, Na, TP, UricA
Biological variation Desirable	AMY, AST, BUN, cTNI, Glu, K, LD, NT-proBNP, Phos, Chol, CRP
Biological variation Optimum	ALT, CK, DBil, GGT, TBil, Tg, UCFP
P50 EQAP (*)	HCG, Li
Manufacturer claims	Amon

External Quality Assurance Program of the Spanish Society of Clinical Chemistry and Molecular Pathology (SEQC).

Alb - Albumin; ALP - Alkaline phosphatase; ALT - Alanine aminotransferase; Amon - Ammonia; AMY - Amylase; AST - Aspartate aminotransferase; BUN - Urea nitrogen; Ca - Calcium; Chol - Cholesterol; CK - Creatine kinase; Cre - Creatinine; GGT - γ-glutamyl transferase; LD - Lactate dehydrogenase; UricA - Uric acid; DBil - Direct bilirubin; TBil -Total bilirubin; Phos - Phosphorus; Glu - Glucose; Mg - Magnesium; Tg - Triglycerides; UCFP - Urinary/cerebrospinal fluid protein; TP - Total protein; K - Potassium; Na - Sodium; Cl - Chloride; Li - Lithium; HCG -Human chorionic gonadotropin; CRP - C-reactive protein; cTNI - Cardiac troponin I; NT-proBNP - N-terminal pro-brain natriuretic peptide.

Imprecision

After the preliminary familiarization phase (five days, 50 test per each parameter, 1500 patient analyses in total), the procedure was performed over a twenty day period. According to the recommendations of CLSI EP5-A2 document, the following steps were carried out per day: two runs of control samples material and pooled patient samples were analyzed daily. There was a maximum delay interval of two hours between the analyses in each device. Each run consisted of two replicates. Analysis was conducted by using a different aliquot per replicate. The run was discarded if there was any problem in quality control, procedures or any operating difficulty. Between each run the order of analysis of pooled patient samples and quality control material were interchanged.

To interpret the imprecision results different coefficients of variation (CV %) were calculated from all data (repeatability, between-run, between-day and within-laboratory imprecision). Results are expressed as within-laboratory imprecision per analyte and quality control material and it was compared with the allowable imprecision established by laboratory.

Systematic error or bias

Systematic error (SE) was estimated from experimental data obtained according to CLSI EP15-A2 document. Data were compiled upon every analyte and quality control level. Throughout this paper the term bias estimation is assumed to be equal to SE.

To interprete the bias results, bias was expressed as the difference between the average result that has been obtained for each parameter and the accepted reference value from a third party interlaboratory quality control program (Unity Real Time software, BioRad Lab) and it is expressed in terms of percent difference related to expected value (%). As accepted reference value, the cumulative media of the peer group from the third party quality control (BioRad Lab) was assumed (16).

Depending on the test, the peer group included 27–34 laboratories. The average number of the data included in the peer group was approximately 7000, though it varied from one parameter to another. The minimum data for any test was 5000, apart from urea nitrogen (N = 1988, provided by 13 laboratories).

The obtained values are compared with the allowable systematic error based on biological variation established by the laboratory as showed in Table 3.

Verification of comparability of patient results with the previous device

Forty randomly selected patient samples from the emergency laboratory, regardless of their clinical conditions were performed in two runs. Samples were analyzed in one of the Dimension Vista devices (V-1) and Dimension RxL on the same day of venous collection.

Analyses procedure followed the recommendations of document from CLSI (CLSI EP9-A2). Daily analysis of eight patient samples was undergone over a five day period. Two replicates of the samples were analyzed in the new device V-1. Later, within a 2 hour interval, the same samples were performed by the comparative procedure, also by duplicate.

To interpret the comparability verification results, the difference between the current method and the candidate replacement is considered as follows: Confidence interval of the estimated difference should include the laboratory acceptable error at the medical decision level. Total allowable error (TEa) also based on BV was considered as the criteria for comparison study.

Results

Tables 4 to 6 show the individual results of imprecision and bias evaluation of the two Dimension Vista analysers. They are grouped depending on the compliance degree of each parameter.

Table 4.

Analytes that fulfil laboratory acceptance criteria for imprecision and bias in both analyzers.

Control Material
Analyte (units)	Quality control level	Imprecision (%)			SE (%)
		QS	CV V-1	CV V-2	QS	PD V-1	PD V-2
ALT (U/L)	175	6.1	1.74	1.2	6	−2.01	−3.7
AMY (U/L)	322	4.4	1.6	1.14	7.4	1.16	5.47
Amon (μmol/L)	32.13366.28	10 (*)	9.931.6	6.61.14	10 (*)	8.190.71	6.762.93
AST (U/L)	240	6	2.89	1.25	5.4	−2.04	−2
HCG (IU/L)	4.18376.28	7 (#)	2.575.51	4.086.1	7(#)	−5.211.21	−5.5−2.85
BUN (mmol/L)	10.550.34	6.2	3.591.95	3.111.44	5.5	−0.390.22	−2.12−1.83
Chol (mmol/L)	2.645.44	2.7	1.751.6	0.910.83	4	−1.6−0.42	−2.45−2.45
cTNI (μg/L)	0.050.682.95	10	9.484.525.23	7.962.763.89	16.1	7.0413.0910.15	−3.185.065.1
CK (U/L)	76592	5.7	2.191.96	1.450.47	5.8	−0.05−0.01	0.98−2.47
DBil (μmol/L)	3.4237.63	6	64.91	4.534.96	11.4	5.47−0.42	−7.028.11
GGT (U/L)	157	3.5	1.34	0.68	5.4	−0.96	−2.25
LD (U/L)	91	4.3	3	4.02	4.3	1.33	3.47
Li (mmol/L)	0.52.35	5(#)	4.241.73	3.832.94	5(#)	−1.55−0.67	4.970.79
NT-proBNP (ng/L)	591382.044	10.44	7.584.58.2	1.721.455.1	10.4	−5.573.232.15	−0.05−6.321.32
CRP (nmol/L)	75.811904.80	10.55	5.565.73	2.972.6	10.9	7.527.92	1.170.22
TBil (μmol/L)	8.55111.18	6	5.992.56	5.881.48	11.4	−0.51.14	0.54.73
Tg (mmol/L)	0.952.29	5.2	2.733.51	54.43	5.3	−3.07−5	−0.49−2.84
TP (g/L)	42.2067.70	2	1.821.65	1.371.15	1.8	0.590	0.89−1.14
UricA (μmol/L)	207.60576.41	4.5	2.422.78	4.413.63	4.9	−3.410.02	2.57−0.96
UCFP (g/L)	240747.4	19.8	5.528.04	6.188.83	10.9	−6.71−0.3	−2.921.63

QS - Quality specification; SE - Systematic error; CV - Coefficient of variation; MC - Manufacture claims; PD - Percent difference related to expected value;

P50 EQAP,

Alb - Albumin; ALP - Alkaline phosphatase; ALT - Alanine aminotransferase; Amon - Ammonia; AMY - Amylase; AST - Aspartate aminotransferase; BUN - Urea nitrogen; Ca - Calcium; Chol - Cholesterol; CK - Creatine kinase; Cre - Creatinine; GGT - γ-glutamyl transferase; LD - Lactate dehydrogenase; UricA - Uric acid; DBil - Direct bilirubin; TBil - Total bilirubin; Phos - Phosphorus; Glu - Glucose; Mg - Magnesium; Tg - Triglycerides; UCFP - Urinary/cerebrospinal fluid protein; TP - Total protein; K - Potassium; Na - Sodium; Cl - Chloride; Li - Lithium; HCG -Human chorionic gonadotropin; CRP - C-reactive protein; cTNI - Cardiac troponin I; NT-proBNP - N-terminal pro-brain natriuretic peptide.

Table 6.

Analytes that need further review in both analyzers.

Control Material
Analyte (units)	MDL	Imprecision (%)			SE (%)			Total error (%)
		QS	CV V-1	CV V-2	QS	PD V-1	PD V-2	QS	TE V-1	TE V-2
Na (#) (mmol/L)	110153	0.5	0.580.92	0.850.96	0.5	0.31−0.03	0.540.19	1.32	1.271.55	1.941.77
Cl (#) (mmol/L)	74121	0.9	0.851.27	1.051.09	0.7	−1.03−0.72	−0.35−1.07	2.21	2.702.82	2.082.87
Mg (#) (mmol/L)	0.452	2.7	2.551.79	6.041.82	2.8	3.034.39	2.69−0.03	7.21	7.247.34	12.663.03

MDL - Medical decision levels; QS - Quality specification; CV - Coefficient of variation; SE- Systematic error; PD- Percent difference related to expected value; Na - Sodium; Cl - Chloride; Mg - Magnesium.

Manufacturer claim (MC): Sodium MC for imprecision: 4.5 % at 120 mmol/L and 2.99% at 164 mmol/L. Chloride MC for imprecision: 4.24% at 99 mmol/L and 3.98% at 123 mmol/L. Magnesium MC for imprecision: 9.58% at 1.05 mmol/L and 12.38% at 5.25 mmol/L.

Table 4 represents all parameters which fulfil both imprecision and bias requirements in both analyzers. On the other hand, Table 5 highlights those parameters that do not reach the analytical requirement of imprecision or bias but they fulfil total error objectives (TEa = Bias + 1.65 × CV).

Table 5.

Analytes within total allowable Error (TEa) in both analyzers.

Control Material
Analyte (units)	MDL	Imprecision (%)			SE (%)			Total Error (%)
		QS	CV V-1	CV V- 2	QS	PD V-1	PD V-2	QS	V-1	V-2
Alb (g/L)	24.2038.50	2.3	2.262.02	2.752.79	2	−0.40.06	1.030.39	5.8	4.133.39	5.574.99
ALP (U/L)	298	3.2	4.32	2.8	6.4	3.93	11	17.52	11.06	15.62
Ca (mmol/L)	1.403.10	1.4	1.801.09	1.220.56	1.3	0.490.16	1.250.4	3.6	3.461.96	3.261.32
Cre (μmol/L)	64.53598.47	4	6.253.21	3.040.45	5.7	1.720.96	0.321.19	12.2	12.036.26	5.341.93
Glu (mmol/L)	3.3319.76	2.9	1.991.6	2.281.44	2.2	0.580.07	3.071.3	6.9	3.862.71	6.833.68
K (mmol/L)	2.097.11	2.4	2.91.74	−2.830.94	1.8	1.020.11	0.790.53	8.7	5.812.98	5.462.08
Phos (mmol/L)	0.622.20	4.3	2.81.67	5.355.31	3.2	2.960.48	0.130.07	10.2	7.583.24	8.968.83

MDL - Medical decision levels; QS - Quality specification; CV - Coefficient of variation; SE - Systematic error; PD - Percent difference related to expected value; Alb - Albumin; ALP - Alkaline phosphatase; Ca - Calcium; Cre - Creatinine; Glu - Glucose; K - Potassium; Phos - Phosphorus; UCFP - Urinary/cerebrospinal fluid protein.

Analytes that did not fulfil any requirement are shown in Table 6. These analytes were considered to be in a special situation and were evaluated independently.

Regarding electrolytes specifically sodium and chloride, it is widely known that due to the current “state of the art” it is difficult to fulfil BV criteria (17). In fact, as a result of this evaluation, we do not reach the minimum imprecision BV criteria. Some actions were performed in order to achieve a better control of these parameters (such as cleaning system review, increasing maintenance protocols, water purification supplies review, etc).

Magnesium did not fulfil all the established analytical performance requirements. One of the devices had greater imprecision and the other showed greater bias than established by the laboratory as quality specifications. Therefore magnesium, as well as sodium and chloride, needed more actions to improve its performance. These included acting over preventive maintenance, improving calibrator stability by changing its storage conditions (frozen versus refrigerated) and even more, calibrator value was reassigned by the manufacturer.

Nevertheless, these three parameters (sodium, chloride and magnesium) fulfilled manufacturer claims (Table 6) and the Spanish minimum consensus quality specifications (17).

On the other hand, the verification of comparability of patient results is shown in Table 7.

Table 7.

Verification of comparability of patients results with the previous device.

Analyte (units) (measuring range)	MDL	Allowable difference (%)	Estimated difference	95% CI		Allowable difference at MDL
Alb (g/L) (9–53)	20	5.90	0.4	0.2	0.7	1.2
	35		−0.4	−0.7	−0.1	2.1
	52		−1.4	−2.0	−0.7	3.1
ALP (U/L) (34–495)	400	17.52	−68.0	−74.1	−61.8	70.1
ALT (IU/L) (9–529)	60	16	−7.8	−10.4	−5.3	9.6
	300		1.1	−4.5	6.7	48.0
Amon (μmol/L) (46–390)	91	10	7.1	−5.5	19.8	9.1
	365		−5.9	−11.3	−0.6	36.5
AMY (U/L) (5–1513)	50	14.6	−4.3	−7.3	−1.4	7.3
	120		−9.7	−12.6	−6.8	17.5
	200		−15.8	−18.7	−12.9	29.2
AST (IU/L) (4–491)	60	15.2	−4.7	−6.3	−3.1	9.1
	300		−5.2	−10.1	−0.2	45.6
HCG(*) (IU/L) (0–30919)	5	5.20	−0.2	−2.5	2.1	0.3
	604		8.1	3.8	12.5	31.4
BUN (mmol/L) (4.6–58.2)	4.6	15.70	0.5	0.2	0.8	0.7
	19.9		0.1	−0.1	0.3	3.1
	38.2		−0.4	−0.9	0.1	6.0
Ca (mmol/L) (1.73–3.40)	1.75	3.6	0.03	−0.00	0.06	0.06
	2.75		−0.07	−0.09	−0.04	0.10
	3.38		−0.12	−0.14	−0.10	0.12
Chol (mmol/L) (1.30–9.12)	2.33	8.5	0.0	−0.1	0.1	0.2
	5.18		−0.2	−0.2	−0.1	0.4
	6.22		−0.2	−0.3	−0.2	0.5
	6.73		−0.3	−0.4	−0.2	0.6
	9.07		−0.4	−0.6	−0.3	0.8
CK (U/L) (6–2198)	100	15.2	0.9	−5.1	6.9	15.2
	240		−8.5	−14.0	−2.9	36.5
	1800		−113.2	−140.4	−85.9	273.6
Cl (mmol/L) (90–120)	90	2.2	−1.4	−3.5	0.7	2.0
	112		−1.1	−2.0	−0.3	2.5
cTNI (*) (μg/L) (0.000–31.750)	0.045	10.00	0.03	0.24	0.19	0.01
Cre (μmol/L) (42–1591)	53	12.24	5.3	3.6	7.1	5.6
	141		7.2	5.7	8.9	15.0
	530		15.8	9.4	22.2	56.0
GGT (U/L) (5–686)	20	11.10	−2.1	−6.3	2.2	2.2
	50		2.9	−6.8	1.0	5.6
	150		5.7	−9.2	−2.3	16.7
Glu (mmol/L) (2.39–12.21)	2.50	6.90	−0.09	−0.25	0.07	0.17
	6.66		−0.13	−0.19	−0.06	0.46
	9.99		−0.16	−0.28	−0.03	0.69
K (mmol/L) (2.4–7.8)	3.0	5.8	0.01	−0.02	0.04	0.17
	5.8		−0.20	−0.24	−0.17	0.34
	7.5		−0.33	−0.40	−0.27	0.44
LD (U/L) (103–786)	150	11.40	−2.1	−11.7	7.6	17.1
	300		−20.5	−28.1	−12.9	34.2
	500		−45.1	−58.2	−32.0	57.0
Mg (#)(mmol/L) (0.55–2.50)	0.60 (#)	7.20	0.10	0.08	0.12	0.04
	1.00		0.06	0.05	0.08	0.07
	2.50		−0.07	−0.08	−0.05	0.18
Na (mmol/L) (112–154)	115	1.30	1.3	0.7	1.9	1.5
	135		−0.3	−0.9	0.3	1.8
	150		−1.5	−2.5	−0.4	1.9
NT-proBNP (*) (ng/L) (4.0–7379.8)	125.0	27.60	109.5	26.0	193.1	34.5
	450.0		162.1	85.0	239.2	124.2
	2985.1		571.8	444.5	699.1	823.9
CRP (nmol/L) (19.1–10502.9)	285.7	56.6	73.1	−179.4	325.4	161.7
	952.4		93.8	−143.8	331.44	539.1
	9524.0		361.3	174.4	548.11	5390.6
Phos (mmol/L) (0.48–2.68)	0.48	10.20	−0.05	−0.06	−0.03	0.05
	0.81		−0.04	−0.05	−0.03	0.08
	1.62		−0.03	−0.04	−0.00	0.16
TBil (μmol/L) (3.4–345.1)	24.0	15.50	−0.7	−1.0	−0.3	3.7
	42.8		−1.6	−2.0	−1.2	6.6
	342.1		−16.4	−19.3	−13.4	53.0
Tg (mmol/L) (0.46–4.60)	1.69	14.00	0.15	0.12	0.18	0.24
	4.52		0.23	0.15	0.32	0.63
TP (g/L) (42–81)	45	5.20	−0.7	−1.5	0.1	2.3
	60		−0.7	−1.0	−0.3	3.1
	80		−0.6	−1.5	0.2	4.2
UricA (μmol/L) (83.3–690.0)	119.0	12.40	−4.9	−8.9	−1.0	14.8
	475.9		−1.6	−19.2	−7.7	59.0
	636.5		−17.3	−29.0	−7.9	78.9

Methodological changes and non interchangeable results.

Non-interchangeable.

MDL - Medical decision levels; PD - Percent difference related to expected value; Alb - Albumin; ALP - Alkaline phosphatase; ALT - Alanine aminotransferase; Amon - Ammonia; AMY - Amylase; AST - Aspartate aminotransferase; BUN - Urea nitrogen; Ca - Calcium; Chol - Cholesterol; CK - Creatine kinase; Cre - Creatinine; GGT - γ-glutamyl transferase; LD - Lactate dehydrogenase; UricA - Uric acid; DBil - Direct bilirubin; TBil - Total bilirubin; Phos - Phosphorus; Glu - Glucose; Mg - Magnesium; Tg - Triglycerides; UCFP - Urinary/cerebrospinal fluid protein; TP - Total protein; K - Potassium; Na - Sodium; Cl - Chloride; Li - Lithium; HCG - Human chorionic gonadotropin; CRP - C-reactive protein; cTNI - Cardiac troponin I; NT-proBNP - N-terminal pro-brain natriuretic peptide.

All the parameters performed by the same methodology were interchangeable with the previous device, except magnesium in which significant differences were found. Analytical conditions and reference intervals were reviewed, showing no additional problems. Finally this issue was solved as the manufacturer changed the calibrator assigned value after conducting an interim review process. The change was intended to better align the Dimension Vista magnesium results with the reference method, atomic absorption, particularly at the low end of the assay range (Siemens HD Support Bulletin DV-1034_MG Dimension Vista® CHEM 1 Calibrator).

The parameters with methodological changes such as cTNI, NT-proBNP and CRP obviously showed that patient results were not interchangeable.

Discussion

Patients belonging to a healthcare system, at some stage within their life, may encounter different systems of measurements within the same institution. This may be the case even during a single clinical event. It forces the laboratory, as a critical point, to control and ensure that all the results that may be issued are comparable (18). In addition to this, the laboratory must ensure that they are incorporated into each patient’s medical record, without distorting or creating errors which may affect the interpretation of their results (19) and CLSI recommends to control this aspect as a means of risk management (6,7).

In addition, this represents an ISO 15189:2007 requirement and accreditation bodies must review that laboratory had performed all the necessary mechanisms to ensure this issue.

The flexible scope in the accreditation process (2–4) implies that laboratory assume responsibility for the management of all or part of its scope of accreditation without the necessity of a preliminary evaluation by the Accreditation Body for each new activity. For which reason, the laboratory must demonstrate to the accreditation body that it has the technical competence in evaluating methods prior to use on patient samples. As an accredited laboratory this enables it to incorporate a new test into its accredited scope on the basis of its own validations without waiting for the evaluation by the accreditation body prior to the next audit or having to undergo an extraordinary audit.

The strength of the flexible scopes of accreditation is based on the capability of the laboratory’s management system on the implementation of the validation and/or verification procedures and the monitoring activities related to their implementation (appropriateness of claims, personnel competence, estimations of measurement uncertainty, equipment and measurement traceability, proficiency testing activities and internal quality control).

In this context accreditation body evaluation is focused on laboratory validation activities. That implies that the laboratory has to develop a well organized and documented procedure of validation of the measurement system so that it could be able to demonstrate the adequacy of the system in an easy and reproducible way. This is very important in order to shorten the time of evaluation and reducing the impact of the economical and human resources expenses, increasing the laboratories’ effectiveness.

On the other hand, the main objective of the laboratory is to serve as a diagnostic tool as well as monitoring a treatment or a disease evolution. In this context, it is necessary to ensure that the analytical quality of the results fulfil their clinical needs. Our laboratory established biological variation as the criteria which enable this (12).

Nevertheless, all procedures to guarantee analytical quality should be performed in a standardized way. For every kind of evaluation our studies follow the CLSI protocols, recognized worldwide. This includes EP5 for imprecision, EP15 for bias estimation and EP9 for method comparison.

One of the remarks that CLSI highlights in these studies is the kind of selected material. It is recommended to be as similar as possible to patient samples. The other remarkable need is the concentration at which clinical decision is made. They should be as near as possible to the medical decision levels. Samples selected in our studies are quality control material from human matrix and they are complemented with patient samples pools from plasma or urine for some parameters of interest. All comparison studies were performed on patient samples.

The medical literature deals with these kinds of issues by approaching only a few parameters at one time (20–22). Other studies only deal with a single analytical performance evaluation (23,24). There are not many articles that include all routine biochemistry parameters in the same procedure (25,26) covering the main evaluation protocols. On the other hand, the majority of studies set the manufacturer claims as quality objectives (25–27). Biological variation which constitutes the analytical objectives of our study is generally more stringent than manufacturer claims (28).

Related to the evaluation of analytical performance of Dimension Vista, 27 of 30 studied parameters fulfilled all analytical criteria. Even though 7 of them did not reach the desired imprecision or bias, all were less than TEa, therefore all were considered within acceptance criteria.

If an analyte shows results greater than the allowable imprecision or bias, but are less than the total allowable error (the maximum acceptability limit for laboratory), it could be considered acceptable.

The 3 parameters that did not fulfil the analytical requirements (sodium, chloride and magnesium) needed further evaluations and actions before being used on clinical patients. All fulfilled manufacturer claims and also the minimum consensus analytical specifications derived by the “state of the art” that has been published, as well as other well known specifications (17,29–31). As previously described, these actions included changes in maintenance protocols, review of water supply conditions, changes in storage conditions of calibrators and reassignation of calibrator values.

Due to the thorough nature of the study, we were able to highlight some analytes with poor analytical performance that otherwise could be overlooked. This is one of the main benefits from the study since we could apply a more stringent quality control strategy over these parameters, having a positive impact on clinical practice.

On the other hand, this study considers the use of biological variation criteria as an analytical quality objective instead of using other wider objectives. Depending on the laboratory resources and the “state of the art”, some of these quality specifications might be unrealistic. If the actual objective is not achievable in a long term monitoring, after acting in a corrective way, it is important to consider the possibility of changing the quality objective. In that case, if the chosen objective is down in the Stockholm hierarchy, the laboratory must assume that the level of quality necessary to satisfy medical needs may not be fulfilled.

This was not our case because TEa biological variation specifications were mostly reached, as was confirmed in the monthly laboratory periodic evaluations.

All parameters included in the new technological improvement (LOCI) (32) obtained better analytical performance than previous methodologies: cTNI, NT-proBNP as well as CRP by nephelometrical assay.

Regarding these parameters, some changes have been made. For instance, a new 99 Percentile cutoff for cTNI was established (0.04 ng/mL) highlighting that imprecision less than 10% can be obtained for this cut-off (33,34). Clinicians were alerted about this new diagnostic point by means of multi-disciplinary clinical seminars, written warnings, etc.

Regarding the verification of comparability of patient results with the previous device, all parameters performed by similar methodologies were interchangeable, except magnesium.

In the case of magnesium, significant differences were found at the medical decision levels for hypomagnesaemia diagnosis which is relevant in children with kidney transplant for instance. Clinicians were alerted about the possibility of new reference population values and advised that every individual patient should have been carefully analyzed and compared with their historical record. Finally, the problem was solved with the new calibrator assigned value by the manufacturer.

These evaluations illustrate that even same methodology and same manufacturer can give non-interchangeable patient results. In addition, a different device of the same model can produce different analytical performance.

In summary, a new device installation should always be validated by the laboratory due to the fact that different working conditions can influence patient results. This kind of evaluation procedure should always be performed prior to use on patient samples. Therefore, laboratory can demonstrate some limitations that otherwise could be overlooked.

Dimension Vista showed a generally good acceptable analytical performance according to biological variation criteria but technical supervising should be necessary for some parameters such as sodium or chloride. Some other parameters met biological variation criteria except at the medical decision levels (creatinine, magnesium) and would require the application of extreme quality control procedures.

The benefit of having a flexible scope of accreditation is to be able to include additional or new activities as accredited from the first patient result. In that way it is not necessary to be previously evaluated by the Accreditation Body. Laboratories having flexible scopes can reduce the economical impact of technical innovations increasing their laboratory effectiveness.