Evaluation of a new handheld instrument for the detection of counterfeit artesunate by visual fluorescence comparison.

There is an urgent need for accurate and inexpensive handheld instruments for the evaluation of medicine quality in the field. A blinded evaluation of the diagnostic accuracy of the Counterfeit Detection Device 3 (CD-3), developed by the US Food and Drug Administration Forensic Chemistry Center, was conducted in the Lao People's Democratic Republic. Two hundred three samples of the oral antimalarial artesunate were compared with authentic products using the CD-3 by a trainer and two trainees. The specificity (95% confidence interval [95% CI]), sensitivity (95% CI), positive predictive value (95% CI), and negative predictive value (95% CI) of the CD-3 for detecting counterfeit (falsified) artesunate were 100% (93.8-100%), 98.4% (93.8-99.7%), 100% (96.2-100%), and 97.4% (90.2-99.6%), respectively. Interobserver agreement for 203 samples of artesunate was 100%. The CD-3 holds promise as a relatively inexpensive and easy to use instrument for field evaluation of medicines, potentially empowering drug inspectors, customs agents, and pharmacists. © The American Society of Tropical Medicine and Hygiene.

Introduction

The World Health Organization (WHO) considers counterfeit or falsified (spurious/falsely labeled/falsified/counterfeit [SFFC]) medicines to be a major threat to public health, with counterfeit/falsified and substandard antimalarial pharmaceuticals being a major global public health concern, especially in areas of sub-Saharan Africa and southeast Asia.1–3 A very large epidemic of counterfeit artesunate afflicted mainland southeast Asia over the last decade.4–8 In Africa, there are increasing reports of poor artemisinin-based combination therapies (ACTs), which are the vital mainstay for malaria control.5,9–11 Widespread problems have also been reported for other essential medicines, such as antihelminthics, antibiotics, and antiretrovirals.8,12–15

Analysis of the quality of medicines poses severe problems, because few countries have WHO prequalified reference laboratories for chemical analysis. Three countries in malarious Africa and five countries in malarious Asia have such laboratories, and they are all in capital cities. Such analysis is expensive and requires significant human capacity, sustainable funding, and quality assurance.16 The WHO estimated that 30% of countries have either no medicine regulation in place or a very limited capacity that hardly functions.17,18 Considerable investment is, therefore, needed in building appropriate Medicine Regulatory Authority (MRA) capacity, including the capability for screening and analyzing medicines.9

Although development of centralized laboratories is important, it is also vital to implement analytical tools in the field in warehouses, at border crossings, and in pharmacies, empowering medicine inspectors to screen for medicines that require additional laboratory assessment. Rapid colorimetric tests and the Minilab for thin-layer chromatography analysis have been developed with this implementation in mind.19,20 In addition, many portable instruments are marketed for chemical analysis of medicines, which are based primarily on near-infrared (NIR) and Raman spectroscopy.21–25 However, such instruments may not be quantitative or suitable for all pharmaceutical products, are costly, and require sophisticated software and training. In low- and middle-income countries (L/MICs) in Africa and southeast Asia, rugged, low-cost, easy to use, validated field instruments are needed as screening tools to detect suspect counterfeit and substandard medicines for additional analysis.

Although the details are still debated, there are two main types of poor quality medicines: substandard and counterfeit (the latter is increasingly referred to as falsified in the global arena when intellectual property considerations are not invoked).26 In essence, substandard medicines are produced by authorized manufacturers, but because of errors in production and quality control, they fail to meet required pharmaceutical standards. In contrast, counterfeit or falsified medicines are fraudulent products manufactured with the intent to deceive. The term counterfeit, used by the Food and Drug Administration (FDA) and defined in the US Federal Food Drug and Cosmetic Act,27 applies to a product that falsely bears the trademark, trade name, or other identifying feature and thereby, purports to be an authentic product.

A medicine's packaging provides valuable points of comparison, and detection of differences from known authentic packaging for a given product in addition to chemical analysis are key for the detection of counterfeits. Counterfeit medicines may contain the active pharmaceutical ingredients (APIs), but when present, they are frequently in subtherapeutic quantities.5,6,28 Therefore, an instrument that enables rapid comparison of packaging and product may provide an accurate and less expensive tool for screening suspect medicines. If validated, the Counterfeit Detection Device version 3 (CD-3) combined with field-deployable spectroscopic tools and the Minilab may provide sufficient pharmaceutical quality information to make acceptance/rejection decisions in the field. Over the last 7 years, FDA scientists at the Forensic Chemistry Center (FCC) have developed and deployed several generations of this inexpensive handheld field instrument that can rapidly analyze medicines in real time, allowing onsite/port of entry real-time comparison of the pharmaceutical dosage form and the packaging with authentic examples.29 The current version, the CD-3, has been used routinely to screen suspect pharmaceutical products both at the FCC laboratory and in the field in the United States at border crossings and other points of entry. At the international mail facilities (IMFs) in the United States, the instruments are used by FDA investigators to screen incoming packages for potential counterfeit pharmaceuticals, cosmetics, and medical devices. The CD-3 has also been successfully used in a number of criminal investigations and has screened numerous suspect products in both the laboratory and the field. The CD-3 has been validated and used in the detection of counterfeits of pharmaceutical products commonly imported into the United States (e.g., Lipitor, Plavix, Viagra, and Cialis; FDA, unpublished data). However, no testing had been conducted on antimalarials, and the CD-3 has not been used outside of the United States, where counterfeit and substandard medicines are known to be significant problems. Therefore, the CD-3 was evaluated in the Lao People's Democratic Republic (Laos) with two objectives: to estimate the accuracy of the CD-3 in distinguishing counterfeit from genuine antimalarials as a proof of principle and to determine the interobserver variability in CD-3 interpretation among Laos drug inspectors after brief training on the use of the device.

CD-3 Description

The CD-3 is a compact (15.2 × 7.6 cm; 300 g) handheld electronic tool (Figure 1) with multiple single wavelength light-emitting diode (LED) light sources that cover the spectral region from the ultraviolet (UV) to the infrared (IR).29 The CD-3 features two charged couple device (CCD) cameras that provide the user with the ability to view samples in real time and capture images and videos of the suspect samples being screened. One camera operates in the UV-visible (UV-Vis) spectral region, and the second camera operates in the IR spectral region. It can be battery or mains powered, and a separate digital handheld microscope can be used to examine suspect samples at higher magnifications. The batteries will last between 3 and 8 hours depending on the intensity of use. The LEDs are used to illuminate a sample at user-selected wavelengths (375 and 470 nm) and enable the user to directly visualize product differences using either CCD camera. To put it in terms of a traditional spectrometer (e.g., NIR spectroscope), the LEDs are the light source, and the user's eye is the CD-3 detector. No x–y spectral data are generated or saved with the CD-3. The light from the LEDs interacts with the inks and tablet colors on sample packaging and dosage form surfaces. What the user's eye observes are differences between the suspect dosage form and packaging and an authentic drug. The visual differences observed can take the form of changes in colors, shading, contrast, fluorescence, or a combination of all of these changes. The CD-3 can be used (Figure 2) to verify the presence or absence of overt/covert markings on the packaging. The differences observed in the suspect sample can be attributed to chemical differences between the products (e.g., differences in active ingredient and excipients), colors used in the coatings, or packaging materials (e.g., cellulose materials used in boxes and outserts, inks, print type, etc.). Differences between suspect and authentic dosage forms are readily observed through blister packages, facilitating rapid product screening. The greater the number of visual differences observed using the CD-3 in a suspect sample compared with an authentic sample, the stronger the evidence that the product is counterfeit. The device captures jpeg images at 96 dots per inch (DPI) resolution. Dimensions of each captured image are 720 × 576 pixels (width × length) at 24-bit color depth. At these parameters, each captured image averages a file size of approximately 75 Kb. The device storage is an 8-GB (upgradable to 32 GB) flash drive that can hold approximately 107,000 CD-3 images. The drive is accessible using a personal computer through a Universal Serial Bus (USB) cable connection. Files can be uploaded to the drive or downloaded from the drive.

Figure 1.

The CD-3 current generation of the instrument.

Figure 2.

The testing algorithm used for suspect artesunate tablets.

Methods

All work was conducted at the Microbiology Laboratory, Mahosot Hospital, Vientiane, Laos in July of 2012. The samples were from a library of counterfeit and genuine antimalarials from different manufacturers collected in surveys over the last 10 years (described in refs. 4, 6, and 9 and unpublished data by Newton PN and Tabernero P) and stored at approximately 4°C. All samples had undergone visual packaging analysis with reference to known authentic drugs obtained directly from manufacturers as well as high-performance liquid chromatography (HPLC), mass spectrometry, or Fast Red Dye test assay.19 Counterfeit samples were defined as those failing packaging analysis, and genuine samples were those that passed both packaging and chemical analysis. No samples passed packaging analysis but failed chemical analysis. Because the authentic products had not been analyzed before using the CD-3, a baseline description or library of visual features was created for each authentic antimalarial product (packaging and dosage form) using all of the different CD-3 instrument settings (illumination wavelengths) for two authentic samples and entered into an Excel spreadsheet. The measurements of multiple unique markers for each authentic sample helped resolve any possible discrepancies when examining the suspect samples. Images for each CD-3 setting and responses were documented. The differences observed between genuine and counterfeit packaging are considered law enforcement-sensitive, and therefore, additional details of those observations are not provided.

Three individuals (a pharmacist and two drug inspectors) were initially trained in the use of the CD-3 for 1.5 days. The CD-3 users were then blinded to the authenticity of the specimens until after testing was completed (Figure 2). Interobserver variability was assessed for 102 samples. Over a 3-day period, 203 samples of oral antimalarial artesunate were scanned using the CD-3.

Results

Evaluation of the CD-3.

Two hundred three samples of artesunate tablet blister packs, labeled as manufactured by Guilin Pharmaceutical Co. Ltd. (Guilin, People's Republic of China) with expiration dates ranging between 2001 and 2011, were analyzed. Among the counterfeit artesunate, 14 different counterfeit packaging types were included.6 Only two samples were misclassified—two authentic drugs as defined by packaging and chemical analysis were incorrectly classified as counterfeit by interpretation of CD-3 images (Table 1). The identification of the counterfeit samples was based on the visual appearance of the dosage form and the packaging. In one case, the blister pack was missing (and all tablets had been used in the analysis), and only the box was evaluated; the other sample had different print features from the authentic sample on the expiration and manufacturing information. The specificity (95% confidence interval [95% CI]), sensitivity (95% CI), positive predictive value (95% CI), and negative predictive value (95% CI) of the CD-3 for detecting counterfeit artesunate were 100% (93.8–100%), 98.4% (93.8–99.7%), 100% (96.2–100%), and 97.4% (90.2–99.6%), respectively (Table 1). Examples of key non-covert features revealed by the CD-3 used to identify counterfeit artesunate are shown in Figure 3. Additional CD-3 evaluation of a small collection of other products (artemether-lumefantrine, dihydroartemisinin-piperaquine, and sulphamethopyrazine-pyrimethamine) showed clear differences in the packaging and dosage form of authentic and counterfeit products that were not apparent to the naked eye (data not presented).

Table 1

Comparison between reference assays and CD-3 test results for detection of counterfeit artesunate among 203 samples of oral artesunate labeled as manufactured by Guilin Pharmaceutical Co. Ltd., Guilin, China

	Reference counterfeit	Reference genuine	Total
CD-3 counterfeit	125	0	125
CD-3 genuine	2	76	78
Total	127	76	203

Figure 3.

Examples of differences observed between counterfeit and authentic artesunate tablets and packaging. In general, clear differences between the suspect and the authentic tablets and packaging and many of the comparison features could not be detected with the naked eye. A and B show the interior of the cardboard box dark versus bright (regions are highlighted by white and black arrows, respectively); differences were observed between the (A) counterfeit and (B) authentic carton end flap using a 375-nm wavelength setting on the CD-3. C and D show the (C) absence of tablet debossing details for tablets in AS 50 mg and (D) enhanced tablet debossing details on AS 50 mg. Differences in tablet color and blister pack surface patterns (regions highlighted by white and black arrows, respectively) were observed between the (C) counterfeit and (D) authentic tablets in blisters using a 470-nm wavelength setting on the CD-3.

Interobserver variability.

The interobserver agreement between the trainer and the two trainees for 102 samples of artesunate blisters was 100% (κ = 1.0).

Discussion and Conclusions

The CD-3 showed very good accuracy in detecting counterfeit artesunate packaging and tablets, which were fraudulently labeled as manufactured by one company. Minimal training was required, and agreement between the trainer and two trainees was 100%. The availability of authentic samples, provided by the manufacturer, is necessary for comparison with suspect samples. The CD-3 can store an image library of authentic products relevant to the sampling planned and the area involved. Cooperation of the private sector for prompt and secure delivery of authentic examples of their products to MRAs will be important for the accurate use of the CD-3 to establish and maintain up to date image libraries of each product on the CD-3, particularly in developing economic and regulatory environments, where product registration may not occur. Such libraries could be easily shared around the world to MRAs that use the CD-3. However, information on covert markers as well as CD-3 baseline markers will need to be carefully guarded. Furthermore, risk analysis will be needed to minimize escalation of the sophistication and use of counterfeit packaging, which has appeared to happen with artesunate,6 making the task of detecting counterfeit medicines progressively harder. Although this may result in increased sophistication of counterfeiting by criminals, increasing their costs and reducing illicit profit margins, it may also make it more difficult for MRAs to detect counterfeit products in the supply chain and warn patients and pharmacists.

There are several limitations to this study. Although the CD-3 is routinely used for numerous medicine types, we only evaluated it with one medicine type in large numbers; also, interobserver variability only involved two trainees, and a collection of authentic and suspect samples was used rather than a prospective, real-life assessment. We used artesunate oral monotherapy, because we had access to a collection of falsified samples to test the CD-3 as a proof of concept. However, because artesunate monotherapy is no longer the WHO recommended therapy to treat malaria, additional field evaluation with diverse genuine, substandard, and falsified ACTs is required.7 Additionally, more method development with the CD-3 is needed to determine its ability to detect substandard medicines, such as products with reduced amounts of active pharmaceutical ingredients that have been negligently manufactured by authorized manufacturers. Although not the strength of this device, these products may be detected if the manufacturing errors lead to visual differences on the exterior or interior surfaces of the tablet compared with good quality authentic products.

These initial validation results suggest that the CD-3 could be a useful tool; it requires minimal training and can rapidly screen large numbers of medicines in the field for counterfeits in L/MICs, such as Laos. The device is not yet commercially available but likely to cost considerably less than portable chemical analysis instruments, such as Raman or NIR. The CD-3 does not directly analyze the chemistry of the sample, unlike Raman and NIR, which produce interpretable chemical signatures of the tablet constituents. However, it does, through allowing the observer to rapidly recognize visible differences from the genuine samples, facilitate identification of abnormalities in the packaging and tablets. Additional evaluations with other medicines, both falsified and substandard, and in other geographical settings are required. Evaluation of the accuracy and field robustness of the CD-3 compared and combined with portable chemical analysis instruments would help clarify the roles of each modality.