Literature DB >> 24571349

Immunochromatographic diagnostic test analysis using Google Glass.

Steve Feng1, Romain Caire, Bingen Cortazar, Mehmet Turan, Andrew Wong, Aydogan Ozcan.   

Abstract

We demonstrate a Google Glass-based rapid diagnostic test (RDT) reader platform capable of qualitative and quantitative measurements of various lateral flow immunochromatographic assays and similar biomedical diagnostics tests. Using a custom-written Glass application and without any external hardware attachments, one or more RDTs labeled with Quick Response (QR) code identifiers are simultaneously imaged using the built-in camera of the Google Glass that is based on a hands-free and voice-controlled interface and digitally transmitted to a server for digital processing. The acquired JPEG images are automatically processed to locate all the RDTs and, for each RDT, to produce a quantitative diagnostic result, which is returned to the Google Glass (i.e., the user) and also stored on a central server along with the RDT image, QR code, and other related information (e.g., demographic data). The same server also provides a dynamic spatiotemporal map and real-time statistics for uploaded RDT results accessible through Internet browsers. We tested this Google Glass-based diagnostic platform using qualitative (i.e., yes/no) human immunodeficiency virus (HIV) and quantitative prostate-specific antigen (PSA) tests. For the quantitative RDTs, we measured activated tests at various concentrations ranging from 0 to 200 ng/mL for free and total PSA. This wearable RDT reader platform running on Google Glass combines a hands-free sensing and image capture interface with powerful servers running our custom image processing codes, and it can be quite useful for real-time spatiotemporal tracking of various diseases and personal medical conditions, providing a valuable tool for epidemiology and mobile health.

Entities:  

Mesh:

Substances:

Year:  2014        PMID: 24571349      PMCID: PMC3988681          DOI: 10.1021/nn500614k

Source DB:  PubMed          Journal:  ACS Nano        ISSN: 1936-0851            Impact factor:   15.881


Early detection of emerging public health threats is very important to prevent long-term undesired effects and reduce disease burden globally. Over the past decade, lateral flow based immunochromatographic tests or rapid diagnostic tests (RDTs), which are in general based on light scattering off surface-functionalized metallic nanoparticles, have emerged as a quick and cost-effective method to screen various diseases providing complementary approaches to conventional medical practices, such as clinical examination, microscopic analysis, and investigation. RDT technologies have since provided various advantages for tackling public health problems including, but not limited to, more effective tracking/monitoring of chronic conditions, infectious diseases and drugs of abuse in at-risk areas, and widespread medical testing by minimally trained medical personnel or community healthcare workers.[1−20] In parallel, the recent advances in portable wireless telecommunication technologies, especially mobile phones, provide remarkable opportunities for healthcare applications in a variety of fields including epidemic preparedness, public health monitoring, and distributed healthcare systems.[21−31] In addition to mobile phones, of particular interest are emerging wearable electronics devices such as smart watches and glasses with integrated or attachable inertia sensors, audio-visual imaging and recording devices, and wireless connectivity.[32−35] One such promising smart device, the Google Glass, consists of a voice-controllable hands-free computing system with imaging and video-recording capabilities and various wireless technologies including Bluetooth and Wi-Fi (see Figure ). By connecting with Android mobile phones or iPhones through Bluetooth, the Google Glass is also capable of using the cellular device’s telecommunications capabilities to access the Internet in areas without Wi-Fi and determine location information via global positioning systems (GPS) and/or triangulation through cellular service provider towers.
Figure 1

Labeled Google Glass and demonstration of imaging a rapid diagnostic test (RDT). (a) Front-profile view of the Google Glass with various hardware components[36] labeled. (b) Example of using the Glass for taking an image of an RDT as part of our RDT reader application.

Labeled Google Glass and demonstration of imaging a rapid diagnostic test (RDT). (a) Front-profile view of the Google Glass with various hardware components[36] labeled. (b) Example of using the Glass for taking an image of an RDT as part of our RDT reader application. Leveraging the advantages of these new platforms, here we introduce an RDT reader technology integrated on the Google Glass. This wearable computational platform allows for rapid hands-free imaging and processing of any number of RDTs, which can be very useful for disease and medical condition testing and monitoring in remote locations, disaster relief areas, or quarantine zones. The RDTs to be imaged can be either held in the user’s hand (see Figure ) or laid flat on a surface. Using a Quick Response (QR) code[37] identifier, which is custom-designed and attached to each RDT cassette, this system is capable of automatically finding and identifying the type of the RDT of interest, along with other information (e.g., patient data) that can be linked to the same QR code. Adding the ability to recognize and process additional RDT types can then be done on our centralized servers without any need to update the Google Glass RDT reader software. Furthermore, our servers provide a centralized database and Web interface for visualizing uploaded data in the form of a spatiotemporal map, which can be quite useful for short- and long-term spatiotemporal tracking of the evolution of infectious diseases and other conditions. Over the past several years, there has been considerable research and development effort to create automated digital test readers capable of both qualitative and quantitative analysis of RDTs.[38−47] These have mainly appeared in the form of bulky but high-throughput desktop readers which generally read only a specific set of RDTs. More recently, mobile-phone-based readers capable of working with a number of tests have also been introduced.[48−50] For example, in our previous work,[48] we created a compact and cost-effective RDT reader optical attachment installed on a cell phone that can work with various lateral flow immunochromatographic assays to detect the presence and strength of a target analyte. Other approaches include LMD (Mobile Assay, CO, USA), whom use a custom software application running on a cell phone.[51] However, these mobile technologies do not provide the ability to image and process multiple RDT tests simultaneously and require manual handling of both the RDT test and the mobile phone camera. Here, we replace all the external opto-mechanical hardware attachments with customized image processing techniques to create an RDT reader software application capable of detecting and processing multiple RDTs imaged using the Google Glass built-in camera under natural illumination conditions along with a hands-free sensing and image capture interface. Therefore, our RDT reader application on Google Glass retains the mobile interface while allowing for multiplexed imaging of various types of RDTs from different manufacturers. Utilizing the existing camera module and the continuous wireless connectivity of the Google Glass, we combine this hands-free sensing and image capture interface with powerful servers running our custom image processing codes to merge the advantages of desktop readers with those of mobile readers. Additionally, our system integrates into a global network of lab-on-a-chip applications, allowing for quick retrieval of RDT results through the same Google Glass interface. We tested this Google Glass-based RDT reader platform through human immunodeficiency virus (HIV) and prostate-specific antigen (PSA) rapid tests (see Figure ) by installing our application on Google Glass devices obtained as part of the Google Glass Explorer program. The PSA test is routinely used for prostate cancer screening and surveillance in men. Recent work has suggested that the ratio of free PSA to total PSA (i.e., free plus those bound to other proteins) and the rate of increase in PSA level can collectively predict the presence and aggressiveness of prostate cancer.[52−55] For our proof-of-concept demonstration experiments, we imaged these RDTs under fluorescent illumination indoor conditions with relatively simple backgrounds, for example, walls that are commonly found in buildings. We believe that this wearable RDT reader platform running on Google Glass can be quite useful for epidemiology and mobile-health applications by providing real-time spatiotemporal tracking of various diseases and personal medical conditions through a rapid hands-free and high-throughput imaging interface.
Figure 2

Rapid diagnostic tests used in this work. (a) JAJ International free PSA test; (b) JAJ International total PSA test; (c) OraQuick ADVANCE Rapid HIV-1/2 test; (d) OraQuick In-Home HIV test (approved by the U.S. Food and Drug Administration).

Rapid diagnostic tests used in this work. (a) JAJ International free PSA test; (b) JAJ International total PSA test; (c) OraQuick ADVANCE Rapid HIV-1/2 test; (d) OraQuick In-Home HIV test (approved by the U.S. Food and Drug Administration).

Results and Discussion

System Design

As part of our diagnostic system, we designed a custom Google Glass RDT reader application for capturing RDT images, a Web portal for generating custom QR code-based identifiers and viewing test results, and the server processes for rapid and high-throughput digital evaluation of test results from any number of devices, with results ready within 8 s per test (see Figures and 4). After installing the Google Glass RDT application, the users are able to image new RDTs and view previously evaluated tests. Users must first use our custom-designed Web site to input RDT test information and generate a corresponding QR code identifier, which can then be attached to the tests prior to imaging (see Figures and 4). As the hardware on the Google Glass is ill-suited for computationally intensive tasks, we do not process test images on the device. Instead, RDT images are transferred wirelessly using Wi-Fi or through a Bluetooth-matched device’s wireless connection (e.g., Wi-Fi, GSM, CDMA, etc.) to our servers for rapid digital processing and evaluation (see Figure ). In case wireless connectivity is not available, test results can be stored locally on the Google Glass and automatically uploaded to our servers for processing once connectivity becomes available. After evaluation, test results are securely stored on the server under the Google account registered with the Glass and also sent back to the Google Glass and shown to the user in the form of a Timeline Card populated with the RDT image and test type-specific results (see Figure ).
Figure 3

Block diagram of the rapid diagnostic test (RDT) imaging and processing workflow (a–c) done by the Google Glass application (red dashed frame) and server processes (green dashed frame). In this case, a single RDT is analyzed.

Figure 4

Our custom-designed Web interface of the QR code generator and real-time rapid diagnostic test (RDT) map (available at http://devpc02.ee.ucla.edu/rdtonglass). (a) QR code generator takes in and stores the information for one or more RDTs and produces a QR code identifier to be printed and attached to each physical test. (b) RDTs processed by each user can be viewed on this Google Maps-powered interface. Results can be sorted/searched by various attributes including disease type, test location, time and date, RDT type, etc. Image Credit: Google Maps, Imagery ©2014, Digital Globe, U.S. Geological Survey, USDA Farm Service Agency.

Block diagram of the rapid diagnostic test (RDT) imaging and processing workflow (a–c) done by the Google Glass application (red dashed frame) and server processes (green dashed frame). In this case, a single RDT is analyzed.

RDT Reader Application on Google Glass

The RDT reader application appears on the Google Glass as a static card in the Google Glass Timeline. Through this digital card, the user can start the process of taking images of QR code-labeled RDTs. The QR code label for each test is printed after filling in a form on our custom-designed Web site (http://devpc02.ee.ucla.edu/rdtonglass), where the user can input various RDT parameters including the test type (for example OraQuick ADVANCE Rapid HIV-1/2 antibody test, OraQuick In-Home HIV test,[56−59] JAJ Free PSA, JAJ Total PSA[60−62]), lot number, and patient ID, etc. (see Figure ). Our custom-designed Web interface of the QR code generator and real-time rapid diagnostic test (RDT) map (available at http://devpc02.ee.ucla.edu/rdtonglass). (a) QR code generator takes in and stores the information for one or more RDTs and produces a QR code identifier to be printed and attached to each physical test. (b) RDTs processed by each user can be viewed on this Google Maps-powered interface. Results can be sorted/searched by various attributes including disease type, test location, time and date, RDT type, etc. Image Credit: Google Maps, Imagery ©2014, Digital Globe, U.S. Geological Survey, USDA Farm Service Agency. After starting a new test, a camera preview will appear in the Google Glass viewing window with a vertical test outline overlay to assist the user in placing or holding the RDT at a specified distance and orientation. The size and orientation of the RDT in the captured image is important for several reasons. All Google Glass camera system hardware iterations up to now seem optimized for capturing images >2 ft away from the camera. These systems did not include an adjustable lens on the camera, and therefore, they result in out-of-focus blur for imaging of objects closer to the Glass. Thus to maximize resolution while preventing significant focus blur, we chose an overlay size occupying approximately 70% of the vertical resolution of the Glass. To reduce shadowing on the strip region by the RDT casing, we orient the overlay vertically under the assumption that light sources will be strongest above and below the test cassette. Additionally, the activation and imaging procedures for some RDTs such as the OraQuick HIV tests require the test remain vertical. After aligning the RDT into the overlay, the user can then take the image by tapping on the touchpad of the Glass or through the voice-activated image capture interface of Glass. In future iterations, QR code-activated automated imaging can also be implemented. The captured Glass image then undergoes Google’s automatic image enhancement to produce a higher contrast smoothened image, which typically requires <3 s. After showing the enhanced image to the user through the Glass interface, this image is uploaded to our servers for further processing as detailed in Figure . Next, the server processes the test image, and the result is returned to the Glass and displayed to the user in the form of a “result card”, posted to the Timeline (see Figure ), populated with the cropped image region, test type, test validation (valid/invalid), and assessment of the diagnostic results (positive/negative and/or concentration level, for qualitative and quantitative tests, respectively). Evaluated tests can also be viewed independently on a real-time RDT monitoring server through an Internet browser. Test results are shown geographically using Google Maps and in more detail through a table that is filterable by RDT or specific parameters of the patient and/or disease (see Figure ).

Glass-Based HIV and PSA Testing Results

We validated the ability of our Google Glass-based RDT reader platform to perform both qualitative decisions and quantitative measurements for several lateral flow-based immunochromatographic RDTs (see Figure ). For qualitative validation, we used the FDA-approved OraQuick In-Home HIV test and the OraQuick ADVANCE Rapid HIV-1/2 antibody test (OraSure Technologies, Inc., PA, USA). For quantitative test validation, we used free and total PSA Rapid tests (JAJ International, Inc., CA, USA). To activate these HIV and PSA tests, we used OraQuick ADVANCE Rapid HIV-1/2 antibody test kit positive and negative controls (OraSure Technologies, Inc., PA, USA) containing HIV-1 and HIV-2 antibodies in human plasma and free and total PSA positive and negative controls provided by the test manufacturer (JAJ International, Inc., CA, USA) containing free PSA and total PSA (free PSA with PSA-ACT) in serum, respectively. We started by evaluating the performance of our Glass platform for making qualitative decisions on OraQuick HIV RDTs. After activating these RDTs using the OraQuick positive controls for HIV-1 and HIV-2 separately and the OraQuick negative control as specified by the manufacturer, we marked each RDT using a QR code identifier generated using our online tool. We then validated test results visually and confirmed detection and evaluation of negative and positive HIV-1 and HIV-2 test lines using our RDT reader. We note that the OraQuick ADVANCE Rapid HIV-1/2 antibody tests and OraQuick In-Home HIV tests did not have significant differences at the same activation concentration levels and were thus used interchangeably in our testing procedures. To demonstrate the performance of our Glass software system at identifying “difficult” samples, we also imaged and evaluated HIV RDTs activated with highly diluted positive control samples, such that we achieved dilutions of 2-, 3-, 4-, 5-, and 6-fold by adding phosphate buffer solution (PBS) to the manufacturer-provided reagent solution used for activating the HIV RDTs. Visual inspection of these tests noticed much fainter test line responses for higher dilution factors. To test our platform, we imaged each one of our 31 activated HIV RDTs up to 50 times each for a total of 281 images. These images were captured with the RDT held up vertically in front of the Glass (see Figure ) and included some minor tilts of the RDT plane relative to the camera and illumination differences caused by Google’s automatic image enhancement, both of which did not affect our detection accuracy. We first validated our support vector machine-based (SVM)[63−65] approach that requires training a classifier using known labeled (e.g., yes/no) strip images, using a leave-one-out cross-validation technique,[66] the results of which are summarized in Table . This technique trains an SVM classifier on all but one input image and classifies the remaining image using the trained classifier, repeating for all the images in the data set to compile accuracy statistics.[66] This validation achieved correct diagnosis on all the 281 images of OraQuick ADVANCE Rapid HIV-1/2 antibody tests for up to even 5× dilution factors. To further demonstrate the robustness of our technique for OraQuick RDT HIV classification, we activated and imaged a new testing set composed of 12 OraQuick In-Home HIV tests (2 with negative controls; 5 with HIV-1 controls and 5 with HIV-2 controls diluted by 2× to 6×). Each of these tests was imaged up to 35 times for a total of 145 images. We then used the previously imaged 281 images as training data for a new SVM classifier and tested the resulting classifier on these new 145 images, achieving 100% classification accuracy, that is, correctly diagnosing all the activated RDTs (see Table ). We should emphasize that for the set of controls we used, the OraQuick ADVANCE Rapid HIV-1/2 antibody tests and OraQuick In-Home HIV tests, provided sufficiently similar responses that our classifier is capable of using images of these tests “interchangeably” without degradation in classification accuracy. Furthermore, while our training data contained HIV tests activated using positive controls with dilutions from 1× to 5×, our new testing data contained HIV tests activated with dilutions up to 6×, suggesting the possibility that detection of even fainter test lines may be possible using Glass even without specifically training the classifier for those weaker antibody/antigen concentrations.
Table 1

a

(a) Support vector machine (SVM) classifier[63−65] cross-validation results for total training image set of 281 images taken from 18 OraQuick ADVANCE Rapid HIV-1/2 antibody tests, 3 tests for each concentration level (negative, 1×, 2×, 3×, 4×, and 5× dilution). Leave-one-out cross-validation[66] trains an SVM classifier on all but one test image and then tests the trained classifier on the left-out test image. The table compiles validation results for all test images. (b) After training an SVM classifier using all the 281 training images, the SVM classifier is tested on a new test set composed of 145 images taken from 12 OraQuick In-Home HIV tests, 2 tests for each concentration level (negative, 2×, 3×, 4×, 5×, and 6× dilution).

(a) Support vector machine (SVM) classifier[63−65] cross-validation results for total training image set of 281 images taken from 18 OraQuick ADVANCE Rapid HIV-1/2 antibody tests, 3 tests for each concentration level (negative, 1×, 2×, 3×, 4×, and 5× dilution). Leave-one-out cross-validation[66] trains an SVM classifier on all but one test image and then tests the trained classifier on the left-out test image. The table compiles validation results for all test images. (b) After training an SVM classifier using all the 281 training images, the SVM classifier is tested on a new test set composed of 145 images taken from 12 OraQuick In-Home HIV tests, 2 tests for each concentration level (negative, 2×, 3×, 4×, 5×, and 6× dilution). After successfully validating our qualitative (yes/no) performance even under highly diluted control samples, next we moved to evaluating the performance of our Glass platform for making quantitative measurements of PSA RDTs. We activated these RDTs using manufacturer-provided controls at 0, 2, 4, 8, 10, 20, 100, and 200 ng/mL concentrations for free PSA RDTs and at 0, 6, 8, 10, 20, and 40 ng/mL concentrations for total PSA RDTs. As before, each RDT is marked using a QR code identifier generated using our online tool (http://devpc02.ee.ucla.edu/rdtonglass). We activated and imaged 14 PSA tests, activating 1 at each concentration for free and total PSA and imaging the activated test up to 10 times each, under the same illumination conditions with the test held vertically in front of the Glass (see Figure ). After Glass-based imaging and digital processing of these test images as described in the Methods section, we were able to observe linearity between PSA concentration (ng/mL) and the test line intensity values read for both free and total PSA (see Figure ). In our free PSA experiments (Figure ), concentrations above 20 ng/mL start saturating, breaking the linearity of our response curves. We should note that, for assisting early stage diagnosis of cancer, the most relevant free PSA levels are below 20 ng/mL.[61,62]
Figure 5

Calibration curves for free and total PSA under bright fluorescent illumination. (a) Free PSA calibrated using samples taken at 0, 2, 4, 8, 10, and 20 ng/mL (ppb). Additional samples taken at 100 and 200 ng/mL are also shown. (b) Total PSA calibrated using samples taken at 0, 6, 8, 10, 20, and 40 ng/mL.

Calibration curves for free and total PSA under bright fluorescent illumination. (a) Free PSA calibrated using samples taken at 0, 2, 4, 8, 10, and 20 ng/mL (ppb). Additional samples taken at 100 and 200 ng/mL are also shown. (b) Total PSA calibrated using samples taken at 0, 6, 8, 10, 20, and 40 ng/mL. Additionally, to demonstrate the ability of this system for multiplexed RDT processing, we imaged using Glass several sets of the previously activated free PSA and total PSA RDTs placed next to each other on a table (see Figure ). In these 25 images taken with up to four PSA RDTs per image, we correctly detected and evaluated all PSA tests with minimal differences in test line intensity compared to single RDT images taken in front of the Glass. Since our methodology normalizes using the control line, general illumination changes as caused by placing multiple tests farther from the center of the imaging area (see Figure ) do not significantly alter test results compared to those from single RDT images for the same tests.
Figure 6

Multiplexed prostate-specific antigen rapid diagnostic test (RDT) processing example. (a) Starting with the original Glass image, the QR codes are detected using either iterative speeded-up robust features (SURF)[67] matching or edge-based location module detection. (b) Afterward, each QR code is reconstructed and read. (c,d) Each test is processed and quantified to produce a test line value, simultaneously quantifying the free and total PSA (in ng/mL).

Multiplexed prostate-specific antigen rapid diagnostic test (RDT) processing example. (a) Starting with the original Glass image, the QR codes are detected using either iterative speeded-up robust features (SURF)[67] matching or edge-based location module detection. (b) Afterward, each QR code is reconstructed and read. (c,d) Each test is processed and quantified to produce a test line value, simultaneously quantifying the free and total PSA (in ng/mL). In our results presented so far, QR code detection and processing succeeded in 99.6% of all cases. In a separate evaluation of our QR code system, we attached QR codes onto >60 activated HIV and PSA RDTs and took >300 images containing both single RDTs and multiple RDTs both held vertically in front of the Glass and laid on a flat surface. Compared to our previous experiments, we included images of RDTs with motion blur or misaligned RDTs and at distances spanning from 0.125 to 1.5 ft. On these images, our system for finding the relatively blurry QR codes captured by the Google Glass achieved an accuracy of 96.6%. The majority of failures during this detection step were caused during the detection of the RDT either by the RDT being at a significant out-of-plane tilt compared to the Glass or from motion blur when RDTs were held in front of the Glass camera. Following this detection step, we tested our system for reconstruction and reading of the code on those detected QR codes and achieved a 100% reading rate. We note that the QR code detection is a significantly harder task compared to its reconstruction and reading, and therefore, we expect that any detected codes using Glass should be successfully read, as shown in this specific experiment. Finally, we would like to emphasize that the Google Glass is still in development (we used the beta Explorer Edition), and we have been experiencing significant hardware and software updates throughout our research and development efforts. In particular, the Google Glass’s inability to focus on close objects affected our sensitivity in reading test lines, particularly at lower concentrations. Additionally, even while not using the processing power of the Glass, we were able to continuously image for approximately 1 h on average before the Glass required recharging. However, with each successive iteration of the Glass, we have experienced better performance and a longer use period and are thus confident that some of these remaining challenges will either be entirely solved or alleviated in future improvements and versions of the Glass.

Conclusions

In summary, we demonstrated a Google Glass-based RDT reader application capable of qualitative and quantitative measurements of various lateral flow assays and diagnostic tests. Using a custom-written Glass application and without any external optical hardware, one or more RDTs labeled with QR codes are imaged using the built-in camera of the Glass, and digitally transmitted to a remote server for processing. These digital test images are automatically processed to create a quantitative diagnostic result, which is then returned to the Google Glass user and stored with the RDT image and other related information on a central server providing review of diagnostics results via a world map through geo-tagged data. We demonstrated the success of this Glass-based platform on HIV and PSA RDTs. Providing real-time spatiotemporal tracking/mapping of various diseases and medical conditions, this smart RDT application for Google Glass could be quite valuable for epidemiology, mobile health, and telemedicine applications.

Methods

Automated Image Processing on the Server

QR Code Detection and Reconstruction

Once received by the server, each Glass image is first searched for the presence of our custom QR codes (see Figure ). QR codes consist of three large double-layered square modules in the top-left, top-right, and bottom-left corners of the QR code along with a number of smaller data modules filling the remainder of the code. To maximize readability and reduce errors, we use the largest size codes available (Version 1-H), capable of encoding test identifiers of up to 17-digit numerals under a high error code correction (ECC) capability. To make detection easier, we print the QR code’s location and data modules in blue and red colors, respectively. A descriptor called speeded-up robust features (SURF)[67] is used to detect scale- and rotation-invariant features in the blue channel of the RDT image. These SURF descriptors are then matched against SURF descriptors from a template QR code as demonstrated in the OpenCV library.[68] Detected QR codes are then mapped back to the template using homographic transformations to map the RDT back to a vertical orientation with minimal tilt.
Figure 7

Methodology for finding QR code in a Glass image scene and segmenting the test strip region. Using a generic QR code template, we match location modules across the image using SURF.[67] Detected QR codes are then reconstructed and processed, and the location is used for ratio-based segmentation of the rapid diagnostic test strip region.

Methodology for finding QR code in a Glass image scene and segmenting the test strip region. Using a generic QR code template, we match location modules across the image using SURF.[67] Detected QR codes are then reconstructed and processed, and the location is used for ratio-based segmentation of the rapid diagnostic test strip region. We use the ZXing barcode reader library[69] to process the QR codes and return the embedded identifier. Due to focus blur, this library is unable to process the cropped images directly. Instead, we first automatically reconstruct a binary QR code from the detected QR codes (see Figure ). From the cropped QR codes, we automatically remove any remaining white borders, grayscale the image, and resize to a multiple m of the known QR code grid size of 21 pixels. We then bin the m*21 × m*21 image pixels into a 21 × 21 grid by applying a threshold on the average grayscale pixel intensity in each m × m block of pixels. This new 21 × 21 reconstructed QR code is then processed by the ZXing library to extract the test identifier.
Figure 8

Methodology for QR code reconstruction from blurry Google Glass images. To produce a QR code that is detectable using standard libraries, we perform a binned threshold across the image. Reconstructed QR codes contain errors but remain within the QR code’s error correction capabilities.

Methodology for QR code reconstruction from blurry Google Glass images. To produce a QR code that is detectable using standard libraries, we perform a binned threshold across the image. Reconstructed QR codes contain errors but remain within the QR code’s error correction capabilities. Furthermore, we also created the capability to use this Glass platform for multiplexed imaging of RDTs (see Figure ). For simple uncluttered backgrounds, we can quickly and easily detect QR codes by finding the corner location modules as illustrated in Figure . Using an edge detector, we first find significant edges and fill holes created from enclosed regions. By subtracting the filled holes from the original edges, for simple backgrounds (e.g., table tops), we obtain squares indicating the QR code location markers. After eliminating noise by comparing the area ratios of the detected regions against the known regularity for QR code squares, we then identify the orientation and the size of the QR codes in the image by exploiting the QR code’s corner location module pattern. As an alternative, but more computationally involved, method for more complicated scenes, iterative SURF feature detection and matching can also be employed to find all the RDTs within the Glass image.
Figure 9

Methodology for multiplexed QR code detection for simple backgrounds. QR code corner location modules are found using an edge detector. Filtering by area ratios removes the artificial edges caused by background noise. Matching the distances between detected square centroids of similar sizes against known QR code regularities allows for detection of QR codes.

Methodology for multiplexed QR code detection for simple backgrounds. QR code corner location modules are found using an edge detector. Filtering by area ratios removes the artificial edges caused by background noise. Matching the distances between detected square centroids of similar sizes against known QR code regularities allows for detection of QR codes.

Test Evaluation from the Strip Region

After confirming that a valid identifier is attached to the test, we automatically crop the strip region by using the relative position of the QR code on the RDT (see Figure ). In our experiments, we vertically align the QR code above the strip area and automatically crop a large rectangular region containing the boundaries of the strip region. By digitally scanning column-wise down the length of the strip, we automatically search for strong intensity valleys corresponding to the control line. A final crop is made using the inner subset of columns containing the control line. Cropped strip regions without a strong control line intensity valley in any significant subset of columns are considered “invalid” tests. For the OraQuick HIV tests, we used average pixel intensities down the strip as our descriptor for the SVM classifier[63−65] (see Figure ). To generate these descriptors, we start by converting from RGB to grayscale and high pass filtering the image to maximize both the control and test line intensities. To deal with noise and reflections caused by a thin plastic cover over the strip region and to reduce general illumination differences across the strip, we then use a row-wise median filter to collapse the image into a column vector down the length of the strip. The pixels beyond the center of the control line serve as our descriptor for the SVM. The SVM classifier is trained using a balanced set of HIV RDTs activated using positive and negative controls and thereafter used for testing newly activated HIV RDTs (see e.g., Table 1).
Figure 10

Methodology for classifying quantitative HIV rapid diagnostic tests (RDTs). Illumination and noise interference are reduced by applying median filtering and sharpening, respectively, on the cropped strip region. The RDT strip is then aligned using the location of the control strip and then used as a descriptor for a support vector machine (SVM) classifier, which returns a positive/negative decision.

Methodology for classifying quantitative HIV rapid diagnostic tests (RDTs). Illumination and noise interference are reduced by applying median filtering and sharpening, respectively, on the cropped strip region. The RDT strip is then aligned using the location of the control strip and then used as a descriptor for a support vector machine (SVM) classifier, which returns a positive/negative decision. For the free and total PSA tests (from JAJ International, Inc., CA, USA), we use the ratio of the test line intensity to the control line intensity as a normalized measure of PSA concentration (see Figure ). To reduce illumination differences across the strip, a row-wise average of the intensity along the green channel produces a column vector representation of the strip. To reduce out-of-focus noise, we cross-correlate in the first spatial derivative the control line peak with the rest of the strip to statistically determine the most likely test line location. Normalizing the test line intensity against the control line intensity produces a reliable and quantified measure of the test. Using images of free and total PSA taken with known concentration values (see, e.g., Figure ), we can then fit standard curves to determine the concentration of PSA for sets of RDT images captured under similar illumination conditions.
Figure 11

Methodology for quantifying PSA concentrations. Row-wise averaging over the green channel reduces noise. The control and test lines are found through cross-correlation in the spatial derivative domain. We compare the normalized test value against a predetermined calibration curve to obtain the concentration of the analyte in ng/mL. Also see Figures and .

Methodology for quantifying PSA concentrations. Row-wise averaging over the green channel reduces noise. The control and test lines are found through cross-correlation in the spatial derivative domain. We compare the normalized test value against a predetermined calibration curve to obtain the concentration of the analyte in ng/mL. Also see Figures and .
  49 in total

Review 1.  Microfluidic platforms for lab-on-a-chip applications.

Authors:  Stefan Haeberle; Roland Zengerle
Journal:  Lab Chip       Date:  2007-07-27       Impact factor: 6.799

2.  Out with the old, in with the new: the utility of rapid diagnostic tests for malaria diagnosis in Africa.

Authors:  Chris Drakeley; Hugh Reyburn
Journal:  Trans R Soc Trop Med Hyg       Date:  2008-11-18       Impact factor: 2.184

3.  Smart-phone based computational microscopy using multi-frame contact imaging on a fiber-optic array.

Authors:  Isa Navruz; Ahmet F Coskun; Justin Wong; Saqib Mohammad; Derek Tseng; Richie Nagi; Stephen Phillips; Aydogan Ozcan
Journal:  Lab Chip       Date:  2013-08-12       Impact factor: 6.799

Review 4.  Rapid diagnostic tests for malaria parasites.

Authors:  Anthony Moody
Journal:  Clin Microbiol Rev       Date:  2002-01       Impact factor: 26.132

5.  Evaluation of rapid diagnostic tests for the detection of human immunodeficiency virus types 1 and 2, hepatitis B surface antigen, and syphilis in Ho Chi Minh City, Vietnam.

Authors:  T X Lien; N T Tien; G F Chanpong; C T Cuc; V T Yen; R Soderquist; K Laras; A Corwin
Journal:  Am J Trop Med Hyg       Date:  2000-02       Impact factor: 2.345

6.  Prostate-cancer mortality at 11 years of follow-up.

Authors:  Fritz H Schröder; Jonas Hugosson; Monique J Roobol; Teuvo L J Tammela; Stefano Ciatto; Vera Nelen; Maciej Kwiatkowski; Marcos Lujan; Hans Lilja; Marco Zappa; Louis J Denis; Franz Recker; Alvaro Páez; Liisa Määttänen; Chris H Bangma; Gunnar Aus; Sigrid Carlsson; Arnauld Villers; Xavier Rebillard; Theodorus van der Kwast; Paula M Kujala; Bert G Blijenberg; Ulf-Hakan Stenman; Andreas Huber; Kimmo Taari; Matti Hakama; Sue M Moss; Harry J de Koning; Anssi Auvinen
Journal:  N Engl J Med       Date:  2012-03-15       Impact factor: 91.245

Review 7.  A systematic review of rapid diagnostic tests for the detection of tuberculosis infection.

Authors:  J Dinnes; J Deeks; H Kunst; A Gibson; E Cummins; N Waugh; F Drobniewski; A Lalvani
Journal:  Health Technol Assess       Date:  2007-01       Impact factor: 4.014

8.  Preoperative PSA velocity and the risk of death from prostate cancer after radical prostatectomy.

Authors:  Anthony V D'Amico; Ming-Hui Chen; Kimberly A Roehl; William J Catalona
Journal:  N Engl J Med       Date:  2004-07-08       Impact factor: 91.245

9.  Microfluidic digital PCR enables rapid prenatal diagnosis of fetal aneuploidy.

Authors:  H Christina Fan; Yair J Blumenfeld; Yasser Y El-Sayed; Jane Chueh; Stephen R Quake
Journal:  Am J Obstet Gynecol       Date:  2009-05       Impact factor: 8.661

10.  Prevalence of prostate cancer among men with a prostate-specific antigen level < or =4.0 ng per milliliter.

Authors:  Ian M Thompson; Donna K Pauler; Phyllis J Goodman; Catherine M Tangen; M Scott Lucia; Howard L Parnes; Lori M Minasian; Leslie G Ford; Scott M Lippman; E David Crawford; John J Crowley; Charles A Coltman
Journal:  N Engl J Med       Date:  2004-05-27       Impact factor: 91.245

View more
  23 in total

Review 1.  Inorganic Complexes and Metal-Based Nanomaterials for Infectious Disease Diagnostics.

Authors:  Christine F Markwalter; Andrew G Kantor; Carson P Moore; Kelly A Richardson; David W Wright
Journal:  Chem Rev       Date:  2018-12-04       Impact factor: 60.622

2.  Quantification of plant chlorophyll content using Google Glass.

Authors:  Bingen Cortazar; Hatice Ceylan Koydemir; Derek Tseng; Steve Feng; Aydogan Ozcan
Journal:  Lab Chip       Date:  2015-02-11       Impact factor: 6.799

3.  Dermascope guided multiple reference optical coherence tomography.

Authors:  Roshan Dsouza; Hrebesh Subhash; Kai Neuhaus; Josh Hogan; Carol Wilson; Martin Leahy
Journal:  Biomed Opt Express       Date:  2014-08-01       Impact factor: 3.732

4.  Simple sample processing enhances malaria rapid diagnostic test performance.

Authors:  K M Davis; L E Gibson; F R Haselton; D W Wright
Journal:  Analyst       Date:  2014-05-01       Impact factor: 4.616

5.  Mitigating the Hook Effect in Lateral Flow Sandwich Immunoassays Using Real-Time Reaction Kinetics.

Authors:  Elizabeth G Rey; Dakota O'Dell; Saurabh Mehta; David Erickson
Journal:  Anal Chem       Date:  2017-04-13       Impact factor: 6.986

6.  Human-Device Interaction in the Life Science Laboratory.

Authors:  Robert Söldner; Sophia Rheinländer; Tim Meyer; Michael Olszowy; Jonas Austerjost
Journal:  Adv Biochem Eng Biotechnol       Date:  2022       Impact factor: 2.768

Review 7.  Biomedical imaging and sensing using flatbed scanners.

Authors:  Zoltán Göröcs; Aydogan Ozcan
Journal:  Lab Chip       Date:  2014-09-07       Impact factor: 6.799

8.  Smartphone-based analysis of biochemical tests for health monitoring support at home.

Authors:  Marina Velikova; Ruben L Smeets; Josien Terwisscha van Scheltinga; Peter J F Lucas; Marc Spaanderman
Journal:  Healthc Technol Lett       Date:  2014-09-23

9.  Mobile phones democratize and cultivate next-generation imaging, diagnostics and measurement tools.

Authors:  Aydogan Ozcan
Journal:  Lab Chip       Date:  2014-09-07       Impact factor: 6.799

10.  Deep learning of HIV field-based rapid tests.

Authors:  Valérian Turbé; Carina Herbst; Thobeka Mngomezulu; Sepehr Meshkinfamfard; Nondumiso Dlamini; Thembani Mhlongo; Theresa Smit; Valeriia Cherepanova; Koki Shimada; Jobie Budd; Nestor Arsenov; Steven Gray; Deenan Pillay; Kobus Herbst; Maryam Shahmanesh; Rachel A McKendry
Journal:  Nat Med       Date:  2021-06-17       Impact factor: 53.440

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.