Training time and quality of smartphone-based anterior segment screening in rural India.

OBJECTIVE: We aimed at evaluating the ability of individuals without ophthalmologic training to quickly capture high-quality images of the cornea by using a smartphone and low-cost anterior segment imaging adapter (the "EyeGo" prototype).
METHODS: Seven volunteers photographed 1,502 anterior segments from 751 high school students in Varni, India, by using an iPhone 5S with an attached EyeGo adapter. Primary outcome measures were median photograph quality of the cornea and anterior segment of the eye (validated Fundus Photography vs Ophthalmoscopy Trial Outcomes in the Emergency Department [FOTO-ED] study; 1-5 scale; 5, best) and the time required to take each photograph. Volunteers were surveyed on their familiarity with using a smartphone (1-5 scale; 5, very comfortable) and comfort in assessing problems with the eye (1-5 scale; 5, very comfortable). Binomial logistic regression was performed using image quality (low quality: <4; high quality: ≥4) as the dependent variable and age, comfort using a smartphone, and comfort in assessing problems with the eye as independent variables.
RESULTS: Six of the seven volunteers captured high-quality (median ≥4/5) images with a median time of ≤25 seconds per eye for all the eyes screened. Four of the seven volunteers demonstrated significant reductions in time to acquire photographs (P1=0.01, P5=0.01, P6=0.01, and P7=0.01), and three of the seven volunteers demonstrated significant improvements in the quality of photographs between the first 100 and last 100 eyes screened (P1<0.001, P2<0.001, and P6<0.01). Self-reported comfort using a smartphone (odds ratio [OR] =1.25; 95% CI =1.13 to 1.39) and self-reported comfort diagnosing eye conditions (OR =1.17; 95% CI =1.07 to 1.29) were significantly associated with an ability to take a high-quality image (≥4/5). There was a nonsignificant association between younger age and ability to take a high-quality image.
CONCLUSION: Individuals without ophthalmic training were able to quickly capture a high-quality magnified view of the anterior segment of the eye by using a smartphone with an attached imaging adapter.

Introduction

Anterior segment photography is an important part of a complete mobile eye examination as it provides direct information about the health of the eyelids, eyelashes, lacrimal system, conjunctiva, sclera, cornea, anterior chamber, iris, and lens. We used a low-cost, custom-made mobile phone attachment for anterior segment imaging (referred to herein as the “EyeGo” adapter) described in detail elsewhere1 that was an early prototype of a commercially available ophthalmic imaging adapter for smartphones called Paxos Scope™ (DigiSight Technologies, San Francisco, CA, USA). The EyeGo consists of three parts: a light-emitting diode light source, a macrolens, and an apparatus that holds the smartphone – aligning the macrolens and the smartphone camera (Figure 1).1 The EyeGo magnifies the cornea and surface aspects of the eye, enabling front and back of the eye imaging, and its simple design makes it an ideal screening tool for performing mobile eye examinations.1,2

Figure 1

The EyeGo adapter.

Notes: (A) The EyeGo adapter for anterior segment imaging: a smartphone adapter consisting of an external LED light source and a macrolens. (B) A health fair screening volunteer capturing images of the anterior segment for a high school student by using the EyeGo adapter prototype. (C) A photograph taken by the EyeGo adapter of a normal eye.

Abbreviation: LED, light-emitting diode.

Although Myung et al demonstrated that the EyeGo is easy for medical professionals to use, the device remains relatively untested by users without training in eye care.1–4 Consequently, our primary aim was to evaluate the ability of untrained users to quickly capture high-quality images of the front of the eye, and our secondary aim was to assess the relationship between a user’s age, comfort using a smartphone, and comfort in assessing problems with the eye and the user’s ability to capture high-quality images of the front of the eye.

Methods

Research was performed ethically and in accordance with the Institutional Review Board of Stanford University and L V Prasad Eye Institute, both of which approved this research. Verbal informed consent was obtained from the parent of each minor participating in Healthy Scholars Screening, and the study was conducted in a Health Insurance Portability and Accountability Act (HIPAA)-compliant manner. All research adhered to the tenets of the Declaration of Helsinki. All image acquisition and transmittal were handled with strict attention to the confidentiality of personal data in accordance with the Data Protection Act of 1998 and Access to Health Records of 1990.

The iPhone 5S (Apple Inc., Cupertino, CA, USA) used to capture images was encrypted using the Stanford University Mobile Device Management application.5 Images were uploaded from the phone to research electronic data capture (REDCap) tools hosted at Stanford University after the event. The study data were input to and managed using REDCap. REDCap is a secure, web-based application designed to support data capture for research studies, providing 1) an intuitive interface for validated data entry; 2) audit trails for tracking, manipulation, and export procedures; 3) automated export procedures for seamless data downloads to common statistical packages; and 4) procedures for importing data from external sources.

The EyeGo screening study included all students presenting at the Center for Development (CCD) in Varni for the Healthy Scholars Screening over 4 consecutive days in August 2014, with a total of 24.4 hours of screening with the EyeGo. Students cycled through 5 health stations including thyroid, vision, hearing, dental, and girl’s health screening. Following the vision station, students were screened with the EyeGo. In total, 111 students were screened sequentially on Day 1 by 2 different users (time spent specifically on EyeGo screening: 4 hours, 55 minutes), 224 by 3 users on Day 2 (7 hours, 47 minutes), 214 by 1 user on Day 3 (5 hours, 49 minutes), and 217 by 3 users on Day 4 (5 hours, 42 minutes; 1 user had also worked on Day 3). All students from two high schools were offered this free health screening. We excluded 15 students who were screened by a user who had difficulty using the device quickly (the individual had never used a smartphone) and who was requested to switch roles at the screening due to time constraints. Age was recorded from Healthy Scholars Screening forms. Both eyes of all 751 patients were imaged.

Patients underwent visual acuity testing and extraocular movement testing and then were imaged by one of seven Healthy Scholars volunteers with varying levels of training and education (eg, undergraduate student, undergraduate degree holder, land surveyor, lab technician, and multipurpose health worker). Healthy Scholars volunteers already present at the screening had been randomly recruited to perform EyeGo imaging, based on their availability during the 5 days of screening.

Images were taken indoors in a large gymnasium with fluorescent lighting. Users could take additional photographs of each eye if they felt that their first was unsuccessful for any of the following reasons: if the patient or his/her eye or eyelid moved unexpectedly or if the user lost hand positioning over the eye as he/she was taking the photograph. In general, 1–3 images were obtained for each eye of each patient, and the highest quality image (normal or with pathology) was used for the analysis, as determined by the grader post hoc.

Healthy Scholars volunteers were given brief (<5 minutes) standard instructions on how to take photographs by using the EyeGo.1 Users were instructed to hold the iPhone 5S with two hands: one hand held the phone sideways with the third digit and thumb, whereas the fourth and fifth digits stabilized the phone against the patient’s forehead, and the other hand further stabilized the phone. The index finger of the hand closest to the button on the camera was used to take a photograph. Users were given real-time feedback on their first 10 images by an experienced user (CL). Care was taken in all cases to prevent contact between the phone and adapter and the patient’s skin. In case contact was made, the adapter and phone were wiped clean with an alcohol swab, and the adapter itself was submerged in soap and water or another cleaning solution.

Prior to imaging, users were asked their highest level of training/education in addition to two survey questions: 1) How comfortable do you feel using a smartphone? and 2) how comfortable do you typically feel while assessing problems with the eye? Users responded on a 5-point Likert scale (Table 1).

Table 1

Baseline characteristics of EyeGo users (n=7) and their relationship with image quality

Characteristic	n (%)	Odds ratioa (95% confidence interval)
Ageb – median (interquartile range)	20 (20, 36)	0.915c (0.77 to 1.09)
Highest level of training/education
Undergraduate student	2 of 7 (28.6)
Undergraduate degree	1 of 7 (14.3)
Lab technician	1 of 7 (14.3)
Multipurpose health worker (female)	2 of 7 (28.6)
Land surveyor	1 of 7 (14.3)
“How comfortable do you feel using a smartphone?”d
Very comfortable	4 of 7 (57.1)	1.25 (1.13 to 1.39)
Somewhat comfortable	1 of 7 (14.3)
Neutral	1 of 7 (14.3)
Somewhat uncomfortable	1 of 7 (14.3)
Very uncomfortable	0 of 7 (0.0)
“How comfortable do you typically feel while assessing problems with the eye?”d
Very comfortable	2 of 7 (28.6)	1.17 (1.07 to 1.29)
Somewhat comfortable	1 of 7 (14.3)
Neutral	3 of 7 (42.9)
Somewhat uncomfortable	1 of 7 (14.3)
Very uncomfortable	0 of 7 (0.0)

Notes:

Estimated by using a binary regression model with image quality <4 or ≥4 as the outcome variable and age, comfort using a smartphone, and comfort in assessing problems with the eye as predictors;

median age was used, as the distribution was non-normal when tested by using the Shapiro–Wilk test statistic;

calculated by 10-year intervals in age;

EyeGo users were asked these two questions prior to screening.

One medical student grader de-identified and graded all images by using a 5-point scale previously validated for nonmydriatic imaging in the FOTO-ED study by Lamirel et al.6 Images were graded using the following criteria from the FOTO-ED study: 1) The quality is inadequate for any diagnostic purpose; 2) grader was unable to exclude all emergent findings; 3) grader was only able to exclude emergent findings; 4) the quality is not ideal, but grader was able to exclude subtle findings; and 5) image was of ideal quality.6 Emergent findings from anterior imaging include corneal abrasions/lacerations/ulcers, episcleritis, scleritis, chemical burns, foreign bodies, hyphema, hypopyon, and traumatic injury. An example of a subtle finding for anterior imaging includes fine detail of the iris. High-quality images were defined as images with a grade of ≥4/5. This scale was appropriate for determining the utility of the EyeGo in ruling out emergent findings.

Images were reviewed on a 15.4-inch backlit display monitor with in-plane switching technology that facilitates viewing at a broad angle at which images can be viewed without deterioration of color and brightness (MacBook Pro, resolution =2,880×1,800 at 220 pixels per inch). The reviewer could adjust monitor contrast and brightness for image review.

Data were analyzed by using statistical methods for prospective cohort designs. Median difference was used as the basic summary measure of change in quality and time by experience. Odds ratios (ORs) were used as the basic summary measure of association between age, comfort using a smartphone, and comfort in assessing problems with the eye and image quality. All the analyses were conducted by using Statistical Analysis Software Enterprise Guide Version 6.1 (Cary, NC, USA).

Variables were first graphically examined for normal distributions and assessed for outliers to determine the appropriate statistical test. The Shapiro–Wilk test was used to test for normal distribution. Measures of central tendency and variation as appropriate to the study variable and its distribution were used to describe the study population. Binomial logistic regression using image quality (ie, <4 or ≥4) as the dependent variable was used to obtain ORs, with age, comfort using a smartphone, and comfort in assessing problems with the eye as predictors.

The Wilcoxon rank sum test was used to compare the time each user took to take each of the first 100 photographs and the second 100 photographs as well as the quality of the first 100 and second 100 photographs. This test was chosen as time and quality were not normally distributed. This allowed us to determine the unadjusted P-value for the difference between the groups. Statistical tests had a two-tailed α of 0.05.

Results

Eight volunteers from the Healthy Scholars organization imaged the eyes of a total of 766 subjects. One user did not complete imaging of 100 subjects due to difficulty using the EyeGo quickly and time constraints from other segments of the health screening; therefore, the user and all 15 subjects imaged by this user were excluded from the study. Table 2 reports baseline characteristics of the subjects imaged. The median age of participants was 12.5 years. Imaging and external examination assisted in recording oculodermal melanocytosis, arcus, and conjunctival injection (Figure 2A–D) in addition to stye, ptosis, and blepharitis. Only 2.3% of subjects reported ocular complaints prior to examination, with watering (1.2%) being the most common complaint. Ophthalmic examination revealed ocular findings in 13.0% (98 of 751) of subjects with decreased visual acuity being the most common (90 of 751; 12.0%).

Table 2

Baseline characteristics of subjects screened by Healthy Scholars

Baseline characteristics	n (%)
Agea – median (interquartile range)	12.5 (11.5, 13.7)
Presenting ocular complaints
Watering	9 of 751 (1.2)
Blurred vision	6 of 751 (0.8)
Ocular pain	5 of 751 (0.7)
Photophobia	2 of 751 (0.3)
Floaters	2 of 751 (0.3)
Total	17 of 751 (2.3)
Anterior segment findings on examination
Decreased visual acuity	90 of 751 (12.0)
Stye	1 of 751 (0.1)
Strabismus	1 of 751 (0.1)
Ptosis	1 of 751 (0.1)
Blepharitis	1 of 751 (0.1)
Periorbital wound	1 of 751 (0.1)
Oculodermal melanocytosis	1 of 751 (0.1)
Arcus	1 of 751 (0.1)
Conjunctival injection	1 of 751 (0.1)
Total	98 of 751 (13.0)

Notes:

Median age was used, as the distribution was non-normal when tested by using the Shapiro–Wilk test statistic; n=751.

Figure 2

Photographs of the ocular surface taken by using the EyeGo adapter for anterior segment imaging. Reflections present due to suboptimal lighting conditions.

Notes: (A) Normal. (B) Arcus resulting from the deposition of lipids in the peripheral cornea. (C) Oculodermal melanocytosis associated with glaucoma. (D) Conjunctival injection.

Table 1 lists baseline characteristics of the seven anterior adapter EyeGo users. The median age of users was 20 years, with a range of 19–38 years. There was a nonsignificant association between younger age and higher quality of images with a reduction in the odds of high-quality images for each additional 10 years of age (OR =0.92; 95% CI =0.77 to 1.09). All seven of these individuals answered two questions regarding their comfort in administering tests prior to screening. In response to the first question “How comfortable do you feel using a smartphone?” the majority felt “very comfortable” (57.1%). In response to the second question “How comfortable do you typically feel while assessing problems with the eye?” most reported “neutral” (42.9%). For every 1-point increase in comfort using a smartphone on a 5-point Likert scale, users experienced a 25% increase (OR =1.25; 95% CI =1.13 to 1.39) in the odds of taking a high-quality image (≥4/5). For every 1-point increase in comfort in assessing problems with the eye on a 5-point Likert scale, users experienced a 17% increase (OR =1.17; 95% CI =1.07 to 1.29) in the odds of taking a high-quality image.

Three users of the EyeGo adapter for anterior segment imaging achieved a median image quality of 5 (the highest value) for the first 100 eyes imaged and continued to have a median image quality of 5 for the second 100 eyes imaged with no significant change (P3=0.20, P4=0.67, and P5=0.70; Table 3). Three users achieved an improvement in image quality between the first 100 eyes imaged and second 100 eyes imaged (P1<0.001, P2<0.001, and P6<0.001). A total of six users (85.7%) achieved a median image quality of 5 for the last 100 eyes imaged.

Table 3

Changes in time taken per eye and change in the quality of photographs taken with experience

User	First 100 eyes		Last 100 eyes		Difference		P-valueb
	Median timea (s)	Median quality	Median time (s)	Median quality	Time (s)	Quality	Time (s)	Quality
1	25.0	3.0	17.5	4.0	−7.5	1.0	0.01	<0.001
2	18.0	4.0	20.0	5.0	2.0	1.0	0.15	<0.001
3	20.0	5.0	18.0	5.0	−2.0	0.0	0.13	0.20
4	22.0	5.0	24.0	5.0	2.0	0.0	0.15	0.67
5	12.0	5.0	10.0	5.0	−2.0	0.0	0.01	0.70
6	25.0	4.0	15.5	5.0	−9.5	1.0	<0.001	<0.01
7	22.0	4.0	16.0	5.0	−6.0	1.0	0.01	0.11

Notes:

Median time and quality were used, as distributions were non-normal when tested by using the Shapiro–Wilk test statistic;

Statistical significance was measured by using the Wilcoxon rank sum test.

Four users experienced a significant decrease (P1=0.01, P5=0.01, P6=0.01, and P7=0.01) in median time between the first and second 100 eyes imaged (Table 3). Another user experienced a nonsignificant decrease in median time (P3=0.13). Two users experienced an increase in median time between the first and second 100 eyes imaged – neither of these increases was significant (P2=0.15 and P4=0.15).

Discussion

Our study demonstrates that volunteers with no prior ophthalmic training and minimal device training (<5 minutes and feedback with the first 10 patients) could capture high-quality images of the cornea and front of the eye for 1,502 eyes with a median time of ≤25 seconds per eye. Six of seven volunteers captured high-quality (median ≥4/5) images of the eye at baseline. EyeGo users with a baseline image quality <5 underwent an improvement in median image quality with experience. Furthermore, most users experienced a significant reduction in median time to capture images. In addition, we found that a user’s self-reported comfort using a smartphone and in assessing eye problems increased the odds of the user capturing high-quality images. Lastly, 13.0% (98 of 751) of students had ocular findings on examination with decreased visual acuity being the most common (90 of 751; 12.0%) followed by 1 each (0.1%) of stye, strabismus, ptosis, blepharitis, periorbital wound, oculodermal melanocytosis, arcus, and conjunctival injection.

The prevalence of anterior segment ocular morbidity detected in our study (13.0%) was similar to that found in a study that conducted ophthalmologic screening examinations of 1,157 students aged 6–16 years at a municipal (12.92%) and private school (9.82%) in Pune City, Maharashtra, India.7 However, it was lower than the overall prevalence of ocular morbidity found through questionnaires provided to 1,561 students aged 6–16 years in Shimla, Himachal, India (31.6%).8

Anterior segment imaging is a necessary part of a complete mobile eye examination as it can detect disease of the eyelids, eyelashes, lacrimal system, conjunctiva, sclera, cornea, anterior chamber, iris, and lens.1 Currently, several components of a comprehensive eye examination can be completed by using a smartphone and smartphone applications or hardware attachments: visual acuity,9 Amsler grid testing,10 contrast testing,10 color vision assessment,10 and refraction.11,12 Applications for the assessment of pupillary response, extraocular movements, and visual field testing are not yet available but will likely become available in the near future. With a rise in smartphone owners in developing nations from a median of 21% in 2013 to 37% in 2015, the movement toward a smartphone-centered ocular examination increases accessibility in terms of both cost and convenience to underserved populations.13 This is in contrast to established methods for nonmobile anterior segment imaging that require slit lamps and/or advanced training with more expensive devices.14–16 Detection of ocular disease is critical as the World Health Organization estimates that 80% of worldwide ocular pathology is curable and preventable.17 Access to low-cost and easy-to-use tools for performing ocular screening allows for such detection. We confirm here that the EyeGo presents an easy-to-use alternative to these methods. Further, images taken with the EyeGo allow for remote reading of images through a secure, encrypted email or HIPAA-compliant smartphone applications.

Our study was limited by the exclusion of one user who could not finish the screening due to unfamiliarity with and difficulty using the smartphone. Comfort using smartphones was significantly associated with the ability to take high-quality images; therefore, being comfortable using a smartphone contributes to the ease of use of the EyeGo. In addition, the use of the Likert scale in our survey data has disadvantages as it limits respondents to 5 choices, often not truly equidistant in value. Lastly, our participant sample size – and therefore user sample size, as each user was required to image 100 students to have been included in the study – was limited by the number of students attending the Healthy Scholars Screening.

Our study demonstrates the feasibility of adding anterior segment imaging to a mobile eye examination with the EyeGo attachment. In the setting of this health screen, anterior segment imaging allowed for the detection and documentation of pathology that may otherwise have been missed during visual acuity screening. Anterior segment imaging fits seamlessly into a comprehensive eye screening otherwise including vision screening, refraction, pupil assessment, posterior photographs, visual field testing, and imaging with ocular coherence tomography. The low cost, ease of use, and portability of the EyeGo enable it to provide anterior and posterior segment imaging in any setting – from a doctor’s office to a gymnasium in rural Varni.