mHealth for HIV Treatment & Prevention: A Systematic Review of the Literature.

This systematic review assesses the published literature to describe the landscape of mobile health technology (mHealth) for HIV/AIDS and the evidence supporting the use of these tools to address the HIV prevention, care, and treatment cascade. The speed of innovation, broad range of initiatives and tools, and heterogeneity in reporting have made it difficult to uncover and synthesize knowledge on how mHealth tools might be effective in addressing the HIV pandemic. To do address this gap, a team of reviewers collected literature on the use of mobile technology for HIV/AIDS among health, engineering, and social science literature databases and analyzed a final set of 62 articles. Articles were systematically coded, assessed for scientific rigor, and sorted for HIV programmatic relevance. The review revealed evidence that mHealth tools support HIV programmatic priorities, including: linkage to care, retention in care, and adherence to antiretroviral treatment. In terms of technical features, mHealth tools facilitate alerts and reminders, data collection, direct voice communication, educational messaging, information on demand, and more. Studies were mostly descriptive with a growing number of quasi-experimental and experimental designs. There was a lack of evidence around the use of mHealth tools to address the needs of key populations, including pregnant mothers, sex workers, users of injection drugs, and men who have sex with men. The science and practice of mHealth for HIV are evolving rapidly, but still in their early stages. Small-scale efforts, pilot projects, and preliminary descriptive studies are advancing and there is a promising trend toward implementing mHealth innovation that is feasible and acceptable within low-resource settings, positive program outcomes, operational improvements, and rigorous study design.

INTRODUCTION

Today, mobile health information technologies are being deployed around the world to address a spectrum of challenges from disease surveillance to health systems strengthening to health education [1]. Health professionals, policymakers, and technologists alike have been inspired by the promise of eHealth and mHealth technologies during the present wave of innovation. The speed of innovation, broad range of pilot initiatives and tools, and inconsistencies in reporting have made it difficult to uncover and synthesize knowledge on how these tools might be effective in addressing global health crises such as the HIV pandemic.

For the first time since the dawn of the epidemic, major clinical trials have confirmed the effectiveness of several prevention strategies [2-5]. Pledges by multinational donors to achieve universal access to HIV treatment, care, and support [6] and the stated strategic goal of the President’s Emergency Plan for AIDS Relief (PEPfAR) of achieving “AIDS free generation” has led to optimism with regard to the potential for elimination of HIV globally [7]. To achieve universal access to treatment, national and local programs must expand access to HIV care, strengthen health systems, improve quality of care delivered, reduce costs, and address barriers to access at every stage of the HIV treatment cascade [8-11]. Early reports on mHealth suggest that mobile health technologies may help to address these programmatic needs [12].

mHealth (mobile health) can be defined as the practice of medical and public health via mobile communication devices [13,14]. Although explicitly focused on the use of mobile devices, the full promise of mHealth may require understanding it within in the broader context of eHealth – defined as the transfer of health resources and health care my electronic means [15] – and comprehensive health information systems. mHealth tools have been particularly useful in low- and middle-income countries (LMICs), where mobile phones and similar devices have the added advantage of extended battery life, simple interface for technology users, voice operability, cellular connectivity, and relative affordability.

This systematic review describes the overall landscape of mHealth for HIV/AIDS as reflected in the published literature and evidence related to the use of mHealth to address specific programmatic requirements along the cascade of HIV prevention, care, and treatment as reflected in the research literature.

METHODS

Initially, a search of all published articles referring to mHealth was conducted. We searched for the following terms within title, abstract, or author keywords using this logic: mHealth OR ((handheld computers OR mobile device OR cellular phone OR mobile phone) AND health). We limited the search to articles published in English during the past ten years, from January 2001 to December 2011. The term handheld computer captured a variety of types of devices, including tablet devices such as iPads, personal digital assistants (PDAs), and devices for global positioning systems (GPS). To capture this multidisciplinary field, we searched among health, engineering, technology, and social science databases: Pubmed/Medline, Scopus, Embase, Cochrane, CABI Global Health, Compendex, Web of Science, INSPEC, Popline, WHO Technical Reports, and Google Scholar. Finally, we searched within the collection of unique mHealth articles (as depicted in Fig. ) to identify only those referring to HIV or AIDS within the title, abstract, or author keywords.

To categorize and assess the literature, three independent reviewers systematically coded each article to identify descriptions of the following topics: methods, design, implementation science category, rigor, purpose of technology, theoretical framework, location, population served, community engagement/participation, stage of cascade, impact, findings, and conclusions. Finally, coded information was gathered and summarized for each article by each reviewer. If there was any disagreement between all three reviewers’ code summaries, a senior researcher fully reviewed the article and code to settle the discrepancy with their final determination. This process resulted in the article descriptions in Tables and .

The literature was then divided into two categories: research and non-research. Research articles were defined as those that reported on systematic investigation of an mHealth implementation or tool using a specified study design and methods. The majority of articles were excluded from the research category because they had no description of methods used for investigation. These articles tended to describe an mHealth for HIV/AIDS implementation, often including lessons learned. Two articles were excluded because they described research that happened to use mHealth tools for the purpose of conducting a survey but not provide explicit research insights into the use of the mHealth tool itself. All articles were used in the assessment of the overall landscape of mHealth for HIV/AIDS and only research articles were used in the assessment of the evidence related to the use of mHealth to address specific HIV programmatic requirements.

FINDINGS

mHealth & HIV Landscape

The mHealth literature collection included 2,603 articles, after sorting to include only unique articles that were in line with the above stated definition of mHealth. The majority of those articles considered irrelevant to mHealth described the unhealthy effects of mobile phones, such as exposure to electromagnetic signals and phone use while driving. Within the final mHealth collection, 64 were deemed pertinent to HIV/AIDS after the review of title, abstract, and author keywords. The team included additional articles from reference lists of included articles and then ensured relevance to mHealth and HIV with a full article review, resulting in a final collection of 62 articles for analysis. These detailed are depicted in Fig. (): PRISMA flow diagram.

As described in the literature review tables (Tables and ) and overview table (Table ), the final collection of 62 articles were mostly from peer-reviewed journals and included policy and position papers, editorial commentary, literature reviews, and research/evaluation. Articles published from 2001-2006 tended to focus on the use of personal digital assistants (PDAs) to support provider services. Nearly 80% of all articles were published between 2007 and 2011, focusing more on the use of mobile phones to support providers, community health workers, and patients directly. Among the ten literature reviews found, only two were systematic and included a description of methods [15, 16]. These reviews were tangentially related to HIV/AIDS, tending to focus more broadly on mobile devices for medical education or health services in developing countries.

Although articles describe using a range of technical capabilities, most focus on simple text-based SMS. More than half of projects provided alerts and reminders (60%) and a quarter used mobile tools for field-based data collection (24%) such as surveys and electronic patient diaries. A smaller number of studies described the use of mobile technology for direct voice communication between patients and providers (24%), HIV information on demand (11%), educational messaging and health promotion (13%), and HIV provider decision-support (5%). Only one article, a brief news report, described the use of mobile technology for point-of-care diagnostics, specifically a mobile phone imaging tool that is currently in development to measure CD4 count from remote locations [17].

The literature describes a proliferation of mHealth tools for HIV across geographic regions and within diverse communities of focus. The majority of projects provided services to urban communities in the global South. Projects mostly focused on providing direct services to people living with HIV (PLHIV) (45%). Only a few articles mentioned a focus on key vulnerable populations, such as pregnant women (3%), sex workers (5%), men who have sex with men (5%), and users of injection drugs (0%).

Research & Evaluation Studies

Of 62 articles identified, 56% were research or evaluation studies -- ie, they focused on systematic investigation of mHealth for HIV and reported using a specific study design and methods. As detailed in Table , these studies can be generally characterized by the fundamental components of implementation science: monitoring/evaluation, operations research, and impact evaluation.

Most studies can be characterized as monitoring/evaluation reports. Four studies (20%) were monitoring reports, particularly descriptions of project activities, inputs, and outputs. A third of studies (34%) were evaluation reports, including relational/quasi-experimental studies of what was achieved by mHealth initiatives. Monitoring and evaluation efforts of this kind often included taking multiple measurements of programs or interventions across time, such as pre/post tests. Typical of this kind of study, Brock and Smith assessed the use of a mobile device with education videos in a clinic waiting room to measure patients’ knowledge of HIV/AIDS before, immediately after, and 4-6 weeks after use [18]. The study found that participating patients had higher HIV/AIDS knowledge scores after using the mHealth educational tool, however it did not include control groups to compare the mHealth system in relation to no intervention or other recommended educational practices.

Ten studies (29%) reported on operations research, including many feasibility and acceptability assessments that focus on how an mHealth solution might be most efficiently adopted within a particular clinical or community context to improve program practices. These articles did not involve a comparison group, multiple measurements, or randomization but more often described results of cross-sectional surveys, focus groups, and interviews with community stakeholder groups. For example, Crankshaw et al. evaluated the use of mobile phones for clinic appointment reminders and adherence messages at an antiretroviral treatment (ART) clinic in urban South Africa that was struggling with loss to follow-up [19]. Their findings indicated that although most patients had access to a mobile phone, women patients tended to change phones and share phones more often than men. The authors argue that these feasibility findings must be incorporated into program delivery to protect patient privacy and improve program effectiveness.

Finally, the literature collection included several impact evaluations (14%) aimed to assess causality using experimental design with randomized selection of intervention and control groups. Efforts of this kind tended to focus on measuring program outcomes such as treatment adherence and biomedical health impacts such as CD4-count. Randomized clinical studies (RCTs) led by Pop-Eleches et al. and Lester et al. (findings described below) are salient examples of rigorous studies [20,21].

Overall, studies used a mix of quantitative (71%) and qualitative (51%) methods, including surveys, focus groups, clinical chart review, and computer systems reports on use. Although some (14%) used both qualitative/quantitative strategies, none described an integrated mixed method approach. Among 35 studies, only a few [22-27] mentioned a theoretical basis or conceptual framework that guided their assumptions about why mHealth might facilitate or cause the intended change.

HIV Programmatic Objectives

The research literature provided evidence on a range of interventions, several of which might contribute evidence to the ways in which mHealth for HIV might facilitate the scale-up of HIV prevention, care, and treatment services across the cascade, as depicted in Fig. ().

Voluntary counseling & testing: Three articles provide some evidence that mHealth tools can be used to increase demand for voluntary counseling and testing (VCT) among vulnerable communities. First, in their assessment of the SEXINFO text messaging service in San Francisco, Levine and colleagues found that SMS was a feasible and acceptable way for vulnerable youth to receive information and referrals to clinical services [28]. Using systems data, the researchers were able to assess project outputs and found that the project resulted in a sizeable number of messages sent and received by youth. However, the study did not assess whether or not SEXINFO had an impact on VCT uptake.

As noted above, a quasi-experimental study found that by placing PDAs with HIV educational media in clinic waiting rooms, study respondents increased their HIV knowledge [18]. In absence of a comparison group, however, there is insufficient evidence to demonstrate that the mHealth intervention was any more effective than traditional paper-based materials and verbal messaging or patient education. Moreover, the article offers no evidence that increased HIV knowledge before clinic visits was associated with increased testing or linkage to care.

Finally, a unique pilot study by Welz and Herbst described the use of handheld computers for delivering HIV testing results in hard-to-reach South African communities [29]. As a part of a PDA-based household survey, research staff offered finger-prick testing to all adults and stored test results on secure PDAs at community-based counseling centers. Survey participants who wanted to confidentially obtain their HIV results could do so by presenting a unique code. Among those tested, 5% received their results in this manner. The authors argue that in a traditional surveillance system, few if any would be informed of their HIV status, however they offer no evidence to support this claim. Although there were measures taken to protect personal data, confidentiality was not confirmed by the study.

No published articles, within the time frame of the review, described the use of mobile technologies to support counseling and screening among pregnant women and/or infants, an essential programmatic activity for the prevention of mother-to-child transmission (PMTCT) of HIV.

Linkage to Care: There is some evidence that mHealth can contribute to retention in care between testing and enrollment in HIV care. One RCT that took place in an urban European sexual health clinic found that patient reminders significantly increased appointment attendance at clinical care site [30]. The intervention, however, included text messages to mobile phones, voice phone calls, and postal reminders, making it difficult to discern the effect of mobile health tools. Simple economic analysis included in this study revealed that the reminder system paid for itself within three months because the intervention clinic was able to bill for more consultations per day.

A similar system to improve appointment attendance among PLHIV in rural Uganda was evaluated by Kunutor and colleagues [31]. In their pilot operations study, researchers assessed feasibility and program outputs associated with sending simple text messages or making a voice call to remind patients who miss their appointments to come in for a clinical visit as soon as possible. The study demonstrated that most patients who received text/voice messages presented for treatment within a few days, however the lack of comparison group and absence of multiple measurements makes it difficult to conclude that the mobile phone intervention is responsible for improved clinic attendance rates. The study included no costing details on staff time for delivering voice and text messages, which may have been helpful in comparing it to other efforts to improve retention in care.

CD4 Screening: Although point-of-care CD4 diagnostic tools may be available in the future [32] and eHealth systems have been useful for HIV patient tracking across the continuum of care [33], there is not evidence to date on the use of mHealth tools explicitly for CD4 screening. In a more generic sense, several articles [20,31,32,35-37] found that mHealth tools were helpful for managing care by improving attendance to medical appointments, during some of which one would assume CD4 testing took place, through text reminders and community health worker support. However, further detail about the use of mHealth tools for rapid, accurate, and shared CD4 results reporting was not reported explicitly, although mHealth technologies to accomplish these goals are feasible and available.

Treatment Adherence: Use of mHealth to improve ART adherence has the strongest evidence base. Several descriptive [19,34] and quasi-experimental studies [27,35-37] conclude that text message reminders are acceptable, feasible, and useful for improved treatment adherence among PLHIV in resource-constrained settings. Two impact studies, both RCTs, demonstrate the effectiveness of mHealth for adherence to ART. Pop-Eleches et al. found that treatment adherence improved significantly among patients randomized to receive weekly text message reminders during a 48-week intervention period in Kenya [20]. The authors conclude that short weekly reminders were significantly more effective than no, daily, or longer text reminders.

Consistent with the findings Pop-Eleches et al, another Kenya-based RCT by Lester et al. found that patients receiving weekly SMS reminder messages had significantly improved antiretroviral adherence and rates of viral suppression compared with the control individuals [21]. Differing from the Pop-Eleches intervention, patients in the Lester study were instructed to respond to clinic nurses within 48 hours, confirming they received SMS. Although people enrolled in PMTCT programs were included as study participants, description of an assessment of reminders to support PMTCT, women, and mothers was not reported.

DISCUSSION

Our review reveals that the science and practice of mHealth for HIV prevention, care, and treatment are in their early stages. Although the majority of studies published focus primarily on acceptability and feasibility of early small-scale pilots, the literature reveals a promising trend toward feasible and acceptable initiatives, positive outcomes, and rigorous study design.

Limitations

mHealth is a new and rapidly evolving field, led frequently by commercial entrepreneurs and small technology non-profits. It is likely that many mHealth initiatives are not being documented or published. Efforts that lead to negative findings may be published less frequently. As a result, this review may not reflect the full mHealth landscape, particularly the unreported implementation knowledge of practitioners and institutions. Only those articles that explicitly report use of mobile information technology devices were included. As such, the review did not include articles on information communication and computer-based systems that rely on less mobile devices, including PCs, laptop computers, and printers, despite their potential relevance of these eHealth systems to mHealth. Although future reviews may find only minor differences between eHealth and mHealth tools, especially as computer-based interventions all become increasingly mobile, we found that this distinction is still relevant for the articles published in the past ten years.

mHealth, HIV, & Implementation Science

As an emergent area of study and practice, it is not surprising that the current mHealth literature has focused mostly on assessment of acceptability and feasibility of pilot initiatives within low-resource contexts. It is likely that, as the science of mHealth matures, strategies for health systems strengthening and for addressing the HIV prevention and treatment cascade [8,9,38] will increasingly incorporate mobile technologies. In this regard, development of a road map for mHealth implementation science is warranted. Implementation science is a field that explicitly aims to improve the uptake, implementation, and translation of actionable research findings into real world programs [39,40] and, as such, an implementation science agenda will ultimately focus the global community on the design, development, and use of technologies that have a demonstrable impact(s).

Based on this assessment of the existing mHealth literature, there are three fundamental steps toward strengthening the implementation science evidence base. First, providing actionable evidence on how to improve HIV care through incorporation of mHealth solutions will require integration of technologies into existing programs. To date, mHealth practice is mostly characterized as small, one-off, externally driven, and isolated pilots. The literature reveals ample data related to feasibility, acceptability, and even early outcomes/impact to support the potential benefit that may accrue through larger scale implementation in the context of national HIV programs.

Second, articulation of theoretical frameworks and program logic will strengthen the mHealth evidence base. Program monitoring and evaluation requires a description of the assumptions that sequentially link inputs, activities, outputs and outcomes to intended impact(s). Although there are convincing arguments that better systems are created through user-centered design [41,42], iterative development [43], and building well architected health information systems [44,45], there is no evidence to demonstrate the connections between particular development processes and health outcomes. Furthermore, the literature includes some minor references to conceptual frameworks and theory, such as social action theory [46] and HIV behavior change theory [47], reports of why or how mHealth might impact individuals, social groups, institutions, or health systems were not identified in this review. mHealth interventions might benefit from the dozens if not hundreds of years of development of theories of individual, social, and institutional change, including social cognitive theory [48], unified theory of acceptance and use of technology [49], adoption of innovations [50], and others. A common set of theories of change and matrix for measurement will allow researchers to contribute to a common dialogue and build a stronger evidence-base around whether, why, and under what circumstances mHealth might improve the effectiveness and efficiencies of global HIV intervention.

Third, and as reported in the mHealth literature reviews, there remains a need to improve the rigor of mHealth research and evaluation. An implementation science agenda will drive the field towards more rigorous approaches to monitoring and evaluation, operations research, and impact evaluation [51], necessarily moving the literature from mostly descriptive studies to more quasi-experimental and experimental designs. RCTs, such as those reported by Pop-Eleches, Lester, and their colleagues [20,21], provide strong evidence of the utility of mHealth to address the HIV prevention and treatment cascade. However, when RCTs are not feasible or ethical in practice-based contexts, implementers and researchers can push for more rigorous quasi-experimental studies [52-54] and further grounding [55] and analytical rigor [56] in qualitative studies.

Additionally, improving rigor requires expanding beyond the current trend of external expertise, leadership, and management. An implementation science agenda might also require emphasis on participatory approaches to evaluation, which have often resulted in more relevant and actionable programmatic recommendations, internal capacity building, and a sustainable culture of research within programs. Engaging frontline program directors, community leaders, PLHIV, and marginalized communities is critical to addressing HIV globally and practitioners of implementation science suggest that this tradition is particularly meaningful in their scientific agenda [57].

mHealth & HIV Treatment & Prevention Programmatic Needs

There is now evidence that mHealth tools can improve linkage to care, retention in care, and adherence to ART, however there remain some critical gaps in the evaluation and implementation of mHealth solutions. Surprisingly, there is very sparse evidence on the use of mHealth to enhance VCT uptake. The increasing saturation of mobile phones among underserved communities around the world provides an opportunity for targeted and tailored VCT outreach, education, and communications campaigns. Although evidence supports the use of eHealth systems to improve supply chain management [58-61] for HIV/AIDS and other disease issues in LMICs --such as malaria treatment [62] --the literature does not report on the promising opportunities to use mobile devices to track medications and other supplies essential for HIV service delivery at scale. Similarly, the literature on the use of eHealth systems for CD4 screening [33] has not translated to any evidence around the utility of mHealth systems.

The literature describes mHealth implementations among diverse urban and rural communities around world, however there is a lack of focus on key populations at higher risk of HIV exposure. HIV and AIDS is distinct from most other diseases and health conditions in that HIV individuals often experience lifetime stigma and discrimination [63]. Moreover, behaviors related to acquisition of HIV infection are associated with social and economic vulnerabilities [63]. Key populations -- such as pregnant mothers, sex workers, users of injection drugs, and men who have sex with men -- are not only at higher risk for HIV infection, but are also less likely to access standard treatment and the other related HIV health services due to stigma and discrimination they face from the general population as well as providers [64-70]. Given the promise of mobile technology to deliver services beyond traditional clinical settings and to improve security and confidentiality of health information, greater attention to appropriately designed mHealth interventions is warranted.

Despite the feminization of HIV [71], few articles focus specifically on women and only two mention pregnant women as the target study group. One report describes a recently initiated RCT using mobile phones for data collection [72] and the other includes pregnant women in its sample but presents no findings relevant to PMTCT [21]. We found no articles that describe the use of mobile technology to support PMTCT programs, although one article on mHealth for improving efficiency of early infant diagnosis was published after the literature collection deadline [73]. The nearly complete absence of published data on mHealth for PMTCT is surprising given its priority with the global HIV-response community [74].

CONCLUSION

Our review of the evidence-based for mHealth and HIV reveals that the science and practice are evolving rapidly, but still in their early stages. Small-scale efforts, pilot projects, and preliminary descriptive studies are advancing toward increasingly systematic and rigorous monitoring/evaluation, operations research, and impact evaluation. However, there remains several gaps in an implementation science agenda. mHealth pilots must begin to scale and integrate into local and national HIV prevention and treatment programs, mHealth theoretical frameworks and program logic must be articulated and evaluated, and the overall rigor of mHealth research and evaluation must be improved to strengthen and provide actionable evidence for program leaders, policymakers, and funders.

There is evidence that mHealth tools can improve linkage to care, retention in care, and adherence to ART. Future mHealth efforts should address additional programmatic needs such as VCT uptake, PMTCT, laboratory management, and supply chain management. Most importantly, mHealth efforts must explicitly acknowledge the global focus on the most HIV-vulnerable communities, such as women, children, sex workers, MSM, and migrants.

Table 1.

Non-Research Literature

First Author	Year	Article Title	Type of Article	Summary Conclusions	Specific purpose of technology								Context
					Alerts & Reminders	Data Collection	Edu- cation	EMR/ EHR	Mapping	Decision Support	Info on Demand	Direct Comm	Popn	Rural/ Urban	Region
Blake	2008	Innovation in practice: mobile phone technology in patient care	Literature review	Mobile phones are becoming increasingly important to health promotion -- particularly dietary, smoking cessation, physical activity intervention -- and patient monitoring in chronic disease -- particularly cancer, asthma, and diabetes. HIV-related literature is mentioned with reference to smoking cessation interventions among PLHIV.								✔	General	Rural, Urban	Global
Boyer	2010	Wireless Technologies, Ubiquitous Computing and Mobile Health: Application to Drug Abuse Treatment and Compliance with HIV Therapies	Literature review	There is potential for extending the reach of behavioral interventions from clinical settings into natural environments with the use of mobile health technologies.								✔	General	Rural, Urban	Global
Chan	2010	A technology selection framework for supporting delivery of patient-oriented health interventions in developing countries	Position paper	A framework for selecting patient-oriented technologies in developing countries can be applied to health interventions across many domains to explore how and whether available technologies can support deliver of intrventions with target populations.	Overall review, not focused on specific technology								General	Rural, Urban	Global
Chi	2010	Mobile phones to improve HIV treatment adherence	Editorial comment	WelTel study provides some of the first randomised data for mobile phone-based health interventions, however a clearer understanding of the mechanism behind the intervention’s effectiveness could provide insight into why SMS worked to improve adherence to ARTs and how the intervention might be optimised and replicated elsewhere.	✔							✔	N/A	N/A	N/A
Chiasson	2010	HIV Prevention and Care in the Digital Age	Position paper	HIV prevention and care programs using digital media have great potential to cost-effectively meet the complex needs of diverse and often underserved populations living with or at high risk of HIV.	Overall review, not focused on specific technology								PLWHA, Providers. MSM	Rural, Urban	North America
Curioso	2010	Enhancing ‘M-Health’ With South- To-South Collaborations	Position paper	South-to-South partnerships are key to maximizing the benefits of mHealth technologies.	Overall review, not focused on specific technology								N/A	N/A	N/A
de Costa	2010	Design of a randomized trial to evaluate the influence of mobile phone reminders on adherence to first line antiretroviral treatment in South India - the HIVIND study protocol	RCT description	N/A	✔								PLWHA	Rural, Urban	Asia
Driscoll	2001	HIV/AIDS and information and communication technologies	Policy analysis	IDRC, either alone, or as a member of the UNDP-initiated coalition can ensure the responsible and ethical introduction and implementation of ICTs when defining programs and policies.	Overall review, not focused on specific technology								N/A	N/A	N/A
Evans	2007	A randomized trial evaluating Prosaptide for HIV-associated sensory neuropathies: use of an electronic diary to record neuropathic pain.	RCT, pharma efficacy trial	Electronic diary is a viable method for collecting patient information, particularly in regards to pain measurement, for a short period of time among diverse participants. However, study found that 6-week treatment with PRO was safe but not effective at reducing HIV-associated neuropathic pain.		✔							PLWHA	N/R	North America
Fahey	2003	Reminding patients by text message text reminders	Editorial Comment	Patient reminder systems might be financially supported through reverse billing.	✔								N/A	N/A	N/A
Fraser	2010	Implementing medical information systems in developing countries, what works and what doesn't	Position paper, Literature review	The mHealth approach is rapidly gaining ground in many developing countries, allowing real time data access and management in locations with no infrastructure other than a cell phone tower.	✔	✔		✔			✔		General	Rural, Urban	Global
Gallagher	2007	Use of Rapid Behavioral Assessments to Determine the Prevalence of HIV Risk Behaviors in High Risk Populations	Cross sectional survey	Rapid health behavioral assessments were successfully conducted in widely disparate circumstances and provided the participating health departments with important behavioral data. This data will be helpful in creating and maintaining programs aimed at preventing the spread of HIV.		✔							MSM	Urban	North America
Geibel	2008	Factors Associated with Self-reported Unprotected Anal Sex Among Male SW in Mombsa, Kenya	Cross sectional survey	PDA-based survey was effectively used to identify risk factors associated with anal sex for MSM sexx workers to inform development of targeted prevention strategies.		✔							SW, MSM	Urban	Africa
Kahn	2010	'Mobile' Health Needs and Opportunities in Developing Countries	Position paper	Various mHealth applications offer opportunities to respond to disease burden of developing countries. In reviewing the literature, there are several positive examples but little solid evaluation of clinical or economic performance.	Overall review, not focused on specific technology								General	N/A	Global
Leach-Lemens	2009	Using mobile phones in HIV care and prevention	Literature review, Position paper	Across the cases described, there are several underlying mHealth program characteristics that enable improved health care delivery & increased efficiency of healthcare systems. There remains a need to build a solid evidence-based of impact assessments.	Overall review, not focused on specific technology								General, PLWHA	Rural, Urban	Africa
Lester	2006	Cell phones: tightening the communication gap in resource-limited antiretroviral programmes?	Position paper	Members of a clinic in Kenya rarely receive health information from providers via phone and that over half of them would be willing to receive such information.	✔		✔				✔	✔	PLWHA, SW, Pregnant women	Rural	Africa
Lester	2008	Mobile phones: exceptional tools for HIV/AIDS, health, and crisis management	Position paper	Mobile phones offer an opportunity to expand health care services in resource poor settings.	Overall review, not focused on specific technology								PLWHA	Rural, Urban	Africa
Lester	2009	The HAART cell phone adherence trial: a randomized controlled trial protocol	RCT description	N/A	✔								PLWHA	Urban	Africa
Marcus	2009	NIH recognizes engineering professor's innovative research with major award	News update	Mobile phone diagnostic tools developed at UCLA can be used to measure CD4/CD8 count among PLWHA at point-of-care for faster and potentially less expensive lab results.									N/A	N/A	N/A
Padma	2010	Developing Solutions	News update	As people around the world become more connected, the global health community uses information and communication technology to combat HIV in the developing world.	✔								N/A	N/A	N/A
Price	2008	Texting appointment reminders reduces ‘Did not Attend’ rates, is popular with patients and is cost-effective	Editorial Comment	Text message reminder system was piloted in a sexual health clinic and preliminary outcomes data indicates improvement in "did not attend" rates.	✔								General	Urban	Europe
Rotheram-Borus	2011	Project Masihambisane: a cluster randomised controlled trial with peer mentors to improve outcomes for pregnant mothers living with HIV	RCT description	N/A	✔	✔						✔	Women, Pregnant Infants, PLWHA	Rural	Africa
Shet	2011	India calling: harnessing the promise of mobile phones for HIV healthcare	Position paper	Mobile phones have the potential to induce a paradigm shift in healthcare delivery in resource-limited settings by empowering patients to stay connected to healthcare providers, personalizing healthcare messages, facilitating collection of patient data and training rural professionals with health updates.		✔	✔			✔		✔	PLWHA	Rural, Urban	Global
Swendeman	2010	Innovation in sexually transmitted disease and HIV prevention: Internet and mobile phone delivery vehicles for global diffusion	Literature review	This electronic expansion will enable low-cost, highly engaging, and ubiquitous STD/HIV prevention and treatment support interventions at an unprecedented scale.	Overall review, not focused on specific technology								General	Rural, Urban	Global
Tolly	2009	Innovative use of cell phone technology for HIV/AIDS behavior change communitcation	Position paper	Three CellLife pilots explore the use of mobile phones for HIV services in South Africa, including HIV treatment information communication, adherence support, & widespread HIV education.	✔		✔				✔		PLWHA, General	Rural, Urban	Africa
Tomnay	2005	New technology and partner notification - why aren't we using them?	Position paper	By informing partners of HIV positive individuals, or identifying partners that could be in an at-risk scenario, the chance for HIV transmission could be significantly smaller. Information technology can play a pivotal part in the process, however, there are important ethical considerations to assess.	✔						✔	✔	PLWHA, Providers	Rural, Urban	North America, Europe
Vital Wave Consulting	2009	mHealth for Development: The Opportunity of Mobile Technology for Healthcare in the Developing World	Position paper	mHealth field is still in its early stages, however it has already begun to transform health and dozens of new mHealth applications are being implemented. To advance mHealth, dynamic multi-sector collaboration between governments, multilateral organizations, and private sector is needed.	✔	✔	✔	✔	✔	✔	✔	✔	General	Rural	Global

Table 2.

Research Literature

First Author	Year	Article Title	Implementation Science Component	Methods		Design			Study type	Specific purpose of technology								Context			Findings
				Quant	Qual	Multiple msmts	Control Group	Randomization	1=descriptive 2=relational 3=causal	Alerts & Reminders	Data Collection	Education	EMR/ EHR	Mapping	Decision Support	Info on Demand	Direct Comm	Popn	Rural/ Urban	Region
Ammassari	2011	Timed Short Messaging Service Improves Adherence and Virological Outcomes in HIV-1-Infected Patients With Suboptimal Adherence to Antiretroviral Therapy	Evaluation	✔		✔			2	✔								PLWHA	N/R	Europe	An intervention that provided short SMS text message reminders at the time of ART dosing, everyday, among adults with low-ART adherence in Italy was associated with improved self-reported adherence and viral load for participants during a 9-month trial.
Bernabe-Ortiz	2008	Handheld computers for self-administered sensitive data collection: A comparative study in Peru	Evaluation	✔			✔		2		✔							Young adults	Urban	South America	Compared to paper surveys, PDAs were useful for collecting information about sexual behavior in young people in Peru, eliciting equivalent responses to sensitive questions. This study demonstrates that it is feasible to develop a low-cost, open source application for PDAs to collect sexual behavior data.
Chirowodzam	2009	Using Participatory Methods and Geographic Information Systems (GIS) to Prepare for an HIV Community-Based Trial in Vulindlela, South Africa (Project Accept-HPTN 043)	Monitoring		✔				1		✔							General	Rural	Africa	Participatory GIS methods can be used to engage communities & enhance understanding of local context in prepraration for community-based HIV trial.
Cohen	2007	Time to use text reminders in genitourinary medicine clinics	Operations research	✔					1	✔								General	Urban	Europe	Among patients at a sexual health clinic in the UK, the vast majority own a mobile phone & view appointment text-reminders favorably. This suggests that text/voice reminders may reduce non-attendance rates.
Cornelius	2009	Receptivity of African American Adolescents to an HIV-Prevention Curriculum Enhanced by Text Messaging	Operations research		✔	✔			2	✔		✔						Youth, African American	Urban	North America	Adolescents were receptive to receiving text messages as a booster to the HIV education curriculum currently offered.
Crankshaw	2010	Exploring the Patterns of Use and the Feasibility of Using Cellular Phones for Clinic Appointment Reminders and Adherence Messages in an Antiretroviral Treatment Clinic, Durban, South Africa	Operations research	✔					1	✔								PLWHA	Urban	Africa	The use of mobile phones for HIV-patient outreach & reminders is acceptable to patients & feasible given patient-reported mobile phone use. Interventions targeting women must consider higher barriers to mobile phone access.
Curioso	2005	Design and Implementation of Cell-PREVEN: A Real-Time Surveillance System for Adverse Events Using Cell Phones in Peru	Monitoring	✔					1		✔							SW, Providers	Rural, Urban	South, Central, or Caribbean America	As demonstrated by this pilot, it is feasible to develop a health surveillance system based on mobile phones for real-time data collection in Peru.
Curioso	2007	Access, use and perceptions regarding Internet, cell phones and PDAs as a means for health promotion for people living with HIV in Peru	Operations research		✔				1									PLWHA	Urban	South, Central, or Caribbean America	Health promotion interventions using information and communication technology tools among people living with HIV in resource-constrained settings may be acceptable and feasible, and can build on existing patterns of use.
Donald	2007	Evaluation of use of cellphones to aid compliance with drug therapy for HIV patients	Evaluation		✔	✔			2		✔						✔	PLWHA, Providers	Urban	Africa	Community health workers found the Cell-Life mobile phone application to be highly usable for data collection, with ease-of-use improving during a six-month period of time. This suggests that Cell-Life facilitates the management of ARTs among PLHIV in South Africa.
Dwolatzky	2006	Linking the global positioning system (GPS) to a personal digital assistant (PDA) to support tuberculosis control in South Africa: a pilot study	Operations research / Evaluation	✔			✔		2					✔				Providers	Urban	Africa	GPS technology can improve the ability to locate and timeliness in locating patients' homes in informal settlements in South Africa. This suggests that GPS may improve the efficiency of HIV/TB treatment adherence programs.
Fraser	2007	Information Systems for Patient Follow-up and Chronic Management of HIV and Tuberculosis: a Life-saving Technology in Resource-poor Areas	Literature review		✔				1	✔	✔		✔					PLWHA, Providers	Urban, Rural	Global	Projects demonstrate that information systems can support and monitor HIV and MDR-TB projects as they scale up, tracking patients from initial diagnosis through treatment adherence. However, there is a lack of quantitative & impact evaluations in the literature to scientifically confirm this suggestion.
Kunutsor	2010	Using Mobile Phones to Improve Clinic Attendance Amongst an Antiretroviral Treatment Cohort in Rural Uganda: A Cross-sectional and Prospective Study	Evaluation	✔	✔	✔			2	✔								PLWHA	Rural	Africa	The use of mobile phones for patient appointment reminders among a an cohort of patients receiving ART in Uganda is highly acceptable and feasible for patients. Preliminary data indicates that most patients who miss appointments present for treatment within a few days after mobile phone recall.
Lazev	2004	Increasing access to smoking cessation treatment in a low-income, HIV-positive population: The feasibility of using cellular telephones	Evaluation	✔		✔			2								✔	PLWHA	Urban	North America	It is feasibile to use mobile phones to improve access to smoking cessation counseling for a low-income, multiethnic PLHIV.
Lester	2010	Effects of a mobile phone short message service on antiretroviral treatment adherence in Kenya (WelTel Kenya1): a randomised trial	Impact evaluation	✔		✔	✔	✔	3	✔								PLWHA	Rural, Urban	Africa	Patients who received SMS support had significantly improved ART adherence and rates of viral suppression.
Gold	2010	What's in a message? Delivering sexual health promotion to young people in Australia via text messaging.	Operations research / Monitoring		✔				1			✔						Young adults, Youth	Urban	Australia	Australian youth who participated in program focus groups reported that weekly SMS was an acceptable way to be engaged and educated on sexual health.
Juzang	2011	A pilot programme using mobile phones for HIV prevention.	Evaluation	✔		✔	✔		2			✔						Young adults	Urban	North America	US urban black teens who received 3 texts per week during a 12-week HIV education program showed improved behaviors, attitudes and knowledge related to HIV prevention after participating in the program. Low drop out rates show promise for acceptability of such an intervention.
Kaplan	2006	Can the ubiquitous power of mobile phones be used to improve health outcomes in developing countries?	Literature review		✔				1	Overall review, not focused on specific technology								General	Rural, Urban	Global	Although there is great promise for the use of mobile phones for global health, there is very little evidence that interventions improve clinical outcomes or cost-effectiveness.
Kho	2006	Use of Handheld Computers in Medical Education: A Systematic Review	Literature review		✔				1							✔		Providers	N/A	North America, Other	There are 67 articles on the use of PDAs in medical education, describing high levels of adoption, satisfaction, & use among trainees. evidence demonstrates that use of PDA decision support software resulted in improved knowledge & practice of evidence-based medicine.
Levine	2008	SEXINFO: a Sexual Health Text Messaging Service for San Francisco Youth	Evaluation	✔					1							✔		Youth	Urban	North America	SexInfo SMS referral service is a feasible and acceptable way for at-risk youths in San Francisco to receive sexual health information and referrals to sexual and reproductive health services.
Lim	2008	SMS STI: a review of the uses of mobile phone text messaging in sexual health	Literature review		✔				1	✔					✔		✔	PLWHA	Rural, Urban	Global	SMS has been applied in many ways to improve sexual health and although there is some evidence of its effectiveness, there is a need for more rigorous evaluation.
Perron	2010	Reduction of missed appointments at an urban primary care clinic: a randomised controlled study	Impact evaluation	✔			✔	✔	3	✔								General population	Urban	Europe	A patient reminder system, including SMS reminders, significantly increased patient attendance at medical outpatient clinics in Geneva. An intervention focused on specific patient characteristics may further increase the effectiveness of appointment reminders.
Pop-Eleches	2010	Mobile phone technologies improve adherence to antiretroviral treatment in a resource-limited setting: a randomized controlled trial of text message reminders	Impact evaluation	✔		✔	✔	✔	3	✔								PLWHA	Rural	Africa	These results suggest that SMS reminders may be an important tool to achieve optimal treatment response in resource-limited settings. Overall, weekly text message reminders increase adherence to ART. Daily reminders, on the other hand, failed to increase adherence.
Puccio	2006	The Use of Cell Phone Reminder Calls for Assisting HIV-Infected Adolescents and Young Adults to Adhere to Highly Active Antiretroviral Therapy: A Pilot Study	Evaluation	✔	✔	✔			2	✔							✔	PLWHA, Youth	Urban	North America	Mobile phone reminder calls were acceptible & feasible. There is some indication that reminders contribute to ART adherence, however, viral supression at the close of the 12-week study was inadequate.
Samal	2010	Digital Divide: Variation in Internet and Cellular Phone Use Among Women Attending an Urban Sexually Transmitted Infections Clinic	Operations research	✔					1	Not focused on specific technology								Women	Urban	North America	Although the majority of Baltimore patient respondents found ICTs acceptible, use of computers and internet was related to being young and educated while mobile phones use was more equitable. Web-based interventions for urban women may serve to widen health disparities, however mobile phone interventions may be more appropriate among underserved communities.
Shacham	2009	Can you hear me now? Limited use of technology among an urban HIV-infected cohort	Operations research	✔					1	Not focused on specific technology								PLWHA	Urban	North America	Disparities among internet, cell phone, and text messaging usage exist among HIV-infected individuals. In this particular urban US cohort of PLHIV, cell phone ownership was associated with being Caucasian, employed, more educated, and higher salary.
Shet	2010	Designing a Mobile Phone-Based Intervention to Promote Adherence to Antiretroviral Therapy in South India	Operations research	✔					1	✔								PLWHA	Rural, Urban	Asia	Patient attitudes about and access to mobile phones indicates that delivering ART adherence services, such as weekly automated voice reminders, via mobile phone in South India is feasible and acceptable.
Vidrine	2006	A randomized trial of a proactive cellular telephone intervention for smokers living with HIV/AIDS	Impact evaluation	✔		✔	✔	✔	3								✔	PLWHA	Urban	North America	As opposed to the usual care approach, those PLHIV who participated in a smoking cessation program with 8 mobile phone counseling sessions were 3.6 times more likely to have quit smoking at 3-months.
Vidrine	2006	Impact of a Cell Phone Intervention on Mediating Mechanisms of Smoking Cessation in Individuals Living with HIV/AIDS	Impact evaluation	✔		✔	✔	✔	3								✔	PLWHA	Urban	USA	See above. Additionally, participants in the mobile phone counseling intervention experienced greater reductions in anxiety and depression and increases in self-effiicacy.
Welz	2008	Anonymous HIV Testing with Participant-controlled Access to Results Using Handheld Computers: a New Model of HIV Testing Used in a Household Survey in Rural South Africa	Monitoring	✔					1		✔							General	Rural, Urban	Africa	The PDA-based data collection system used in South Africa demonstrated the potential to conduct biosurveillence while bringing VCT outreach to hard-to-reach communitiies with paper-free, confidential dissemination of HIV test results.
WHO	2011	WHO | Global Observatory for eHealth series - Volume 3 - New horizons for health through mobile technologies	N/A	✔	✔				1	Overall review, not focused on specific technology								N/A	N/A	Global	The survey identifies and describes the existence and maturity of mHealth activities, types of mHealth initiatives being conducted, status of monitoring and evaluation of mHealth initiatives, and barriers to implementation of mHealth initiatives within WHO Member States.
Ybarra	2007	Current Trends in Internet-and Cell Phone-based HIV Prevention and Intervention Programs	Literature review		✔				1	Overall review, not focused on specific technology								N/A	N/A	N/A	Although feasibility and acceptability of interventions have been well described in the literature, there are a limited number of evaluations of cellphone or internet based HIV prevention/intervention programs.

Table 3.

Overview of mHealth Literature

Category	Subcategory	Result (n)	Result (%)
Research	Yes	35	56%
	No	27	44%
Peer-reviewed	Yes	45	73%
	No	13	21%
Rural/ Urban	Urban	44	71%
	Rural	28	45%
Specific intervention population	PLWHA	28	45%
	General Popn	17	27%
	Providers	7	11%
	Youth/Teens/Young adults	6	10%
	Women	2	3%
	Pregnant Women	2	3%
	Infants/Children	1	2%
	Sex workers	3	5%
	Men who have sex w men	3	5%
	Users of injection drugs	0	0%
Region	Africa	18	29%
	North America	14	23%
	Europe	5	8%
	Latin America	4	6%
	Asia	3	5%
Purpose of  technology	Alerts & reminders	37	60%
	Data collection	15	24%
	Direct voice communication	15	24%
	Educational messaging	8	13%
	Info on Demand	7	11%
	EMR/EHR	4	6%
	Decision Support	3	5%
	Mapping	2	3%

Table 4.

Overview of mHealth Research

Category	Subcategory	Result (n)	Result (%)
Implementation Science Category	Literature review	6	17%
	Monitoring/ evaluation reports	16	46%
	Operations research	10	29%
	Impact evaluation	5	14%
Methods	Quantitative	24	69%
	Qualitative	16	46%
Design	Multiple measurements	12	34%
	Control group	10	29%
	Randomization	5	14%