Adam J Schoenfeld1, Jason M Davies2, Ben J Marafino1, Mitzi Dean1, Colette DeJong3, Naomi S Bardach4, Dhruv S Kazi5, W John Boscardin6, Grace A Lin7, Reena Duseja8, Y John Mei7, Ateev Mehrotra9, R Adams Dudley10. 1. Center for Healthcare Value, University of California, San Francisco (UCSF)2Philip R. Lee Institute for Health Policy Studies, UCSF. 2. Center for Healthcare Value, University of California, San Francisco (UCSF)2Philip R. Lee Institute for Health Policy Studies, UCSF3Department of Neurosurgery, UCSF. 3. Center for Healthcare Value, University of California, San Francisco (UCSF)2Philip R. Lee Institute for Health Policy Studies, UCSF4Department of Medicine, UC (University of California) Berkeley-UCSF Joint Medical Program. 4. Center for Healthcare Value, University of California, San Francisco (UCSF)2Philip R. Lee Institute for Health Policy Studies, UCSF5Department of Pediatrics, UCSF. 5. Philip R. Lee Institute for Health Policy Studies, UCSF6Department of Medicine, UCSF. 6. Department of Medicine, UCSF7Department of Emergency Medicine, UCSF. 7. Center for Healthcare Value, University of California, San Francisco (UCSF)2Philip R. Lee Institute for Health Policy Studies, UCSF6Department of Medicine, UCSF. 8. Philip R. Lee Institute for Health Policy Studies, UCSF7Department of Emergency Medicine, UCSF. 9. Department of Health Care Policy, Harvard Medical School, Boston, Massachusetts. 10. Center for Healthcare Value, University of California, San Francisco (UCSF)2Philip R. Lee Institute for Health Policy Studies, UCSF6Department of Medicine, UCSF9Department of Epidemiology and Biostatistics, UCSF.
Abstract
IMPORTANCE: Commercial virtual visits are an increasingly popular model of health care for the management of common acute illnesses. In commercial virtual visits, patients access a website to be connected synchronously-via videoconference, telephone, or webchat-to a physician with whom they have no prior relationship. To date, whether the care delivered through those websites is similar or quality varies among the sites has not been assessed. OBJECTIVE: To assess the variation in the quality of urgent health care among virtual visit companies. DESIGN, SETTING, AND PARTICIPANTS: This audit study used 67 trained standardized patients who presented to commercial virtual visit companies with the following 6 common acute illnesses: ankle pain, streptococcal pharyngitis, viral pharyngitis, acute rhinosinusitis, low back pain, and recurrent female urinary tract infection. The 8 commercial virtual visit websites with the highest web traffic were selected for audit, for a total of 599 visits. Data were collected from May 1, 2013, to July 30, 2014, and analyzed from July 1, 2014, to September 1, 2015. MAIN OUTCOMES AND MEASURES: Completeness of histories and physical examinations, the correct diagnosis (vs an incorrect or no diagnosis), and adherence to guidelines of key management decisions. RESULTS: Sixty-seven standardized patients completed 599 commercial virtual visits during the study period. Histories and physical examinations were complete in 417 visits (69.6%; 95% CI, 67.7%-71.6%); diagnoses were correctly named in 458 visits (76.5%; 95% CI, 72.9%-79.9%), and key management decisions were adherent to guidelines in 325 visits (54.3%; 95% CI, 50.2%-58.3%). Rates of guideline-adherent care ranged from 206 visits (34.4%) to 396 visits (66.1%) across the 8 websites. Variation across websites was significantly greater for viral pharyngitis and acute rhinosinusitis (adjusted rates, 12.8% to 82.1%) than for streptococcal pharyngitis and low back pain (adjusted rates, 74.6% to 96.5%) or ankle pain and recurrent urinary tract infection (adjusted rates, 3.4% to 40.4%). No statistically significant variation in guideline adherence by mode of communication (videoconference vs telephone vs webchat) was found. CONCLUSIONS AND RELEVANCE: Significant variation in quality was found among companies providing virtual visits for management of common acute illnesses. More variation was found in performance for some conditions than for others, but no variation by mode of communication.
IMPORTANCE: Commercial virtual visits are an increasingly popular model of health care for the management of common acute illnesses. In commercial virtual visits, patients access a website to be connected synchronously-via videoconference, telephone, or webchat-to a physician with whom they have no prior relationship. To date, whether the care delivered through those websites is similar or quality varies among the sites has not been assessed. OBJECTIVE: To assess the variation in the quality of urgent health care among virtual visit companies. DESIGN, SETTING, AND PARTICIPANTS: This audit study used 67 trained standardized patients who presented to commercial virtual visit companies with the following 6 common acute illnesses: ankle pain, streptococcal pharyngitis, viral pharyngitis, acute rhinosinusitis, low back pain, and recurrent female urinary tract infection. The 8 commercial virtual visit websites with the highest web traffic were selected for audit, for a total of 599 visits. Data were collected from May 1, 2013, to July 30, 2014, and analyzed from July 1, 2014, to September 1, 2015. MAIN OUTCOMES AND MEASURES: Completeness of histories and physical examinations, the correct diagnosis (vs an incorrect or no diagnosis), and adherence to guidelines of key management decisions. RESULTS: Sixty-seven standardized patients completed 599 commercial virtual visits during the study period. Histories and physical examinations were complete in 417 visits (69.6%; 95% CI, 67.7%-71.6%); diagnoses were correctly named in 458 visits (76.5%; 95% CI, 72.9%-79.9%), and key management decisions were adherent to guidelines in 325 visits (54.3%; 95% CI, 50.2%-58.3%). Rates of guideline-adherent care ranged from 206 visits (34.4%) to 396 visits (66.1%) across the 8 websites. Variation across websites was significantly greater for viral pharyngitis and acute rhinosinusitis (adjusted rates, 12.8% to 82.1%) than for streptococcal pharyngitis and low back pain (adjusted rates, 74.6% to 96.5%) or ankle pain and recurrent urinary tract infection (adjusted rates, 3.4% to 40.4%). No statistically significant variation in guideline adherence by mode of communication (videoconference vs telephone vs webchat) was found. CONCLUSIONS AND RELEVANCE: Significant variation in quality was found among companies providing virtual visits for management of common acute illnesses. More variation was found in performance for some conditions than for others, but no variation by mode of communication.
Authors: Kalpana Gupta; Thomas M Hooton; Kurt G Naber; Björn Wullt; Richard Colgan; Loren G Miller; Gregory J Moran; Lindsay E Nicolle; Raul Raz; Anthony J Schaeffer; David E Soper Journal: Clin Infect Dis Date: 2011-03-01 Impact factor: 9.079
Authors: Ateev Mehrotra; Suzanne Paone; G Daniel Martich; Steven M Albert; Grant J Shevchik Journal: JAMA Intern Med Date: 2013-01-14 Impact factor: 21.873
Authors: Alan Rosenberg; Abiy Agiro; Marc Gottlieb; John Barron; Peter Brady; Ying Liu; Cindy Li; Andrea DeVries Journal: JAMA Intern Med Date: 2015-12 Impact factor: 21.873
Authors: Kathryn A Martinez; Mark Rood; Nikhyl Jhangiani; Lei Kou; Susannah Rose; Adrienne Boissy; Michael B Rothberg Journal: J Gen Intern Med Date: 2018-08-15 Impact factor: 5.128
Authors: Lauren Cheung; Tiffany I Leung; Victoria Y Ding; Jonathan X Wang; Justin Norden; Manisha Desai; Robert A Harrington; Sumbul Desai Journal: Telemed J E Health Date: 2018-09-07 Impact factor: 3.536
Authors: Radhika Rastogi; Kathryn A Martinez; Niyati Gupta; Mark Rood; Michael B Rothberg Journal: J Gen Intern Med Date: 2019-10-30 Impact factor: 5.128
Authors: Allison A Lewinski; Caitlin Sullivan; Kelli D Allen; Matthew J Crowley; Jennifer M Gierisch; Karen M Goldstein; Kaileigh Gray; Susan N Hastings; George L Jackson; Felicia McCant; Abigail Shapiro; Matthew Tucker; Carolyn Turvey; Leah L Zullig; Hayden B Bosworth Journal: J Gen Intern Med Date: 2021-01-26 Impact factor: 6.473
Authors: Nicholas M Mohr; Kalyn D Campbell; Morgan B Swanson; Fred Ullrich; Kimberly A Merchant; Marcia M Ward Journal: J Telemed Telecare Date: 2020-01-05 Impact factor: 6.344