OBJECTIVE: The study sought to evaluate a novel electronic health record (EHR) add-on application for chronic disease management that uses an integrated display to decrease user cognitive load, improve efficiency, and support clinical decision making. MATERIALS AND METHODS: We designed a chronic disease management application using the technology framework known as SMART on FHIR (Substitutable Medical Applications and Reusable Technologies on Fast Healthcare Interoperability Resources). We used mixed methods to obtain user feedback on a prototype to support ambulatory providers managing chronic obstructive pulmonary disease. Each participant managed 2 patient scenarios using the regular EHR with and without access to our prototype in block-randomized order. The primary outcome was the percentage of expert-recommended ideal care tasks completed. Timing, keyboard and mouse use, and participant surveys were also collected. User experiences were captured using a retrospective think-aloud interview analyzed by concept coding. RESULTS: With our prototype, the 13 participants completed more recommended care (81% vs 48%; P < .001) and recommended tasks per minute (0.8 vs 0.6; P = .03) over longer sessions (7.0 minutes vs 5.4 minutes; P = .006). Keystrokes per task were lower with the prototype (6 vs 18; P < .001). Qualitative themes elicited included the desire for reliable presentation of information which matches participants' mental models of disease and for intuitive navigation in order to decrease cognitive load. DISCUSSION: Participants completed more recommended care by taking more time when using our prototype. Interviews identified a tension between using the inefficient but familiar EHR vs learning to use our novel prototype. Concept coding of user feedback generated actionable insights. CONCLUSIONS: Mixed methods can support the design and evaluation of SMART on FHIR EHR add-on applications by enhancing understanding of the user experience.
OBJECTIVE: The study sought to evaluate a novel electronic health record (EHR) add-on application for chronic disease management that uses an integrated display to decrease user cognitive load, improve efficiency, and support clinical decision making. MATERIALS AND METHODS: We designed a chronic disease management application using the technology framework known as SMART on FHIR (Substitutable Medical Applications and Reusable Technologies on Fast Healthcare Interoperability Resources). We used mixed methods to obtain user feedback on a prototype to support ambulatory providers managing chronic obstructive pulmonary disease. Each participant managed 2 patient scenarios using the regular EHR with and without access to our prototype in block-randomized order. The primary outcome was the percentage of expert-recommended ideal care tasks completed. Timing, keyboard and mouse use, and participant surveys were also collected. User experiences were captured using a retrospective think-aloud interview analyzed by concept coding. RESULTS: With our prototype, the 13 participants completed more recommended care (81% vs 48%; P < .001) and recommended tasks per minute (0.8 vs 0.6; P = .03) over longer sessions (7.0 minutes vs 5.4 minutes; P = .006). Keystrokes per task were lower with the prototype (6 vs 18; P < .001). Qualitative themes elicited included the desire for reliable presentation of information which matches participants' mental models of disease and for intuitive navigation in order to decrease cognitive load. DISCUSSION: Participants completed more recommended care by taking more time when using our prototype. Interviews identified a tension between using the inefficient but familiar EHR vs learning to use our novel prototype. Concept coding of user feedback generated actionable insights. CONCLUSIONS: Mixed methods can support the design and evaluation of SMART on FHIR EHR add-on applications by enhancing understanding of the user experience.
Authors: Gregory D Salinas; James C Williamson; Ravi Kalhan; Byron Thomashow; Jodi L Scheckermann; John Walsh; Maziar Abdolrasulnia; Jill A Foster Journal: Int J Chron Obstruct Pulmon Dis Date: 2011-02-28
Authors: Polina V Kukhareva; Charlene Weir; Guilherme Del Fiol; Gregory A Aarons; Teresa Y Taft; Chelsey R Schlechter; Thomas J Reese; Rebecca L Curran; Claude Nanjo; Damian Borbolla; Catherine J Staes; Keaton L Morgan; Heidi S Kramer; Carole H Stipelman; Julie H Shakib; Michael C Flynn; Kensaku Kawamoto Journal: J Biomed Inform Date: 2022-02-12 Impact factor: 6.317
Authors: Richard L Bradshaw; Kensaku Kawamoto; Kimberly A Kaphingst; Wendy K Kohlmann; Rachel Hess; Michael C Flynn; Claude J Nanjo; Phillip B Warner; Jianlin Shi; Keaton Morgan; Kadyn Kimball; Pallavi Ranade-Kharkar; Ophira Ginsburg; Melody Goodman; Rachelle Chambers; Devin Mann; Scott P Narus; Javier Gonzalez; Shane Loomis; Priscilla Chan; Rachel Monahan; Emerson P Borsato; David E Shields; Douglas K Martin; Cecilia M Kessler; Guilherme Del Fiol Journal: J Am Med Inform Assoc Date: 2022-04-13 Impact factor: 4.497
Authors: Brian P Jenssen; Dean J Karavite; Shannon Kelleher; Ekaterina Nekrasova; Jeritt G Thayer; Raj Ratwani; Judy Shea; Emara Nabi-Burza; Jeremy E Drehmer; Jonathan P Winickoff; Robert W Grundmeier; Robert A Schnoll; Alexander G Fiks Journal: Appl Clin Inform Date: 2022-05-18 Impact factor: 2.762
Authors: Shinji Tarumi; Wataru Takeuchi; George Chalkidis; Salvador Rodriguez-Loya; Junichi Kuwata; Michael Flynn; Kyle M Turner; Farrant H Sakaguchi; Charlene Weir; Heidi Kramer; David E Shields; Phillip B Warner; Polina Kukhareva; Hideyuki Ban; Kensaku Kawamoto Journal: Methods Inf Med Date: 2021-05-11 Impact factor: 2.176
Authors: Howard R Strasberg; Bryn Rhodes; Guilherme Del Fiol; Robert A Jenders; Peter J Haug; Kensaku Kawamoto Journal: J Am Med Inform Assoc Date: 2021-07-30 Impact factor: 7.942
Authors: Jeritt G Thayer; Daria F Ferro; Jeffrey M Miller; Dean Karavite; Robert W Grundmeier; Levon Utidjian; Joseph J Zorc Journal: J Am Med Inform Assoc Date: 2021-07-14 Impact factor: 4.497
Authors: Kensaku Kawamoto; Polina V Kukhareva; Charlene Weir; Michael C Flynn; Claude J Nanjo; Douglas K Martin; Phillip B Warner; David E Shields; Salvador Rodriguez-Loya; Richard L Bradshaw; Ryan C Cornia; Thomas J Reese; Heidi S Kramer; Teresa Taft; Rebecca L Curran; Keaton L Morgan; Damian Borbolla; Maia Hightower; William J Turnbull; Michael B Strong; Wendy W Chapman; Travis Gregory; Carole H Stipelman; Julie H Shakib; Rachel Hess; Jonathan P Boltax; Joseph P Habboushe; Farrant Sakaguchi; Kyle M Turner; Scott P Narus; Shinji Tarumi; Wataru Takeuchi; Hideyuki Ban; David W Wetter; Cho Lam; Tanner J Caverly; Angela Fagerlin; Chuck Norlin; Daniel C Malone; Kimberly A Kaphingst; Wendy K Kohlmann; Benjamin S Brooke; Guilherme Del Fiol Journal: JAMIA Open Date: 2021-07-31