OBJECTIVE: Computerized clinical reminders (CRs) were designed to reduce clinicians' reliance on their memory and to present evidence-based guidelines at point of care. However, the literature indicates that CR adoption and effectiveness has been variable. We examined the impact of four design modifications to CR software on learnability, efficiency, usability, and workload for intake nursing personnel in an outpatient clinic setting. These modifications were included in a redesign primarily to address barriers to effective CR use identified during a previous field study. DESIGN: In a simulation experiment, 16 nurses used prototypes of the current and redesigned system in a within-subject comparison for five simulated patient encounters. Prior to the experimental session, participants completed an exploration session, where "learnability" of the current and redesigned systems was assessed. MEASUREMENTS: Time, performance, and survey data were analyzed in conjunction with semi-structured debrief interview data. RESULTS: The redesign was found to significantly increase learnability for first-time users as measured by time to complete the first CR, efficiency as measured by task completion time for two of five patient scenarios, usability as determined by all three groupings of questions taken from a commonly used survey instrument, and two of six workload subscales of the NASA Task Load Index (TLX) survey: mental workload and frustration. CONCLUSION: Modest design modifications to existing CR software positively impacted variables that likely would increase the willingness for first-time nursing personnel to adopt and consistently use CRs.
OBJECTIVE: Computerized clinical reminders (CRs) were designed to reduce clinicians' reliance on their memory and to present evidence-based guidelines at point of care. However, the literature indicates that CR adoption and effectiveness has been variable. We examined the impact of four design modifications to CR software on learnability, efficiency, usability, and workload for intake nursing personnel in an outpatient clinic setting. These modifications were included in a redesign primarily to address barriers to effective CR use identified during a previous field study. DESIGN: In a simulation experiment, 16 nurses used prototypes of the current and redesigned system in a within-subject comparison for five simulated patient encounters. Prior to the experimental session, participants completed an exploration session, where "learnability" of the current and redesigned systems was assessed. MEASUREMENTS: Time, performance, and survey data were analyzed in conjunction with semi-structured debrief interview data. RESULTS: The redesign was found to significantly increase learnability for first-time users as measured by time to complete the first CR, efficiency as measured by task completion time for two of five patient scenarios, usability as determined by all three groupings of questions taken from a commonly used survey instrument, and two of six workload subscales of the NASA Task Load Index (TLX) survey: mental workload and frustration. CONCLUSION: Modest design modifications to existing CR software positively impacted variables that likely would increase the willingness for first-time nursing personnel to adopt and consistently use CRs.
Authors: S Blake Wachter; Jim Agutter; Noah Syroid; Frank Drews; Matthew B Weinger; Dwayne Westenskow Journal: J Am Med Inform Assoc Date: 2003-03-28 Impact factor: 4.497
Authors: Elizabeth A McGlynn; Steven M Asch; John Adams; Joan Keesey; Jennifer Hicks; Alison DeCristofaro; Eve A Kerr Journal: N Engl J Med Date: 2003-06-26 Impact factor: 91.245
Authors: J G Demakis; C Beauchamp; W L Cull; R Denwood; S A Eisen; R Lofgren; K Nichol; J Woolliscroft; W G Henderson Journal: JAMA Date: 2000-09-20 Impact factor: 56.272
Authors: S Blake Wachter; Ken Johnson; Robert Albert; Noah Syroid; Frank Drews; Dwayne Westenskow Journal: J Am Med Inform Assoc Date: 2006-08-23 Impact factor: 4.497
Authors: Mindy Flanagan; Nicole Arbuckle; Jason J Saleem; Laura G Militello; David A Haggstrom; Bradley N Doebbeling Journal: AMIA Annu Symp Proc Date: 2011-10-22
Authors: David A Haggstrom; Jason J Saleem; Alissa L Russ; Josette Jones; Scott A Russell; Neale R Chumbler Journal: J Am Med Inform Assoc Date: 2011-10-08 Impact factor: 4.497
Authors: Alissa L Russ; Darrell A Baker; W Jeffrey Fahner; Bryce S Milligan; Leeann Cox; Heather K Hagg; Jason J Saleem Journal: AMIA Annu Symp Proc Date: 2010-11-13