Yiye Zhang1, Rema Padman2, James E Levin3. 1. School of Information Systems Management, H John Heinz III College, Carnegie Mellon University, Pittsburgh, Pennsylvania, USA. 2. H John Heinz III College, Carnegie Mellon University, Pittsburgh, Pennsylvania, USA. 3. (Late) CMIO, Children's Hospital of Pittsburgh of UPMC, Pittsburgh, Pennsylvania, USA.
Abstract
OBJECTIVE: Evidence indicates that users incur significant physical and cognitive costs in the use of order sets, a core feature of computerized provider order entry systems. This paper develops data-driven approaches for automating the construction of order sets that match closely with user preferences and workflow while minimizing physical and cognitive workload. MATERIALS AND METHODS: We developed and tested optimization-based models embedded with clustering techniques using physical and cognitive click cost criteria. By judiciously learning from users' actual actions, our methods identify items for constituting order sets that are relevant according to historical ordering data and grouped on the basis of order similarity and ordering time. We evaluated performance of the methods using 47,099 orders from the year 2011 for asthma, appendectomy and pneumonia management in a pediatric inpatient setting. RESULTS: In comparison with existing order sets, those developed using the new approach significantly reduce the physical and cognitive workload associated with usage by 14-52%. This approach is also capable of accommodating variations in clinical conditions that affect order set usage and development. DISCUSSION: There is a critical need to investigate the cognitive complexity imposed on users by complex clinical information systems, and to design their features according to 'human factors' best practices. Optimizing order set generation using cognitive cost criteria introduces a new approach that can potentially improve ordering efficiency, reduce unintended variations in order placement, and enhance patient safety. CONCLUSIONS: We demonstrate that data-driven methods offer a promising approach for designing order sets that are generalizable, data-driven, condition-based, and up to date with current best practices. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.
OBJECTIVE: Evidence indicates that users incur significant physical and cognitive costs in the use of order sets, a core feature of computerized provider order entry systems. This paper develops data-driven approaches for automating the construction of order sets that match closely with user preferences and workflow while minimizing physical and cognitive workload. MATERIALS AND METHODS: We developed and tested optimization-based models embedded with clustering techniques using physical and cognitive click cost criteria. By judiciously learning from users' actual actions, our methods identify items for constituting order sets that are relevant according to historical ordering data and grouped on the basis of order similarity and ordering time. We evaluated performance of the methods using 47,099 orders from the year 2011 for asthma, appendectomy and pneumonia management in a pediatric inpatient setting. RESULTS: In comparison with existing order sets, those developed using the new approach significantly reduce the physical and cognitive workload associated with usage by 14-52%. This approach is also capable of accommodating variations in clinical conditions that affect order set usage and development. DISCUSSION: There is a critical need to investigate the cognitive complexity imposed on users by complex clinical information systems, and to design their features according to 'human factors' best practices. Optimizing order set generation using cognitive cost criteria introduces a new approach that can potentially improve ordering efficiency, reduce unintended variations in order placement, and enhance patient safety. CONCLUSIONS: We demonstrate that data-driven methods offer a promising approach for designing order sets that are generalizable, data-driven, condition-based, and up to date with current best practices. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.
Entities:
Keywords:
CPOE; Cognitive Workload; Order Set; Usability
Authors: Asif Ahmad; Phyllis Teater; Thomas D Bentley; Lynn Kuehn; Rajee R Kumar; Andrew Thomas; Hagop S Mekhjian Journal: J Am Med Inform Assoc Date: 2002 Jan-Feb Impact factor: 4.497
Authors: Clement J McDonald; J Marc Overhage; Burke W Mamlin; Paul D Dexter; William M Tierney Journal: J Am Med Inform Assoc Date: 2004 Mar-Apr Impact factor: 4.497
Authors: Nathan C Hulse; Guilherme Del Fiol; Richard L Bradshaw; Lorrie K Roemer; Roberto A Rocha Journal: J Biomed Inform Date: 2007-05-18 Impact factor: 6.317
Authors: Blackford Middleton; Meryl Bloomrosen; Mark A Dente; Bill Hashmat; Ross Koppel; J Marc Overhage; Thomas H Payne; S Trent Rosenbloom; Charlotte Weaver; Jiajie Zhang Journal: J Am Med Inform Assoc Date: 2013-01-25 Impact factor: 4.497
Authors: Johanna I Westbrook; Melissa T Baysari; Ling Li; Rosemary Burke; Katrina L Richardson; Richard O Day Journal: J Am Med Inform Assoc Date: 2013-05-30 Impact factor: 4.497
Authors: Jason K Wang; Jason Hom; Santhosh Balasubramanian; Alejandro Schuler; Nigam H Shah; Mary K Goldstein; Michael T M Baiocchi; Jonathan H Chen Journal: J Biomed Inform Date: 2018-09-07 Impact factor: 6.317
Authors: Jonathan H Chen; Muthuraman Alagappan; Mary K Goldstein; Steven M Asch; Russ B Altman Journal: Int J Med Inform Date: 2017-03-18 Impact factor: 4.046