Adam S Rothschild1, Harold P Lehmann. 1. Department of Biomedical Informatics, Columbia University, Vanderbilt Clinic 5th Floor, 622 West 168th Street, New York, NY 10032, USA. adam.rothschild@dbmi.columbia.edu
Abstract
OBJECTIVE: The aim of this study was to preliminarily determine the feasibility of probabilistically generating problem-specific computerized provider order entry (CPOE) pick-lists from a database of explicitly linked orders and problems from actual clinical cases. DESIGN: In a pilot retrospective validation, physicians reviewed internal medicine cases consisting of the admission history and physical examination and orders placed using CPOE during the first 24 hours after admission. They created coded problem lists and linked orders from individual cases to the problem for which they were most indicated. Problem-specific order pick-lists were generated by including a given order in a pick-list if the probability of linkage of order and problem (PLOP) equaled or exceeded a specified threshold. PLOP for a given linked order-problem pair was computed as its prevalence among the other cases in the experiment with the given problem. The orders that the reviewer linked to a given problem instance served as the reference standard to evaluate its system-generated pick-list. MEASUREMENTS: Recall, precision, and length of the pick-lists. RESULTS: Average recall reached a maximum of .67 with a precision of .17 and pick-list length of 31.22 at a PLOP threshold of 0. Average precision reached a maximum of .73 with a recall of .09 and pick-list length of .42 at a PLOP threshold of .9. Recall varied inversely with precision in classic information retrieval behavior. CONCLUSION: We preliminarily conclude that it is feasible to generate problem-specific CPOE pick-lists probabilistically from a database of explicitly linked orders and problems. Further research is necessary to determine the usefulness of this approach in real-world settings.
OBJECTIVE: The aim of this study was to preliminarily determine the feasibility of probabilistically generating problem-specific computerized provider order entry (CPOE) pick-lists from a database of explicitly linked orders and problems from actual clinical cases. DESIGN: In a pilot retrospective validation, physicians reviewed internal medicine cases consisting of the admission history and physical examination and orders placed using CPOE during the first 24 hours after admission. They created coded problem lists and linked orders from individual cases to the problem for which they were most indicated. Problem-specific order pick-lists were generated by including a given order in a pick-list if the probability of linkage of order and problem (PLOP) equaled or exceeded a specified threshold. PLOP for a given linked order-problem pair was computed as its prevalence among the other cases in the experiment with the given problem. The orders that the reviewer linked to a given problem instance served as the reference standard to evaluate its system-generated pick-list. MEASUREMENTS: Recall, precision, and length of the pick-lists. RESULTS: Average recall reached a maximum of .67 with a precision of .17 and pick-list length of 31.22 at a PLOP threshold of 0. Average precision reached a maximum of .73 with a recall of .09 and pick-list length of .42 at a PLOP threshold of .9. Recall varied inversely with precision in classic information retrieval behavior. CONCLUSION: We preliminarily conclude that it is feasible to generate problem-specific CPOE pick-lists probabilistically from a database of explicitly linked orders and problems. Further research is necessary to determine the usefulness of this approach in real-world settings.
Authors: Asif Ahmad; Phyllis Teater; Thomas D Bentley; Lynn Kuehn; Rajee R Kumar; Andrew Thomas; Hagop S Mekhjian Journal: J Am Med Inform Assoc Date: 2002 Jan-Feb Impact factor: 4.497
Authors: Joan S Ash; Paul N Gorman; Mary Lavelle; Thomas H Payne; Thomas A Massaro; Gerri L Frantz; Jason A Lyman Journal: J Am Med Inform Assoc Date: 2003 Mar-Apr Impact factor: 4.497
Authors: Lisa Pizziferri; Anne F Kittler; Lynn A Volk; Melissa M Honour; Sameer Gupta; Samuel Wang; Tiffany Wang; Margaret Lippincott; Qi Li; David W Bates Journal: J Biomed Inform Date: 2004-12-14 Impact factor: 6.317
Authors: Adam Wright; Dean F Sittig; James D Carpenter; Michael A Krall; Justine E Pang; Blackford Middleton Journal: AMIA Annu Symp Proc Date: 2010-11-13
Authors: Adam Wright; Joshua C Feblowitz; Justine E Pang; James D Carpenter; Michael A Krall; Blackford Middleton; Dean F Sittig Journal: Int J Med Inform Date: 2012-07-18 Impact factor: 4.046