BACKGROUND: Implementation of Computerized Provider Order Entry (CPOE) can fail or meet high levels of user resistance for a variety of reasons, including lack of attention to users' needs and the significant workflow changes induced and required by CPOE. End-user satisfaction is a critical factor in IT implementation. OBJECTIVE: The goal of this study was to identify criteria to select a valid and reliable questionnaire to measure end-user satisfaction with CPOE. METHODS: We developed seven criteria that can be used to select valid and reliable questionnaires. We applied the selection criteria to existing end-user satisfaction questionnaires. RESULTS: Most of the questionnaires used to measure end-user satisfaction have been tested for reliability and validity and most of the questionnaires have reasonably reliability and some sort of validity. However, only one questionnaire, the Physician Order Entry User Satisfaction and Usage Survey (POESUS) met most of the other criteria we developed to select a questionnaire to evaluate CPOE implementation. We used the POESUS in our study and compared the results with other studies. Results show that users are moderately satisfied with CPOE. CONCLUSION: Using the seven criteria we developed, it is possible to select reliable and valid questionnaires. We hope that in the future this will lead to an increasing number of studies using the same questionnaires. That will improve the possibilities for comparing the results of one study to another (benchmarking).
BACKGROUND: Implementation of Computerized Provider Order Entry (CPOE) can fail or meet high levels of user resistance for a variety of reasons, including lack of attention to users' needs and the significant workflow changes induced and required by CPOE. End-user satisfaction is a critical factor in IT implementation. OBJECTIVE: The goal of this study was to identify criteria to select a valid and reliable questionnaire to measure end-user satisfaction with CPOE. METHODS: We developed seven criteria that can be used to select valid and reliable questionnaires. We applied the selection criteria to existing end-user satisfaction questionnaires. RESULTS: Most of the questionnaires used to measure end-user satisfaction have been tested for reliability and validity and most of the questionnaires have reasonably reliability and some sort of validity. However, only one questionnaire, the Physician Order Entry User Satisfaction and Usage Survey (POESUS) met most of the other criteria we developed to select a questionnaire to evaluate CPOE implementation. We used the POESUS in our study and compared the results with other studies. Results show that users are moderately satisfied with CPOE. CONCLUSION: Using the seven criteria we developed, it is possible to select reliable and valid questionnaires. We hope that in the future this will lead to an increasing number of studies using the same questionnaires. That will improve the possibilities for comparing the results of one study to another (benchmarking).
Authors: Christa E Bartos; Douglas B Fridsma; Brian S Butler; Louis E Penrod; Michael J Becich; Rebecca S Crowley Journal: J Biomed Inform Date: 2008-03-04 Impact factor: 6.317
Authors: Peter Hoonakker; Pascale Carayon; Ayse Gurses; Roger Brown; Kerry McGuire; Adjhaporn Khunlertkit; James M Walker Journal: IIE Trans Healthc Syst Eng Date: 2011-10-12
Authors: Pascale Carayon; Randi Cartmill; Mary Ann Blosky; Roger Brown; Matthew Hackenberg; Peter Hoonakker; Ann Schoofs Hundt; Evan Norfolk; Tosha B Wetterneck; James M Walker Journal: J Am Med Inform Assoc Date: 2011-06-22 Impact factor: 4.497
Authors: Peter L T Hoonakker; Pascale Carayon; Roger L Brown; Randi S Cartmill; Tosha B Wetterneck; James M Walker Journal: J Am Med Inform Assoc Date: 2012-10-25 Impact factor: 4.497
Authors: Nicole E Werner; Rachel Rutkowski; Amy Graske; Mary K Finta; Craig R Sellers; Sandhya Seshadri; Manish N Shah Journal: Appl Ergon Date: 2020-05-16 Impact factor: 3.661
Authors: Tosha B Wetterneck; James M Walker; Mary Ann Blosky; Randi S Cartmill; Peter Hoonakker; Mark A Johnson; Evan Norfolk; Pascale Carayon Journal: J Am Med Inform Assoc Date: 2011-07-29 Impact factor: 4.497
Authors: Renata Rego Lins Fumis; Eduardo Leite Vieira Costa; Paulo Sergio Martins; Vladimir Pizzo; Ivens Augusto Souza; Guilherme de Paula Pinto Schettino Journal: Rev Bras Ter Intensiva Date: 2014 Jan-Mar
Authors: Pascale Carayon; Tosha B Wetterneck; A Joy Rivera-Rodriguez; Ann Schoofs Hundt; Peter Hoonakker; Richard Holden; Ayse P Gurses Journal: Appl Ergon Date: 2013-07-08 Impact factor: 3.661