Daniel P Schauer1, Benjamin Kinnear2, Matthew Kelleher2, Dana Sall3,4, Daniel J Schumacher5, Eric J Warm6. 1. Department of Internal Medicine, University of Cincinnati, PO Box 670535, Cincinnati, OH, 45267-0535, USA. Daniel.Schauer@uc.edu. 2. Department of Pediatrics, College of Medicine, University of Cincinnati, Cincinnati, OH, USA. 3. HonorHealth Thompson Peak Medical Center, Scottsdale, USA. 4. University of Arizona College of Medicine, Phoenix, AZ, USA. 5. Department of Pediatrics, , College of Medicine, Cincinnati Children's Hospital/University of Cincinnati, Cincinnati, OH, USA. 6. Department of Internal Medicine, University of Cincinnati, PO Box 670535, Cincinnati, OH, 45267-0535, USA.
Abstract
BACKGROUND: Clinical competency committees (CCCs) and residency program leaders may find it difficult to interpret workplace-based assessment (WBA) ratings knowing that contextual factors and bias play a large role. OBJECTIVE: We describe the development of an expected entrustment score for resident performance within the context of our well-developed Observable Practice Activity (OPA) WBA system. DESIGN: Observational study PARTICIPANTS: Internal medicine residents MAIN MEASURE: Entrustment KEY RESULTS: Each individual resident had observed entrustment scores with a unique relationship to the expected entrustment scores. Many residents' observed scores oscillated closely around the expected scores. However, distinct performance patterns did emerge. CONCLUSIONS: We used regression modeling and leveraged large numbers of historical WBA data points to produce an expected entrustment score that served as a guidepost for performance interpretation.
BACKGROUND: Clinical competency committees (CCCs) and residency program leaders may find it difficult to interpret workplace-based assessment (WBA) ratings knowing that contextual factors and bias play a large role. OBJECTIVE: We describe the development of an expected entrustment score for resident performance within the context of our well-developed Observable Practice Activity (OPA) WBA system. DESIGN: Observational study PARTICIPANTS: Internal medicine residents MAIN MEASURE: Entrustment KEY RESULTS: Each individual resident had observed entrustment scores with a unique relationship to the expected entrustment scores. Many residents' observed scores oscillated closely around the expected scores. However, distinct performance patterns did emerge. CONCLUSIONS: We used regression modeling and leveraged large numbers of historical WBA data points to produce an expected entrustment score that served as a guidepost for performance interpretation.
Authors: Eric J Warm; Justin D Held; Michael Hellmann; Matthew Kelleher; Benjamin Kinnear; Caroline Lee; Jennifer K O'Toole; Bradley Mathis; Caroline Mueller; Dana Sall; Jonathan Tolentino; Daniel P Schauer Journal: Acad Med Date: 2016-10 Impact factor: 6.893
Authors: Matthew Kelleher; Benjamin Kinnear; Dana Sall; Daniel Schumacher; Daniel P Schauer; Eric J Warm; Ben Kelcey Journal: Acad Med Date: 2020-04 Impact factor: 6.893
Authors: Rose Hatala; Jacqueline Gutman; Matthew Lineberry; Marc Triola; Martin Pusic Journal: Adv Health Sci Educ Theory Pract Date: 2018-08-31 Impact factor: 3.853