Benjamin Kinnear1,2, Matthew Kelleher3,4, Dana Sall4, Daniel P Schauer4, Eric J Warm4, Andrea Kachelmeyer3, Abigail Martini3, Daniel J Schumacher3. 1. Department of Pediatrics, University of Cincinnati College of Medicine, , Cincinnati, OH, USA. kinneabn@ucmail.uc.edu. 2. Department of Internal Medicine, University of Cincinnati College of Medicine, Cincinnati, OH, USA. kinneabn@ucmail.uc.edu. 3. Department of Pediatrics, University of Cincinnati College of Medicine, , Cincinnati, OH, USA. 4. Department of Internal Medicine, University of Cincinnati College of Medicine, Cincinnati, OH, USA.
Abstract
BACKGROUND: Graduate medical education (GME) training has long-lasting effects on patient care quality. Despite this, few GME programs use clinical care measures as part of resident assessment. Furthermore, there is no gold standard to identify clinical care measures that are reflective of resident care. Resident-sensitive quality measures (RSQMs), defined as "measures that are meaningful in patient care and are most likely attributable to resident care," have been developed using consensus methodology and piloted in pediatric emergency medicine. However, this approach has not been tested in internal medicine (IM). OBJECTIVE: To develop RSQMs for a general internal medicine (GIM) inpatient residency rotation using previously described consensus methods. DESIGN: The authors used two consensus methods, nominal group technique (NGT) and a subsequent Delphi method, to generate RSQMs for a GIM inpatient rotation. RSQMs were generated for specific clinical conditions found on a GIM inpatient rotation, as well as for general care on a GIM ward. PARTICIPANTS: NGT participants included nine IM and medicine-pediatrics (MP) residents and six IM and MP faculty members. The Delphi group included seven IM and MP residents and seven IM and MP faculty members. MAIN MEASURES: The number and description of RSQMs generated during this process. KEY RESULTS: Consensus methods resulted in 89 RSQMs with the following breakdown by condition: GIM general care-21, diabetes mellitus-16, hyperkalemia-14, COPD-13, hypertension-11, pneumonia-10, and hypokalemia-4. All RSQMs were process measures, with 48% relating to documentation and 51% relating to orders. Fifty-eight percent of RSQMs were related to the primary admitting diagnosis, while 42% could also be related to chronic comorbidities that require management during an admission. CONCLUSIONS: Consensus methods resulted in 89 RSQMs for a GIM inpatient service. While all RSQMs were process measures, they may still hold value in learner assessment, formative feedback, and program evaluation.
BACKGROUND: Graduate medical education (GME) training has long-lasting effects on patient care quality. Despite this, few GME programs use clinical care measures as part of resident assessment. Furthermore, there is no gold standard to identify clinical care measures that are reflective of resident care. Resident-sensitive quality measures (RSQMs), defined as "measures that are meaningful in patient care and are most likely attributable to resident care," have been developed using consensus methodology and piloted in pediatric emergency medicine. However, this approach has not been tested in internal medicine (IM). OBJECTIVE: To develop RSQMs for a general internal medicine (GIM) inpatient residency rotation using previously described consensus methods. DESIGN: The authors used two consensus methods, nominal group technique (NGT) and a subsequent Delphi method, to generate RSQMs for a GIM inpatient rotation. RSQMs were generated for specific clinical conditions found on a GIM inpatient rotation, as well as for general care on a GIM ward. PARTICIPANTS: NGT participants included nine IM and medicine-pediatrics (MP) residents and six IM and MP faculty members. The Delphi group included seven IM and MP residents and seven IM and MP faculty members. MAIN MEASURES: The number and description of RSQMs generated during this process. KEY RESULTS: Consensus methods resulted in 89 RSQMs with the following breakdown by condition: GIM general care-21, diabetes mellitus-16, hyperkalemia-14, COPD-13, hypertension-11, pneumonia-10, and hypokalemia-4. All RSQMs were process measures, with 48% relating to documentation and 51% relating to orders. Fifty-eight percent of RSQMs were related to the primary admitting diagnosis, while 42% could also be related to chronic comorbidities that require management during an admission. CONCLUSIONS: Consensus methods resulted in 89 RSQMs for a GIM inpatient service. While all RSQMs were process measures, they may still hold value in learner assessment, formative feedback, and program evaluation.
Entities:
Keywords:
assessment; competency-based medical education; graduate medical education; quality
Authors: Alina Smirnova; Stefanie S Sebok-Syer; Saad Chahine; Adina L Kalet; Robyn Tamblyn; Kiki M J M H Lombarts; Cees P M van der Vleuten; Daniel J Schumacher Journal: Acad Med Date: 2019-05 Impact factor: 6.893
Authors: Susan Humphrey-Murto; Lara Varpio; Timothy J Wood; Carol Gonsalves; Lee-Anne Ufholz; Kelly Mascioli; Carol Wang; Thomas Foth Journal: Acad Med Date: 2017-10 Impact factor: 6.893
Authors: Matthew Kelleher; Benjamin Kinnear; Dana Sall; Daniel Schumacher; Daniel P Schauer; Eric J Warm; Ben Kelcey Journal: Acad Med Date: 2020-04 Impact factor: 6.893
Authors: Daniel J Schumacher; Abigail Martini; Eric Holmboe; Carol Carraccio; Cees van der Vleuten; Brad Sobolewski; Jamiu Busari; Terri L Byczkowski Journal: Acad Med Date: 2020-08 Impact factor: 6.893
Authors: Lisa L Willett; Gustavo R Heudebert; Katri P Palonen; F Stanford Massie; Catarina I Kiefe; Jeroan J Allison; Joshua Richman; Thomas K Houston Journal: Teach Learn Med Date: 2009 Apr-Jun Impact factor: 2.414