Weifeng Weng1, Brian J Hess2, Lorna A Lynn3, Rebecca S Lipner3. 1. American Board of Internal Medicine, 510 Walnut Street, Suite 1700, Philadelphia, PA, 19106, USA. wweng@abim.org. 2. Hess Consulting, St-Nicolas, Québec, Canada. 3. American Board of Internal Medicine, 510 Walnut Street, Suite 1700, Philadelphia, PA, 19106, USA.
Abstract
BACKGROUND: Patients with osteoporosis can sustain fractures following falls or other minimal trauma. This risk of fracture can be reduced through appropriate diagnostic testing, pharmacologic therapy, and other readily measured standards of care. OBJECTIVES: Our aim was to develop a credible clinical performance assessment to measure physicians' quality of osteoporosis care, and determine reasonable performance standards for both competent and excellent care. DESIGN: This was a retrospective cohort study. PARTICIPANTS: Three hundred and eighty one general internists and subspecialists with time-limited board certification were included in the study. MAIN MEASURES: Performance rates on eight evidence-based measures were obtained from the American Board of Internal Medicine (ABIM) Osteoporosis Practice Improvement Module® (PIM), a web-based tool that uses medical chart reviews to help physicians assess and improve care. We applied a patented methodology, using an adaptation of the Angoff standard-setting method and the Dunn-Rankin method, with an expert panel skilled in osteoporosis care to form a composite and establish standards for both competent and excellent care. Physician and practice characteristics, including a practice infrastructure score based on the Physician Practice Connections Readiness Survey (PPC-RS), were used to examine the validity of the inferences made from the composite scores. KEY RESULTS: The mean composite score was 67.54 out of 100 maximum points with a reliability of 0.92. The standard for competent care was 46.87, and for excellent care it was 83.58. Both standards had high classification accuracies (0.95). Sixteen percent of physicians performed below the competent care standard, while 22 % met the excellent care standard. Specialists scored higher than generalists, and better practice infrastructure was associated with higher composite scores, providing some validity evidence. CONCLUSIONS: We developed a rigorous methodology for assessing physicians' osteoporosis care. Clinical performance feedback relative to absolute standards of care provides physicians with a meaningful approach to self-evaluation to improve patient care.
BACKGROUND:Patients with osteoporosis can sustain fractures following falls or other minimal trauma. This risk of fracture can be reduced through appropriate diagnostic testing, pharmacologic therapy, and other readily measured standards of care. OBJECTIVES: Our aim was to develop a credible clinical performance assessment to measure physicians' quality of osteoporosis care, and determine reasonable performance standards for both competent and excellent care. DESIGN: This was a retrospective cohort study. PARTICIPANTS: Three hundred and eighty one general internists and subspecialists with time-limited board certification were included in the study. MAIN MEASURES: Performance rates on eight evidence-based measures were obtained from the American Board of Internal Medicine (ABIM) Osteoporosis Practice Improvement Module® (PIM), a web-based tool that uses medical chart reviews to help physicians assess and improve care. We applied a patented methodology, using an adaptation of the Angoff standard-setting method and the Dunn-Rankin method, with an expert panel skilled in osteoporosis care to form a composite and establish standards for both competent and excellent care. Physician and practice characteristics, including a practice infrastructure score based on the Physician Practice Connections Readiness Survey (PPC-RS), were used to examine the validity of the inferences made from the composite scores. KEY RESULTS: The mean composite score was 67.54 out of 100 maximum points with a reliability of 0.92. The standard for competent care was 46.87, and for excellent care it was 83.58. Both standards had high classification accuracies (0.95). Sixteen percent of physicians performed below the competent care standard, while 22 % met the excellent care standard. Specialists scored higher than generalists, and better practice infrastructure was associated with higher composite scores, providing some validity evidence. CONCLUSIONS: We developed a rigorous methodology for assessing physicians' osteoporosis care. Clinical performance feedback relative to absolute standards of care provides physicians with a meaningful approach to self-evaluation to improve patient care.
Authors: Eric S Holmboe; Thomas P Meehan; Lorna Lynn; Paula Doyle; Tierney Sherwin; F Daniel Duffy Journal: J Contin Educ Health Prof Date: 2006 Impact factor: 1.355
Authors: Leif I Solberg; Stephen E Asche; L Gregory Pawlson; Sarah Hudson Scholle; Sarah C Shih Journal: Am J Manag Care Date: 2008-02 Impact factor: 2.229
Authors: Sarah Hudson Scholle; L Gregory Pawlson; Leif I Solberg; Sarah C Shih; Stephen E Asche; Ann F Chou; Merry Jo Thoele Journal: Jt Comm J Qual Patient Saf Date: 2008-07
Authors: Russel Burge; Bess Dawson-Hughes; Daniel H Solomon; John B Wong; Alison King; Anna Tosteson Journal: J Bone Miner Res Date: 2007-03 Impact factor: 6.741
Authors: Rebecca S Lipner; Weifeng Weng; Kelly J Caverzagie; Brian J Hess Journal: Adv Health Sci Educ Theory Pract Date: 2013-02-16 Impact factor: 3.853
Authors: Rebecca S Lipner; Weifeng Weng; Gerald K Arnold; F Daniel Duffy; Lorna A Lynn; Eric S Holmboe Journal: Acad Med Date: 2007-10 Impact factor: 6.893
Authors: David Reeves; Stephen M Campbell; John Adams; Paul G Shekelle; Evan Kontopantelis; Martin O Roland Journal: Med Care Date: 2007-06 Impact factor: 2.983