Clarence D Kreiter1, Yuka Kreiter. 1. Department of Family Medicine, Office of Consultation and Research in Medical Education, University of Iowa College of Medicine, lowa City, Iowa 52242, USA. clarence-kreiter@uiowa.edu
Abstract
BACKGROUND: Research on the validity of using the Medical College Admissions Test (MCAT) and undergraduate grade point average (GPA) for selection to medical school has produced conflicting interpretations. There is debate regarding the degree to which coefficients diminish over the course of educational and professional outcomes and disagreement over whether these two measures can predict clinical performance. PURPOSE: To summarize and interpret the validity literature using validity generalization techniques that account for measurement error. METHODS: Validity generalization techniques were used to summarize MCAT and undergraduate GPA validity research. A meta-analysis was performed to evaluate validity coefficients for two outcome domains across educational and professional attainment levels. RESULTS: The ability to predict academic performance decreases slightly for written tests. For clinical performance assessments, existing research does not allow an assessment of change across training levels. However, relevant studies suggest that MCAT and undergraduate GPA have a positive predictive relationship with clinical skills. CONCLUSION: A validity generalization perspective of the literature supports the use of MCAT and undergraduate GPA for selection to medical school.
BACKGROUND: Research on the validity of using the Medical College Admissions Test (MCAT) and undergraduate grade point average (GPA) for selection to medical school has produced conflicting interpretations. There is debate regarding the degree to which coefficients diminish over the course of educational and professional outcomes and disagreement over whether these two measures can predict clinical performance. PURPOSE: To summarize and interpret the validity literature using validity generalization techniques that account for measurement error. METHODS: Validity generalization techniques were used to summarize MCAT and undergraduate GPA validity research. A meta-analysis was performed to evaluate validity coefficients for two outcome domains across educational and professional attainment levels. RESULTS: The ability to predict academic performance decreases slightly for written tests. For clinical performance assessments, existing research does not allow an assessment of change across training levels. However, relevant studies suggest that MCAT and undergraduate GPA have a positive predictive relationship with clinical skills. CONCLUSION: A validity generalization perspective of the literature supports the use of MCAT and undergraduate GPA for selection to medical school.
Authors: Andrea L Wall; Alex Aljets; Steve C Ellis; Daniel J Hansen; W Mark Moore; Heather M W Petrelli; Marilyn K Speedie; Tom TenHoeve; Cynthia Watchmaker; Janeen S Winnike; Stephanie D Wurth Journal: Am J Pharm Educ Date: 2015-09-25 Impact factor: 2.047
Authors: James L Bills; Jacob VanHouten; Michelle M Grundy; Roger Chalkley; Terence S Dermody Journal: Adv Health Sci Educ Theory Pract Date: 2015-05-08 Impact factor: 3.853