OBJECTIVES: The multiple mini-interview (MMI) overcomes the limitations of the traditional panel interview by multiple sampling to provide improved objectivity and reliability. Reliability of the MMI is affected by number of stations; however, there are few data reporting the influence of interview duration on MMI outcome and reliability. We aimed to determine whether MMI stations can be shortened without affecting applicant rankings or compromising test reliability. METHODS: A total of 175 applicants were interviewed and assessed at 10 8-minute stations. Applicants were scored once after 8 minutes at five control stations and twice after 5 minutes and 8 minutes at five experimental stations. Scores at 5 and 8 minutes were compared using t-tests and correlation coefficients. Rankings of applicants based on 5- and 8-minute scores were compared using Spearman's rank order coefficient. The reliability of the MMI was examined for 5- and 8-minute scores using generalisability theory. RESULTS: Mean scores at 5 minutes were lower than mean scores at 8 minutes. Cumulative scores at 5 minutes were also lower. There were highly significant correlations between 5- and 8-minute scores at all experimental stations (0.82-0.91; P < 0.01) and between the cumulative scores at 5 and 8 minutes (0.92; P < 0.01). There was a strong correlation between applicant rankings based on cumulative 5- and 8-minute scores (Spearman's rank order coefficient 0.92). Reliability was not affected. CONCLUSIONS: Reducing the duration of MMI stations from 8 to 5 minutes conserves resources with minimal effect on applicant ranking and test reliability.
OBJECTIVES: The multiple mini-interview (MMI) overcomes the limitations of the traditional panel interview by multiple sampling to provide improved objectivity and reliability. Reliability of the MMI is affected by number of stations; however, there are few data reporting the influence of interview duration on MMI outcome and reliability. We aimed to determine whether MMI stations can be shortened without affecting applicant rankings or compromising test reliability. METHODS: A total of 175 applicants were interviewed and assessed at 10 8-minute stations. Applicants were scored once after 8 minutes at five control stations and twice after 5 minutes and 8 minutes at five experimental stations. Scores at 5 and 8 minutes were compared using t-tests and correlation coefficients. Rankings of applicants based on 5- and 8-minute scores were compared using Spearman's rank order coefficient. The reliability of the MMI was examined for 5- and 8-minute scores using generalisability theory. RESULTS: Mean scores at 5 minutes were lower than mean scores at 8 minutes. Cumulative scores at 5 minutes were also lower. There were highly significant correlations between 5- and 8-minute scores at all experimental stations (0.82-0.91; P < 0.01) and between the cumulative scores at 5 and 8 minutes (0.92; P < 0.01). There was a strong correlation between applicant rankings based on cumulative 5- and 8-minute scores (Spearman's rank order coefficient 0.92). Reliability was not affected. CONCLUSIONS: Reducing the duration of MMI stations from 8 to 5 minutes conserves resources with minimal effect on applicant ranking and test reliability.
Authors: Robin L Corelli; Michael A Muchnik; Ryan J Beechinor; Gary Fong; Eleanor M Vogt; Jennifer M Cocohoba; Candy Tsourounis; Karen Suchanek Hudmon Journal: Am J Pharm Educ Date: 2015-11-25 Impact factor: 2.047
Authors: Lucrecia M Burgos; Alberto Alves DE Lima; Josefina Parodi; Juan Pablo Costabel; María Nieves Ganiele; Eduardo Durante; María Dolores Arceo; Ricardo Gelpi Journal: J Adv Med Educ Prof Date: 2020-01
Authors: Anthony Jerant; Mark C Henderson; Erin Griffin; Julie A Rainwater; Theodore R Hall; Carolyn J Kelly; Ellena M Peterson; David Wofsy; Peter Franks Journal: BMC Med Educ Date: 2017-11-06 Impact factor: 2.463