L Douglas Ried1, Randell E Doty2, Ruth E Nemire3. 1. University of Texas at Tyler, Ben and Maytee Fisch College of Pharmacy, Tyler, Texas. 2. University of Florida, Gainesville, Florida. 3. American Association of Colleges of Pharmacy, Alexandria, Virginia.
Abstract
OBJECTIVE: To assess the psychometric properties of the clinical competency framework known as the System of Universal Clinical Competency Evaluation in the Sunshine State (SUCCESS), including its internal consistency and content, construct, and criterion validity. METHODS: Sub-competency items within each hypothesized competency pair were subjected to principal components factor analysis to demonstrate convergent and discriminant validity. Varimax rotation was conducted for each competency pair (eg, competency 1 vs competency 2, competency 1 vs competency 3, competency 2 vs competency 3). Internal consistency was evaluated using Cronbach alpha. RESULTS: Of the initial 78 pairings, 44 (56%) demonstrated convergent and discriminant validity. Five pairs of competencies were unidimensional. Of the 34 pairs where at least 1 competency was multidimensional, most (91%) were from competencies 7, 11, and 12, indicating modifications were warranted in those competencies. After reconfiguring the competencies, 76 (94%) of the 81 pairs resulted in 2 factors as required. A unidimensional factor emerged when all 13 of the competencies were entered into a factor analysis. The internal consistency of all of the competencies was satisfactory. CONCLUSION: Psychometric evaluation shows the SUCCESS framework demonstrates adequate reliability and validity for most competencies. However, it also provides guidance where improvements are needed as part of a continuous quality improvement program.
OBJECTIVE: To assess the psychometric properties of the clinical competency framework known as the System of Universal Clinical Competency Evaluation in the Sunshine State (SUCCESS), including its internal consistency and content, construct, and criterion validity. METHODS: Sub-competency items within each hypothesized competency pair were subjected to principal components factor analysis to demonstrate convergent and discriminant validity. Varimax rotation was conducted for each competency pair (eg, competency 1 vs competency 2, competency 1 vs competency 3, competency 2 vs competency 3). Internal consistency was evaluated using Cronbach alpha. RESULTS: Of the initial 78 pairings, 44 (56%) demonstrated convergent and discriminant validity. Five pairs of competencies were unidimensional. Of the 34 pairs where at least 1 competency was multidimensional, most (91%) were from competencies 7, 11, and 12, indicating modifications were warranted in those competencies. After reconfiguring the competencies, 76 (94%) of the 81 pairs resulted in 2 factors as required. A unidimensional factor emerged when all 13 of the competencies were entered into a factor analysis. The internal consistency of all of the competencies was satisfactory. CONCLUSION: Psychometric evaluation shows the SUCCESS framework demonstrates adequate reliability and validity for most competencies. However, it also provides guidance where improvements are needed as part of a continuous quality improvement program.
Keywords:
Pharmacy practice competency; advanced pharmacy practice experiences; experiential education; psychometrics; reliability; validity
Authors: L Douglas Ried; Ruth Nemire; Randell Doty; Mildred P Brickler; Holly H Anderson; Elizabeth Frenzel-Shepherd; Margareth Larose-Pierre; Dee Dugan Journal: Am J Pharm Educ Date: 2007-12-15 Impact factor: 2.047
Authors: Melissa S Medina; Cecilia M Plaza; Cindy D Stowe; Evan T Robinson; Gary DeLander; Diane E Beck; Russell B Melchert; Robert B Supernaw; Victoria F Roche; Brenda L Gleason; Mark N Strong; Amanda Bain; Gerald E Meyer; Betty J Dong; Jeffrey Rochon; Patty Johnston Journal: Am J Pharm Educ Date: 2013-10-14 Impact factor: 2.047
Authors: Cynthia G Silber; Thomas J Nasca; David L Paskin; Glenn Eiger; Mary Robeson; J Jon Veloski Journal: Acad Med Date: 2004-06 Impact factor: 6.893
Authors: Jennifer Danielson; Kathleen Hill Besinque; Cheryl Clarke; Deb Copeland; Denise M Klinker; Lena Maynor; Kate Newman; Nancy Ordonez; See-Won Seo; James Scott; Toyin Tofade; Cathy L Worrall Journal: Am J Pharm Educ Date: 2019-05 Impact factor: 2.047