A O'Connor1, O McGarr2, P Cantillon3, A McCurtin4, A Clifford4. 1. Department of Clinical Therapies, Health Sciences Building, University of Limerick, Limerick, Ireland. Electronic address: Anne.OConnor@ul.ie. 2. School of Education, University of Limerick, University of Limerick, Limerick, Ireland. 3. Discipline of General Practice, Clinical Science Institute, National University of Ireland, Galway, Ireland. 4. Department of Clinical Therapies, Health Sciences Building, University of Limerick, Limerick, Ireland.
Abstract
BACKGROUND: Clinical performance assessment tools (CPATs) used in physiotherapy practice education need to be psychometrically sound and appropriate for use in all clinical settings in order to provide an accurate reflection of a student's readiness for clinical practice. Current evidence to support the use of existing assessment tools is inconsistent. OBJECTIVES: To conduct a systematic review synthesising evidence relating to the psychometric and edumetric properties of CPATS used in physiotherapy practice education. DATA SOURCES: An electronic search of Web of Science, SCOPUS, Academic Search Complete, AMED, Biomedical Reference Collection, British Education Index, CINAHL plus, Education Full Text, ERIC, General Science Full Text, Google Scholar, MEDLINE, UK and Ireland Reference Centre databases was conducted identifying English language papers published in this subject area from 1985 to 2015. STUDY SELECTION: 20 papers were identified representing 14 assessment tools. DATA EXTRACTION AND SYNTHESIS: Two reviewers evaluated selected papers using a validated framework (Swing et al., 2009). RESULTS: Evidence of psychometric testing was inconsistent and varied in quality. Reporting of edumetric properties was unpredictable in spite of its importance in busy clinical environments. No Class 1 recommendation was made for any of the CPATs, and no CPAT scored higher than Level C evidence. CONCLUSIONS: Findings demonstrate poor reporting of psychometric and edumetric properties of CPATs reviewed. A more robust approach is required when designing CPATs. Collaborative endeavour within the physiotherapy profession and interprofessionally may be key to further developments in this area and may help strengthen the rigour of such assessment processes.
BACKGROUND: Clinical performance assessment tools (CPATs) used in physiotherapy practice education need to be psychometrically sound and appropriate for use in all clinical settings in order to provide an accurate reflection of a student's readiness for clinical practice. Current evidence to support the use of existing assessment tools is inconsistent. OBJECTIVES: To conduct a systematic review synthesising evidence relating to the psychometric and edumetric properties of CPATS used in physiotherapy practice education. DATA SOURCES: An electronic search of Web of Science, SCOPUS, Academic Search Complete, AMED, Biomedical Reference Collection, British Education Index, CINAHL plus, Education Full Text, ERIC, General Science Full Text, Google Scholar, MEDLINE, UK and Ireland Reference Centre databases was conducted identifying English language papers published in this subject area from 1985 to 2015. STUDY SELECTION: 20 papers were identified representing 14 assessment tools. DATA EXTRACTION AND SYNTHESIS: Two reviewers evaluated selected papers using a validated framework (Swing et al., 2009). RESULTS: Evidence of psychometric testing was inconsistent and varied in quality. Reporting of edumetric properties was unpredictable in spite of its importance in busy clinical environments. No Class 1 recommendation was made for any of the CPATs, and no CPAT scored higher than Level C evidence. CONCLUSIONS: Findings demonstrate poor reporting of psychometric and edumetric properties of CPATs reviewed. A more robust approach is required when designing CPATs. Collaborative endeavour within the physiotherapy profession and interprofessionally may be key to further developments in this area and may help strengthen the rigour of such assessment processes.
Authors: Flora P Gittinger; Martin Lemos; Jan L Neumann; Jürgen Förster; Daniel Dohmen; Birgit Berke; Anke Olmeo; Gisela Lucas; Stephan M Jonas Journal: BMC Med Educ Date: 2022-03-16 Impact factor: 2.463