Annamaria Bagnasco1, Angela Tolotti2, Nicola Pagnucci3, Giancarlo Torre4, Fiona Timmins5, Giuseppe Aleo6, Loredana Sasso7. 1. Department of Health Sciences, University of Genoa, Via Pastore 1, I-16132 Genoa, Italy. Electronic address: Annamaria.bagnasco@unige.it. 2. Department of Health Sciences, University of Genoa, Via Pastore 1, I-16132 Genoa, Italy. Electronic address: angela.tolotti@unipv.it. 3. Department of Clinical and Experimental Medicine, University of Pisa, Via Savi 10, I-56100 Pisa, Italy. Electronic address: nicola.pagnucci@for.unipi.it. 4. School of Medical and Pharmaceutical Sciences, University of Genoa, Via Pastore 1, I-16132 Genoa, Italy. Electronic address: gctorre@unige.it. 5. School of Nursing, Trinity College, College Green, Dublin 2, Ireland. Electronic address: Fiona.Timmins@tcd.ie. 6. Department of Health Sciences, University of Genoa, Via Pastore 1, I-16132 Genoa, Italy. Electronic address: giuseppe.aleo@edu.unige.it. 7. Department of Health Sciences, University of Genoa, Via Pastore 1, I-16132 Genoa, Italy. Electronic address: l.sasso@unige.it.
Abstract
BACKGROUND: While development, testing, and innovation of the Objective Structured Clinical Examination (OSCE) are common in the international literature, studies from the United States of America (USA), Australia, and the United Kingdom (UK) predominate. There is little known about OSCE use in European countries, such as Italy, where other than cost analysis, there is little reporting of OSCE use or validation. OBJECTIVES: This paper reports on one Italian initiative, which evaluated the equity and objectivity of the OSCE method of assessing communication skills. DESIGN: An OSCE method was used to assess the communication skills of first-year students of the Degree Course in Nursing. A method of simulation was implemented through role-playing with standardized patients. An observational method was used to collect data. PARTICIPANTS AND SETTINGS: Four hundred and twenty-one first-year undergraduate nursing students at one university site in Italy took part. METHODS: Ten examination sessions were carried out. The students' performances were assessed by two examiners who used a structured observation grid and conducted their assessment separately. A situation simulated by four nurses with experience as actors was used as the topic for the students' examination. RESULTS: Calculation of the daily rate of students who passed the examination revealed a random distribution over time. The nonparametric correlation indexes referring to the assessments and to the scores assigned by the two examiners proved statistically significant (P≤0.001). CONCLUSIONS: The study confirmed the validity of the OSCE method in ensuring equity and objectivity of communication skills assessment in a large population of nursing students for the purpose of certification throughout the duration of the examination. This has important implications for nurse education and practice as the extent to which OSCE approaches, while deemed objective, are culturally sensitive or valid and reliable across cultures is not clear. This is something that requires further research and examination in this field.
BACKGROUND: While development, testing, and innovation of the Objective Structured Clinical Examination (OSCE) are common in the international literature, studies from the United States of America (USA), Australia, and the United Kingdom (UK) predominate. There is little known about OSCE use in European countries, such as Italy, where other than cost analysis, there is little reporting of OSCE use or validation. OBJECTIVES: This paper reports on one Italian initiative, which evaluated the equity and objectivity of the OSCE method of assessing communication skills. DESIGN: An OSCE method was used to assess the communication skills of first-year students of the Degree Course in Nursing. A method of simulation was implemented through role-playing with standardized patients. An observational method was used to collect data. PARTICIPANTS AND SETTINGS: Four hundred and twenty-one first-year undergraduate nursing students at one university site in Italy took part. METHODS: Ten examination sessions were carried out. The students' performances were assessed by two examiners who used a structured observation grid and conducted their assessment separately. A situation simulated by four nurses with experience as actors was used as the topic for the students' examination. RESULTS: Calculation of the daily rate of students who passed the examination revealed a random distribution over time. The nonparametric correlation indexes referring to the assessments and to the scores assigned by the two examiners proved statistically significant (P≤0.001). CONCLUSIONS: The study confirmed the validity of the OSCE method in ensuring equity and objectivity of communication skills assessment in a large population of nursing students for the purpose of certification throughout the duration of the examination. This has important implications for nurse education and practice as the extent to which OSCE approaches, while deemed objective, are culturally sensitive or valid and reliable across cultures is not clear. This is something that requires further research and examination in this field.
Authors: Holger Lenz; Ansgar Opitz; Dana Huber; Fabian Jacobs; Wolfgang Gang Paik; Jörg Roche; Martin R Fischer Journal: GMS J Med Educ Date: 2019-02-15