Literature DB >> 35573607

Psychometric properties of the Persian version of System for Evaluation of Teaching Qualities by students: A tool for assessing clinical tutors from students' viewpoint.

Fateme Tahmasebi Boldaji1,2, Mitra Amini2, Mohammad Mahdi Parvizi3.   

Abstract

BACKGROUND: Effective clinical teaching is crucially important for patient care in future. Therefore, proper clinical training is essential to make physicians capable of delivering high-quality health care.
MATERIALS AND METHODS: The present study was a cross-sectional research. After translating the questionnaire into Persian, it was distributed among medical students in the clinical years of medical education in teaching hospitals affiliated to Ahvaz Jundishapur University of Medical Sciences in 2018. The System for Evaluation of Teaching Qualities (SETQ) has 25 questions in a 6-scale Likert scale that evaluates clinical tutors in five dimensions of teaching and learning environment, professional attitude toward students, transferring of goals, evaluation of students, feedback, and promoting self-directed learning. Instrument reliability was assessed by calculating the Cronbach's alpha coefficient, whereas questionnaire content validity was evaluated by relative content validity ratio (CVR) and content validity index (CVI). To evaluate the structural validity, an exploratory factor analysis was conducted.
RESULTS: The SETQ was completed by 127 medical students. Cronbach's alpha coefficient of the total questionnaire was estimated as 0.908. The factor analysis showed that the questionnaire was composed of six factors, explaining 66.14% of the total variance. The CVI and CVR indices of the individual items were also acceptable.
CONCLUSION: The findings of our study showed that the Persian version of SETQ questionnaire had the acceptable reliability and validity to be used in assessing clinical tutors in different hospitals in Iran. Copyright:
© 2022 Journal of Education and Health Promotion.

Entities:  

Keywords:  Clinical professors; System for Evaluation of Teaching Qualities; clinical tutors; reliability; validity

Year:  2022        PMID: 35573607      PMCID: PMC9093631          DOI: 10.4103/jehp.jehp_1622_20

Source DB:  PubMed          Journal:  J Educ Health Promot        ISSN: 2277-9531


Introduction

Clinical education is one of the sensitive areas of medical education that plays a major role in shaping learners’ professional abilities as well as an important part of physician training as responsible for maintaining and promoting community health.[12] To achieve optimal clinical education, it is crucial to continuously evaluate and monitor the performance of instructors’ clinical education.[3] Faculty member evaluation is the one which determines the level of faculty member achievements in the quality of education and leads to equity in academic setting.[4] According to a study conducted in 2011, high-ranked universities evaluated their educational system by involving students and academic staff by using the rating scale models.[5] Evaluation of instructors’ educational performance can be helpful to professors themselves by recognizing the strengths and weaknesses of their jobs, and the results of such evaluations can rectify the organizations’ educational performance and improve teachers’ educational skills.[67] Many factors affect the faculty member evaluation that should be taken into account by educational policymakers to improve the quality of the education process.[8] Evaluation of clinical education competency in trainees and medical interns is a necessity, and students as the main clients of the education process believe that evaluation is vital to be done.[3] The use of student feedback in teacher performance appraisal is one of the common and accessible methods used by many major universities around the world.[6910] Various studies had shown that students can be a reliable source and reference for teacher evaluation.[11] Because students are the target group that directly receives the instructors “teaching product, the most relevant group is to comment on the quality of the teachers” performance.[12] There are several questionnaires for assessing clinical instructor quality, but none of these are in student-led clinical settings and some of these tools are not valid.[11314] The System for Evaluation of Teaching Qualities (SETQ) questionnaire is one of the specialized tools and the first questionnaire developed to evaluate different aspects of clinical professors’ performance.[15] It covers most of the criteria required for evaluation. In addition, a low number of evaluators is needed to achieve reliable results, indicating the high power of the SETQ tool. As a result, the SETQ as a valid and reliable tool can provide a good basis for the evaluation of clinical professors by medical students.[1516] The USA version of the SETQ questionnaire was presented in the USA, comprising 26 questions on the following 7 scales: Creating Learning Environments, Controlling Training Session, Goal Communication, Encouraging and Maintaining, Evaluating, Feedback, and Self-Learning.[17] The original version of the SETQ tool in the Netherlands[15] and the USA[17] had been widely used for the evaluation of clinical professors by medical students in various hospitals and is widely accepted and accredited by the academic community. The SETQ tool was then developed based on the Stanford Faculty Development Program 26 and included 23 items on five scales of learning environments, professional attitudes toward resident support, goal communication, resident evaluation, and feedback.[15] A revised SETQ questionnaire (including 25 questions) was also presented and validated in Bahrain with a scale added to this tool entitled self-directed learning improvement.[18] There is no valid questionnaire which has been translated and used for the evaluation of clinical professors from Iranian students’ perspective. Therefore, the purpose of this study was to evaluate the validity and reliability of a modified SETQ questionnaire for the evaluation of clinical professors by medical students in their clinical education years in Iran.

Materials and Methods

Study design and setting

The present study was a descriptive, cross-sectional study performed on medical students studying in clinical (external and internal) in Ahvaz Jundishapur University of Medical Sciences in 2019 to evaluate the psychometric properties of the Persian version of Clinical Teacher Evaluation Questionnaire.

Study participants and sampling

Initially, 140 students were recruited by easy sampling due to the probability of sample loss. Thereupon, the questionnaires that were not completely filled or confused were excluded and finally 127 persons remained as the final study sample size.

Data collection tool and technique

SETQ questionnaire

In this study, the SETQ questionnaire was translated into Persian by two professors, to ensure its validity and its construct validity, and reverse translation was performed and confirmed by five faculty members at the Research Development Center of Shiraz Medical Sciences University. Then, the researchers provided the questionnaire as a web-based online tool and shared to the participants to fulfil. The SETQ questionnaire consists of 25 questions that assess clinical instructors in 6 dimensions as follows: teaching and learning environment (questions 1–6), professional attitude toward students (questions 7–10), relationship of goals (questions 11–13), student assessment (questions 14–18), feedback (questions 19–22), and promoting self-learning (questions 23–25). Each of the 5-point Likert scale questions is answered by one of the following options: completely disagree (1 score), disagree (2 points), neutral or no idea (3 points), agree (4 points), strongly agree (5 points), and an option titled “unable to evaluate” (6 points). The lowest and highest scores on the questionnaire were 25 and 150, respectively.[18] Demographic characteristics of the students including age, sex, school year, and marital status were also collected.

Validity assessment of the questionnaire

The face validity of the Persian version of the questionnaire was evaluated by faculty members at the Medical Education Development Center of Shiraz University of Medical Sciences (at least five experts). To determine the face validity of the Persian version of the questionnaire, the sentences were examined in terms of their writing style, clarity, and fluency too. Content validity index (CVI) 1 and relative content validity coefficient (CVR) were used to examine the content validity of the questionnaire's quantity. For this purposɚe, in the first stage, the questionnaire was distributed among thirty faculty members and experts were asked to claim their perspectives about the necessity and appropriateness of each of the three items on the Likert scale (this is a necessary question, a useful question but not necessary, or not necessary question). The CVI index for each item was calculated using the following formula: CVI = Total agreed points for each question/total number of participants. To calculate the CVR index, the following formula was used:

Statistical analysis

We conducted IBM SPSS Statistics 22.00 (IBM SPSS Statistics for Windows, version 22.0. Armonk, NY: IBM Corp, Chicago, USA, 2013) and LISREL (version 8.8, Jöreskog K, Sörbon D. Lisrel for Windows 8.80. 2006. Scientific Software International: Lincolnwood, IL.) for statistical analysis. Data were also analyzed by descriptive statistics including mean, standard deviation, frequency, and percentage of frequency. The data normalization was evaluated by Skewness1 and Kurtosis2 coefficients, and the coefficient values for all variables were estimated in the safe range (+2 and −2), indicating the normality of the data. Hence, parametric tests were employed for result analysis. Moreover, in the inferential statistics section, exploratory factor analysis (EFA) with KMO3 statistic and Bartlett's spherical test and confirmatory factor analysis (CFA) with covariance-based approach were used to assess the reliability, validity, and reliability of the questionnaire. The reliability of the questionnaire (internal consistency of questions) was assessed by Cronbach's alpha for the whole questionnaire and each of the six dimensions of the questionnaire. In addition, relative content validity coefficient (CVR) and CVI were used to assess content validity. Pearson's correlation test (to examine the relationship between research variables) and independent two-sample t-test and analysis of variance (ANOVA) were used to examine the relationship between the subscales of the questionnaire and individual characteristics. The significance level of tests was considered equal and less than 0.05.

Ethical consideration

The protocol of the study was approved by the Research Ethics Committee of Shiraz University of Medical Sciences, Shiraz, Iran (Code: IR. SUMS. REC.1399.023). Moreover, the questionnaires were completed by the students, anonymously.

Results

The surveyed demographic characteristics of the students are presented in Table 1. The results showed that the mean of all items in the questionnaire was more than 3. In addition, the tendency of most responses was toward “strongly agree” and “completely agree.” The mean scores obtained for each of the subscales are presented in Table 2. The highest mean was related to professional attitude toward students and the lowest was related to self-directed learning promotion.
Table 1

Demographic characteristics of the participants in the study of psychometric properties of the Persian version of System for Evaluation of Teaching Qualities tool

VariableGroupFrequency (%)
SexMale43 (34.1)
Female83 (65.9)
Age (years)21-2575 (59.5)
26-3045 (35.7)
31-354 (3.2)
36-402 (1.6)
Marital statusSingle94 (74.6)
Married32 (25.4)
Academic yeara4th16 (12.7)
5th31 (24.6)
6th35 (27.8)
7th44 (34.9)

aThe Iranian medial students start their clinical courses since the 4th year of their educational period

Table 2

Means and standard deviations of the scores obtained in the domains of the Persian version of System for Evaluation of Teaching Qualities tool

DomainsMeanVarianceSD
Learning and learning environment3.910.450.67
Professional attitude toward students4.030.530.73
Goal transfer3.910.830.91
Student assessment3.850.800.89
Feedback3.980.720.85
Promoting autonomous learning3.831.0031.001

SD=Standard deviation

Demographic characteristics of the participants in the study of psychometric properties of the Persian version of System for Evaluation of Teaching Qualities tool aThe Iranian medial students start their clinical courses since the 4th year of their educational period Means and standard deviations of the scores obtained in the domains of the Persian version of System for Evaluation of Teaching Qualities tool SD=Standard deviation EFA used to analyze 25 presented items was performed using PCM1 with vertical rotation2 and Varimax 3 techniques. The KMO4 index value was calculated to be 0.85, indicating the adequacy of sampling, and the value of this index should be between 0 and 1. In the case it is ascended 0.5 or more, the number of data is appropriate for factor analysis. The Bartlett's test was also statistically significant (P < 0.001), indicating that the correlation matrix was proper for factor analysis of data. After Varimax rotation, the results of the extracted factor loaded of components showed that the factor's load between the items of each variable with variables themselves was higher than the factor's load with the other variables. In other words, the items of each variable demonstrated more correlation with their own variables than those with the other variables. The characteristics of the factors extracted from the research questionnaire are presented in Table 3. As shown in the table, the factor's loadings of all the questions were calculated to be >0.4, which indicated that the questions loaded well on their current variable and there was no need to modify or remove the questions from the questionnaire. Therefore, using the EFA technique, the 25-question questionnaire can be converted into 6 factors (present variable). These six factors totally accounted 66.14% of the variance of factors that was an acceptable value.
Table 3

Factor analysis extracted of Persian version of (System for Evaluation of Teaching Qualities) tool

DomainsQuestionsExploratory factor analysisConfirmatory agent analysis resultResult


Factor load valuePercentage of varianceStandardized factor load value t Cronbach’s alpha
Learning and learning environment1. Encourages students to participate actively in discussions0.78715.8940.739.180.882Desirable
2. Encourages students to discuss problems0.7940.769.74Desirable
3. Keeps to teaching goals and avoids digressions0.7170.749.35Desirable
4. Be prepared to teach and deliver lectures0.8110.8010.39Desirable
5. In the department, train in clinics and operating rooms0.6460.688.28Desirable
6. Teaches all subjects in the curriculum and curriculum0.7570.769.68Desirable
Professional attitude toward students7. Listen to students0.71712.7770.647.540.849Desirable
8. Treats students with respect0.7530.7910.15Desirable
9. Regularly available to students0.7910.8110.49Desirable
10. Easily accessible for discussion0.8090.8310.76Desirable
Transfer of goals11. Explicitly states the learning objectives0.78611.6020.515.550.722Desirable
12. Prioritize learning goals and topics0.7180.667.45Desirable
13. Periodically reviews learning goals0.6710.849.70Desirable
Student assessment14. Expert knowledge evaluates students on a regular basis0.7269.3680.678.110.833Desirable
15. Evaluates students’ analytical abilities on a regular basis0.8150.678.02Desirable
16. Evaluates the application of knowledge to students in relation to patients0.7310.8010.35Desirable
17. Medical skills are regularly evaluated by students0.6800.759.41Desirable
18. Evaluates the communication skills and professionalism of students while dealing with patients0.5200.637.48Desirable
Feedback19. Regularly providing constructive feedback to students0.7788.6380.484.980.739Desirable
20. Explains the mistakes of students0.8110.647Desirable
21. Offers suggestions for improving the work0.4980.647.01Desirable
22. Enables students to reflect on feedback0.5540.728.15Desirable
Promoting autonomous learning23. Provides students with sufficient motivation to study and study in depth0.6707.8630.617.130.763Desirable
24. Encourages students to study new research0.7740.9211.70Desirable
25. Encourages students to learn independently0.7440.657.57Desirable
Factor analysis extracted of Persian version of (System for Evaluation of Teaching Qualities) tool The results of CFA for evaluating the validity of the indicators of a structure in the questionnaire and the standardized coefficients measurement model [Table 3 and Figure 1] also revealed that there was a significant correlation between the current variables and their corresponding indicators. As a result, T-values indicated the significance of each parameter, and if the value of T is greater than the absolute value of 1.96, the model parameters would be significant. Then, the structural validity of the relevant variables was approved at the significant level (0.05).[1] The value of Cronbach's alpha coefficients in the questionnaire is shown in Table 3, which indicates that the value of Cronbach's alpha coefficients for all items was at the desirable and reliable level. In addition, Cronbach's alpha for the whole questionnaire with 25 questions and sample of 127 was calculated to be 0.908.
Figure 1

Standardized path coefficients of factor analysis model of the Persian version of the System for Evaluation of Teaching Qualities tool

Standardized path coefficients of factor analysis model of the Persian version of the System for Evaluation of Teaching Qualities tool To evaluate the content validity quantitatively, relative content validity ratio (CVR) and CVI were used, the results of which are presented in Table 4. Accordingly, it proved that the CVI and CVR indices of the individual items were at acceptable levels; therefore, the content validity of the questionnaire was statistically confirmed and there was no need to remove an item from the questionnaire.
Table 4

Validity of the questionnaire and content validity ratio and content validity index indices of Persian version of the System for Evaluation of Teaching Qualities tool

VariablesQuestion questionnaireNecessaryUseful but not necessaryNot neededCVICVROptimal results
Learning and learning environmentQ141-10.60Desirable
Q25--11Desirable
Q35--11Desirable
Q45--11Desirable
Q541-10.60Desirable
Q65--11Desirable
Professional attitude toward studentsQ741-10.60Desirable
Q85--11Desirable
Q95--11Desirable
Q1041-10.60Desirable
Goal transferQ1141-10.60Desirable
Q1241-10.60Desirable
Q1341-10.60Desirable
Student evaluationQ145--11Desirable
Q155--11Desirable
Q165--11Desirable
Q175--11Desirable
Q185--11Desirable
FeedbackQ195--11Desirable
Q205--11Desirable
Q215--11Desirable
Q2241-10.60Desirable
Promoting self-learningQ2341-10.60Desirable
Q245--11Desirable
Q2541-10.60Desirable

CVI=Content validity index, CVR=Content validity ratio

Validity of the questionnaire and content validity ratio and content validity index indices of Persian version of the System for Evaluation of Teaching Qualities tool CVI=Content validity index, CVR=Content validity ratio Pearson's correlation coefficient was used to examine the relationship between variables [Table 5]. As shown in the table, a significant positive and meaningful relationship between all the studied variables was observed, which implies that changing one of the variables causes change to other variables.
Table 5

Correlation coefficients matrix between the domains of Persian version of the System for Evaluation of Teaching Qualities tool

DomainsTeaching and learning environmentProfessional attitude toward studentsCommunication of goalsEvaluation of studentsFeedbackPromoting self-directed learning
Learning and learning environment
 Pearson’s correlation coefficient1
P-
Professional attitude toward students
 Pearson’s correlation coefficient0.4521
P<0.001-
Goal transfer
 Pearson’s correlation coefficient0.03190.3651
P<0.001<0.001-
Student evaluation
 Pearson’s correlation coefficient0.3580.3740.4801
P<0.001<0.001<0.001-
Feedback
 Pearson’s correlation coefficient0.3660.3760.2770.5031
P<0.001<0.0010.002<0.001-
Promoting self-learning
 Pearson’s correlation coefficient0.3880.4150.3380.4960.5041
P<0.001<0.001<0.001<0.001<0.001-
Correlation coefficients matrix between the domains of Persian version of the System for Evaluation of Teaching Qualities tool The results of the relationship between the questionnaire scores and demographic characteristics are presented in Table 6. It clearly shows that the mean scores of the subscales were similar among students with different gender, marital status, and school year, and there was no significant difference as well as no significant relationship between age and subscales of the questionnaire (except for goal transfer), and those aged 31–35 years had the lowest mean score.
Table 6

Results of the difference between the scores of the domains of the questionnaire and the demographic characteristics of the subjects (the numbers are significant or P value)

Domains/variablesFrequency (n)Mean±SD

Learning and learning environmentProfessional attitude toward studentsGoal transferStudent evaluationFeedbackPromoting self-learning
Sex
 Male433.87±0.723.97±0.813.87±0.923.69±1.083.83±0.933.79±1.11
 Female833.93±0.654.06±0.693.93±0.913.93±0.784.06±0.803.85±0.95
P0.6060.4800.7470.1460.1450.749
Marital status
 Single943.92±0.694.01±0.733.90±0.943.89±0.854.04±0.803.79±0.98
 Married323.89±0.634.09±0.763.92±0.833.74±1.033.82±0.973.92±1.08
P0.6080.6080.9190.4190.2060.532
Age group (years)
 21-25753.90±0.654.04±0.683.99±0.853.77±0.953.95±0.813.67±1.03
 26-30423.95±0.664.05±0.803.88±0.904.05±0.724.15±0.814.11±0.88
 31-3543.58±1.303.56±1.082.58±1.443.05±1.413.25±1.243.33±1.41
 36-4024.16±0.234.37±0.174.16±0.234.10±0.143.00±0.814.16±0.23
P0.7010.5580.025*0.1040.0560.081
Academic years**
 4th163.71±0.704.03±0.533.729±1.174.22±0.524.10±0.393.87±0.59
 5th313.83±0.804.04±0.773.806±0.823.620±0.953.95±0.813.72±1.17
 6th353.96±0.633.95±0.764.028±0.763.75±0.973.87±0.853.70±1.00
 7th444.00±0.594.09±0773.962±0.993.96±0.874.05±1.003.99±0.99
P0.8460.8570.6320.1220.7320.559

*According to the post hoc Tukey HSD test, this significant P value is related to the significant means of scores between the age groups of 21-25 and 31-35 years (P=0.014), as well 26-30 and 31-35 years (P=030), **The Iranian medial students start their clinical courses since the 4th year of their educational period. SD=Standard deviation, Tukey HSD=Tukey’s Honest Significant Difference test

Results of the difference between the scores of the domains of the questionnaire and the demographic characteristics of the subjects (the numbers are significant or P value) *According to the post hoc Tukey HSD test, this significant P value is related to the significant means of scores between the age groups of 21-25 and 31-35 years (P=0.014), as well 26-30 and 31-35 years (P=030), **The Iranian medial students start their clinical courses since the 4th year of their educational period. SD=Standard deviation, Tukey HSD=Tukey’s Honest Significant Difference test

Discussion

The findings of this study showed that the Persian version of the SETQ tool was a reliable, valid, and applicable method for evaluating the characteristics of clinical instructors’ teaching. Evaluation of this tool was performed using standard procedures and factor analysis and expert evaluation. The short time required to complete the questionnaire and the low number of people needed for a reliable evaluation demonstrate the utility of this tool for evaluating clinical professors in medical universities. These findings were consistent with the number of evaluations required in the original SETQ tool for anesthesia and obstetrics and gynecology clinical departments as well as the modified questionnaire in Bahrain.[1516] In the present study, Cronbach's alpha coefficient of internal reliability of the questionnaire was estimated to be 0.908, which was excellent and confirmed. In addition, the Cronbach's alpha coefficient of the questionnaire was in a desirable and reliable level, which confirmed the possibility of using the questionnaire to evaluate all aspects of the questionnaire in the evaluation of clinical professors. Comparison of the results with the reliability of the original instrument version in Bahrain showed that Cronbach's alpha was 0.94.[18] Based on the results of this study, it can be confirmed that this questionnaire can be used for evaluation of clinical professors from students’ point of view. In this study, different methods were used to assess the validity of the questionnaire. To obtain qualitative validity, a large number of medical educational specialists were required to study the translation of the questionnaire, who provided the necessary feedback, and little change was made in the translation based on the experts’ suggestions. Quantitative content validity was assessed using the CVR and CVI indices. Thereupon, the results showed that the CVI and CVR indices of the individual items were within acceptable level, and the questions were properly structured. Therefore, the content validity of the questionnaire was confirmed statistically and also there was no need to remove any item from the questionnaire. Structural validity of the instrument was also investigated using EFA. The results of the EFA supported the structural validity of the tool such that the results indicated the adequacy of sampling and the appropriateness of the data for factor analysis. It was also found that the factor's load between the items of each variable with their own variables was higher than the factor's load with that of the other variables. In other words, the variables of each variable were highly correlated with their own variables than that of with the other variables. Furthermore, the factor loadings of all questions in the questionnaire were >0.4, indicating that all questions were well-aligned and there was no need to modify or omit any question from the questionnaire. Moreover, the findings of the EFA showed six factors (present variable) of the questionnaire in total, which accounted for 66.14% of the variance in factors. As a result, it indicated acceptable validity of the instrument. In the study of the validity of the original version tool in Bahrain, the results of factor analysis showed that the questionnaire consisted of six factors that showed 76.7% of the total variance.[18] In the present study, the results of CFA showed that there was a significant correlation between each of the variables (dimensions of the questionnaire) and its questions afterward, and therefore the questions had the Persian translation was acceptable. Hence, the validity of the variables’ structural measurement was confirmed, and there was no need to alter or delete any question from the research model and from the questionnaire. A study by Hekmat et al. confirmed the validity and reliability of the 13-question questionnaire for evaluating assistants by their professors, which indicated that the questionnaire had appropriate internal consistency, but inappropriate and invalidity of the instrument. This means that the questionnaire’ structure was fundamentally flawed and in no way a suitable scale to measure what it was designed to measure, and it additionally required a thorough basic review; correspondingly, the assistants seem to have met other criteria than these 13 items in assessing the educational instructors.[19] Although many studies conducted on the psychometric properties of student evaluation questionnaires on the evaluation of professors at different universities, it is necessary to repeat these assessment in different societies and cultures, especially by conducting more developed instrument.[72021] Consequently, various evidences supported the visual and conceptual validity of the tool. The evaluation of the validity of the structural instrument also showed that this questionnaire can examine different aspects of teaching clinical students by instructors. In this study, the highest mean was related to professional attitude toward students and the lowest mean belonged to promote self-directed learning. However, the study conducted in Bahrain revealed promoting self-directed learning and the two areas of student evaluation and also professional attitudes toward students received the highest score and the lowest score, respectively.[18] Depending on the features that knowledge, thinking, and learning can have in a particular context, cultural differences and the educational system can differentiate the Persian version from the original version. These contextual considerations may reflect viewpoint differences toward social participation in these two instruments. In El-Ansari et al's. study,[18] the cutoff value based on the 1st quartile was set at 3.8 so that any result below this value was considered at risk and in need of improvement. In the present study, scores of all domains were above 3.8. Furthermore, it showed that the mean scores of each domain of the questionnaire were not significantly different among students with different gender, marital status, age, and academic year, which indicated that students’ characteristics were not correlated with their responses, hence it can be used among different groups of students. Based on the results, the questionnaire used in this study can help develop the future of clinical education, to promote the quality of clinical education and to influence the teaching and learning of medical students. This tool provided both clinical professors and students the opportunity to review and improve the learning process. Clinical education improves when clinical teachers receive feedback from their students.[21] This leads to progress in teaching and training practices and can also helps managers monitor the performance of the educational systems and faculty members. Furthermore, this tool lets educational systems identify the weak points and helps improve processing of the goals.[22] The SETQ tool allows clinical educators to evaluate their performance and can in consequence improve the quality of teaching in poor-performing clinical teachers.[23] In order to improve teaching methods and performances, the results of student evaluation of clinical professors by using the present tool can be useful for professors in line of clinical course too. It can also help educational system administrators monitor clinical professors’ performance and if necessary, design a program to improve faculty performance. What is more that allows students to identify and share the strengths and weaknesses of clinical professors to improve processes.

Limitation and recommendation

It should be noted that the present study was the primary survey to prepare a Persian tool and to assess its validity for students’ evaluation of clinical professors and consequently obtained valuable information. However, it would meet and are also facing potential limitations. Initially, an online method was used to complete the questionnaires. Although the online method provides students with the confidence to independently complete assessment forms whenever they desire to, it correspondingly faces some restrictions including low response rate, forgetting to complete the questionnaire, and uncertainty of completing the questionnaire by that desired person. Next, the researchers did not consider the potential confounding factors for this study, such as the students educational status (their ranks and grades), and their satisfaction with studying medicine. Therefore, it is recommended to evaluate the psychometric properties of this instrument by considering the potential confounding factors. Finally, this study was a single center study. Therefore, it is recommended to repeat the same study at other medical universities of Iran, as well as use this questionnaire to assess clinical tutors of medical schools from students’ viewpoint.

Conclusion

According to the results, the validity and reliability (credibility and trust) of the research questionnaire were confirmed. Therefore, it is concluded that the Persian version of the SETQ questionnaire is a valid and reliable multidimensional tool for evaluation of clinical professors from students’ viewpoint. Hence, the use of the Persian version of the SETQ questionnaire is recommended for the evaluation of clinical professors from the perspective of students in specialized clinics of Iranian physicians. Moreover, as this study focused on the psychometric properties of the modified SETQ tool, further studies should be conducted on the effectiveness of this tool in improving the quality of teaching and clinical education.

Financial support and sponsorship

This study was financially supported by Vice-Chancellor of Research of Shiraz University of Medical Sciences, Shiraz, Iran (Grant No: 19097).

Conflicts of interest

There are no conflicts of interest.
  13 in total

1.  Validation of a global measure of faculty's clinical teaching performance.

Authors:  Brent C Williams; Debra K Litzelman; Stewart F Babbott; Robert M Lubitz; Tim P Hofer
Journal:  Acad Med       Date:  2002-02       Impact factor: 6.893

2.  Students' perceptions of relationships between some educational variables in the out-patient setting.

Authors:  D H J M Dolmans; H A P Wolfhagen; G G M Essed; A J J A Scherpbier; C P M Van Der Vleuten
Journal:  Med Educ       Date:  2002-08       Impact factor: 6.251

3.  Development of a system for the evaluation of the teaching qualities of anesthesiology faculty.

Authors:  Kiki M J M H Lombarts; Martin J L Bucx; Onyebuchi A Arah
Journal:  Anesthesiology       Date:  2009-10       Impact factor: 7.892

4.  The Future of Clinical Education: Opportunities and Challenges from Allied Health Deans' Perspective.

Authors:  Barbara D Romig; Ann W Tucker; Anne M Hewitt; Julie O'Sullivan Maillet
Journal:  J Allied Health       Date:  2017

Review 5.  Assessing the quality of clinical teachers: a systematic review of content and quality of questionnaires for assessing clinical teachers.

Authors:  Cornelia R M G Fluit; Sanneke Bolhuis; Richard Grol; Roland Laan; Michel Wensing
Journal:  J Gen Intern Med       Date:  2010-08-12       Impact factor: 5.128

6.  Student perceptions of evaluation in undergraduate medical education: A qualitative study from one medical school.

Authors:  Sarah Schiekirka; Deborah Reinhardt; Susanne Heim; Götz Fabry; Tobias Pukrop; Sven Anders; Tobias Raupach
Journal:  BMC Med Educ       Date:  2012-06-22       Impact factor: 2.463

7.  Developing a clinical teaching quality questionnaire for use in a university osteopathic pre-registration teaching program.

Authors:  Brett Vaughan
Journal:  BMC Med Educ       Date:  2015-04-08       Impact factor: 2.463

8.  Psychometric properties of the Persian version of the Ambulatory Care Learning Educational Environment Measure (ACLEEM) questionnaire, Shiraz, Iran.

Authors:  Mohammad Mahdi Parvizi; Mitra Amini; Mohammad Reza Dehghani; Peyman Jafari; Zahra Parvizi
Journal:  Adv Med Educ Pract       Date:  2016-09-29

9.  Analysis of psychometric properties of the modified SETQ tool in undergraduate medical education.

Authors:  Ahmed Al Ansari; Kathryn Strachan; Sumaya Hashim; Sameer Otoom
Journal:  BMC Med Educ       Date:  2017-03-16       Impact factor: 2.463

10.  Investigating the faculty evaluation system in Iranian Medical Universities.

Authors:  Farahnaz Kamali; Nikoo Yamani; Tahereh Changiz
Journal:  J Educ Health Promot       Date:  2014-02-21
View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.