| Literature DB >> 34204429 |
Mohammed Arshad Khan1, Vivek Vivek2, Maysoon Khojah1, Mohammed Kamalun Nabi2, Mohinder Paul3, Syed Mohd Minhaj2.
Abstract
Online examinations, commonly referred to as e-exams (electronic examinations), underwent a considerable progression, getting adapted ubiquitously among higher education institutions worldwide. Their preferment was rapid due to the emergence of the COVID-19 pandemic. The process of conducting exams online is being opted as the appropriate way of assessment, ensuring the students' safety and well-being. According to Warts et al., this form of examination has been pretty effective in the past when blended with the conventional assessment. However, at present, implemented as the singular way of assessment, e-exams have shown a more significant promise in being beneficial to the learners. As a matter of fact, a comprehensive analysis on understanding the learners' perception towards the e-exams was not done earlier, particularly in the developing nations. Thus, it was pertinent to examine the pre-requisites of e-exams to promote it as a useful tool for the smooth conduct of exams in the aforesaid nations. Against such a backdrop, this study was conducted during January to March 2021 on 207 students enrolled in four universities, three situated in the National Capital Territory (NCT) of Delhi, India: Delhi University (DU), Jamia Millia Islamia (JMI), and Jawaharlal Nehru University (JNU), and one situated in Saudi Arabia, namely Saudi Electronic University (SEU). A quantitative approach was employed for the study, with the responses recorded via web questionnaires. Confirmatory -factor analysis (CFA) was applied in the study to examine whether the process of conducting online examinations is being chosen as the appropriate form of assessment, ensuring the safety and well-being of students through AMOS (version 24) software. For determining the reliability of the two latent constructs, namely "Perceptions of students towards E-exams (PSE)" and "Pre-requisites of E-exams (POE)," Cronbach's alpha was used through SPSS (version 25) software in the study, and the results reveal that the strong internal consistency exists between all the measured variables. In addition, the mean and standard deviation were used by the researchers to find out the pre-requisites of the online examination system. The participants expressed their insights on the relative benefits of online examination. Their perception was based on pedagogy, validity and reliability, affective factors, practicality, and security. From their insights, it was concluded that online examination is more advantageous than conventional paper-based exams. The outcome also applies to the authenticity of grading and the overall efficiency concerning the time, effort, and expenditure on conducting the examination. Contrarily, the participating students also recognized numerous hurdles in implementing e-exams concerning security, validity, and impartiality. The conclusion further revealed that online examination is especially relevant for formative assessment of learning instead of summative assessment, provided authenticity, security, and flexibility are used as fundamental tenants in the proper implementation of e-exams. The outcome of the present study will facilitate higher education institutions and policymakers in taking the electronic examination system to the next level.Entities:
Keywords: COVID-19; formative assessment; higher education institutions; learners’ perception; online examinations; summative assessment
Mesh:
Year: 2021 PMID: 34204429 PMCID: PMC8296437 DOI: 10.3390/ijerph18126534
Source DB: PubMed Journal: Int J Environ Res Public Health ISSN: 1660-4601 Impact factor: 3.390
Baseline Data of the Participants (N = 207).
| Basis | Categories |
|
| % |
|---|---|---|---|---|
|
| Male | 80 | 80 | 38.6 |
| Female | 127 | 207 | 61.4 | |
|
| Up to 20 years | 103 | 103 | 49.8 |
| 21–25 years | 40 | 143 | 19.3 | |
| 26–30 years | 34 | 177 | 16.4 | |
| Above 30 years | 30 | 207 | 14.5 | |
|
| IT (IT, Computer Science, Statistics, and Mathematics) | 58 | 58 | 28.0 |
| Engineering (Agricultural, Mechanical, Civil, and Electrical) | 41 | 99 | 19.8 | |
| Business (Accounting, Secretarial, Supply Chain and Marketing) | 88 | 187 | 42.5 | |
| Art and Design (Fashion and Industrial Art) | 20 | 207 | 9.7 | |
|
| 1st year | 67 | 67 | 32.4 |
| 2nd year | 39 | 106 | 18.8 | |
| 3rd year | 74 | 180 | 35.8 | |
| 4th year | 27 | 207 | 13.0 | |
|
| Delhi University | 66 | 66 | 31.9 |
| Jamia Millia Islamia | 69 | 135 | 33.3 | |
| Jawaharlal Nehru University | 27 | 162 | 13.0 | |
| Saudi Electronic University | 45 | 207 | 21.8 |
Reliability Analysis.
| Construct | A |
|
|---|---|---|
| Students’ Perceptions of E-exams (PSE) | 0.952 | 18 |
| Pre-Requisites of E-exams (POE) | 0.949 | 12 |
Figure 1Perception of Students towards the Online Examination System.
Model Fit Analysis.
| Name of Category | Required Fit | Acceptable Limits | Values Obtained |
|---|---|---|---|
| Absolute Fit Indices |
| 0.157 | |
| RMSEA | <0.05 | 0.042 | |
| SRMR | <0.09 | 0.046 | |
| GFI | >0.90 | 0.910 | |
| Incremental Fit Indices | AGFI | >0.80 | 0.813 |
| CFI | >0.90 | 0.927 | |
| TLI | >0.90 | 0.922 | |
| NFI | >0.90 | 0.913 | |
| Parsimonious Fit Index | CMIN/DF | <3 | 2.403 |
Analysis Summary of Scalar Estimates.
| Path | β |
| CR | |
|---|---|---|---|---|
| PSE → Pedagogy | 0.913 | 0.834 | 8.794 | <0.001 |
| PSE → Validity and Reliability | 0.973 | 0.947 | 9.667 | <0.001 |
| PSE → Affective Factors | 0.811 | 0.657 | 8.631 | <0.001 |
| PSE → Practicality | 0.932 | 0.869 | 9.637 | <0.001 |
| PSE → Security | 0.939 | 0.881 | 9.662 | <0.001 |
| Pedagogy → PSE1 | 0.742 | 0.550 | 12.274 | <0.001 |
| Pedagogy → PSE2 | 0.834 | 0.696 | 11.557 | <0.001 |
| Pedagogy → PSE3 | 0.681 | 0.464 | 9.431 | <0.001 |
| Validity and Reliability → PSE4 | 0.668 | 0.447 | 10.572 | <0.001 |
| Validity and Reliability → PSE5 | 0.786 | 0.618 | 10.137 | <0.001 |
| Validity and Reliability → PSE6 | 0.824 | 0.679 | 10.550 | <0.001 |
| Validity and Reliability → PSE7 | 0.719 | 0.517 | 9.374 | <0.001 |
| Validity and Reliability → PSE8 | 0.743 | 0.552 | 9.650 | <0.001 |
| Validity and Reliability → PSE9 | 0.827 | 0.684 | 10.583 | <0.001 |
| Affective Factors → PSE10 | 0.835 | 0.698 | 12.789 | <0.001 |
| Affective Factors → PSE11 | 0.834 | 0.695 | 12.769 | <0.001 |
| Affective Factors → PSE12 | 0.799 | 0.638 | 12.337 | <0.001 |
| Practicality → PSE13 | 0.766 | 0.587 | 12.036 | <0.001 |
| Practicality → PSE14 | 0.786 | 0.618 | 12.441 | <0.001 |
| Practicality → PSE15 | 0.815 | 0.664 | 12.298 | <0.001 |
| Security → PSE16 | 0.788 | 0.621 | 12.447 | <0.001 |
| Security → PSE17 | 0.735 | 0.540 | 11.383 | <0.001 |
| Security → PSE18 | 0.813 | 0.660 | 11.284 | <0.001 |
β= Beta Coefficient, R2= Squared Multiple Correlations, and CR= Critical Ratio.
Construct Validity Results.
| Construct | Composite Reliability | Average Variance Extracted |
|---|---|---|
| Pedagogy | 0.797 | 0.570 |
| Validity and Reliability | 0.893 | 0.583 |
| Affective Factors | 0.864 | 0.680 |
| Practicality | 0.833 | 0.623 |
| Security | 0.823 | 0.607 |
Perception of Students towards Online Exams.
| Code | Statements | Mean | Standard Deviation |
|---|---|---|---|
|
| |||
|
| Immediate feedback in online exams helps students to get a deeper understanding of the subject. | 4.35 | 0.872 |
|
| Using cutting-edge technology in online exams enables students to take a new learning approach, i.e., online learning. | 4.43 | 0.724 |
|
| Online exams facilitate a more adaptive learning approach than pen–paper-based ones. | 4.07 | 0.289 |
|
| |||
|
| Online exams are appropriate for any subject area. | 2.89 | 1.261 |
|
| Online exams are felicitous to test the learners’ level of knowledge. | 3.83 | 0.675 |
|
| Online exams facilitate more authentic assessment than traditional methods through integration of multimedia, simulations etc. | 3.27 | 1.098 |
|
| Automated grading in the online examination system is more convenient and authentic than the standard grading method. | 4.31 | 0.376 |
|
| Online exams are more valid and reliable than pen–paper-based exams. | 3.00 | 1.201 |
|
| Online exam system offers speedy and accurate solutions within the desired time limit compared to pen–paper tests. | 4.41 | 0.752 |
|
| |||
|
| Online examinations reduce stress and exam anxiety. | 3.30 | 1.237 |
|
| Using online exams allows students to focus and concentrate more on the questions. | 3.18 | 1.155 |
|
| Students feel more comfortable while appearing in an online exam than a pen–paper-based one. | 3.43 | 1.031 |
|
| |||
|
| Online exams are more efficient in terms of time, effort and money spent. | 4.62 | 0.670 |
|
| Creating a question bank will act as a ready reckoner from an exam point of view. | 4.12 | 0.940 |
|
| Online exams are more accessible than pen–paper-based exams. | 3.29 | 1.142 |
|
| |||
|
| Test materials and results of online exams are more secure than traditional methods. | 3.45 | 1.156 |
|
| The technology used in online exams is sufficiently effective in dealing with cheating and plagiarism. | 1.67 | 1.237 |
|
| Setting up an automated timer for the whole exam or per question means that online exams are more secure than pen–paper-based ones. | 4.12 | 0.382 |
|
| 3.74 | 0.881 | |
Considerations for the Effective Implementation of E-exams.
| Code | Statements | SD (1) | D (2) | Total (1 + 2) | N (3) | A (4) | SA (5) | Total (4 + 5) |
|---|---|---|---|---|---|---|---|---|
|
| ||||||||
| POE1 | Maintaining a question bank including different sets of validated questions for adaptive testing. | 6.3% | 8.3% |
| 42.0% | 32.9% | 10.5% |
|
| POE2 | Developing the different essential questioning techniques while conducting online exams. | 6.8% | 8.2% |
| 35.3% | 39.1% | 10.6% |
|
| POE3 | Provide immediate meaningful feedback. | 6.3% | 7.7% |
| 24.6% | 46.9% | 14.5% |
|
|
| ||||||||
| POE4 | Maintaining confidentiality. | 6.3% | 6.8% |
| 25.6% | 42.0% | 19.3% |
|
| POE5 | Minimizing cheating. | 7.2% | 9.2% |
| 35.3% | 28.5% | 19.8% |
|
| POE6 | Authentication. | 7.2% | 4.3% |
| 39.6% | 33.8% | 15.1% |
|
|
| ||||||||
| POE7 | Evaluation of student learning progress and achievement during the ongoing lesson, unit, or course. | 7.3% | 7.7% |
| 31.9% | 40.1% | 13.0% |
|
| POE8 | Linking online exams to intended learning outcomes (ILOs). | 8.2% | 5.8% |
| 37.7% | 35.3% | 13.0% |
|
| POE9 | Linking analysis of results to quality assurance criteria. | 6.8% | 4.3% |
| 34.8% | 44.0% | 10.1% |
|
|
| ||||||||
| POE10 | Integrating the online exam within the strategic plan. | 5.4% | 4.3% |
| 36.7% | 42.0% | 11.6% |
|
| POE11 | Providing resources and facilitating procedures. | 7.2% | 7.3% |
| 26.6% | 42.5% | 16.4% |
|
| POE12 | Providing support for teachers and students. | 6.3% | 6.8% |
| 27.5% | 40.1% | 19.3% |
|