| Literature DB >> 34093065 |
Raghu Raman1, Sairam B2, Veena G3, Hardik Vachharajani4, Prema Nedungadi3.
Abstract
COVID-19 global pandemic pushed a large number of higher educational institutions to use Online Proctored Exams (OPE) because of government-imposed lockdowns. Treating OPE as an educational technology innovation, we apply the diffusion of innovation theory in predicting factors affecting its adoption by university students which we believe is the first of its kind research study. The study presented here reviews OPE, its types, architecture, challenges, and prospects and then focuses on the student adoption experience at a large, multi-campus higher educational institution. We have used the fine-grained Aspect Level Sentiment Analysis to check the university students' attitudes towards the Online Proctored Exams. We then used linguistic features to extract the aspect terms present in the feedback comments which showed that 55% of university students having a positive attitude towards OPE. Results of our study show that innovation characteristics such as relative advantage, compatibility, ease of use, trialability, and observability were found to be positively related to acceptance of OPE.Entities:
Keywords: Covid-19; Diffusion; Innovation; Online exams; University students
Year: 2021 PMID: 34093065 PMCID: PMC8166363 DOI: 10.1007/s10639-021-10581-5
Source DB: PubMed Journal: Educ Inf Technol (Dordr) ISSN: 1360-2357
Fig. 1High-level architecture and flow for online proctored exams
Fig. 2Trained human proctors monitoring students taking online exams
Fig. 3Research model for student intentions to use OPE
Reliability and validity
| Constructs | Cronbach Alpha | AVE | CR |
|---|---|---|---|
| Relative Advantage | 0.90 | 0.51 | 0.89 |
| Compatibility | 0.84 | 0.69 | 0.87 |
| Ease of Use | 0.87 | 0.58 | 0.89 |
| Trialability | 0.86 | 0.50 | 0.74 |
| Observability | 0.78 | 0.46 | 0.71 |
| Intention to Use | 0.75 | 0.60 | 0.85 |
Scale α = 0.91
Rotated component matrixa
| 1 | 2 | 3 | 4 | 5 | 6 | |
|---|---|---|---|---|---|---|
| RA1 | 0.550 | |||||
| RA2 | 0.796 | |||||
| RA3 | 0.704 | |||||
| RA4 | 0.774 | |||||
| RA5 | 0.808 | |||||
| RA6 | 0.781 | |||||
| RA7 | 0.729 | |||||
| RA8 | 0.663 | |||||
| RA9 | 0.524 | |||||
| C1 | 0.858 | |||||
| C2 | 0.823 | |||||
| C3 | 0.818 | |||||
| EU1 | 0.835 | |||||
| EU2 | 0.828 | |||||
| EU3 | 0.763 | |||||
| EU4 | 0.547 | |||||
| EU5 | 0.811 | |||||
| EU6 | 0.777 | |||||
| T1 | 0.724 | |||||
| T2 | 0.720 | |||||
| T3 | 0.660 | |||||
| O1 | 0.829 | |||||
| O2 | 0.792 | |||||
| O3 | 0.786 | |||||
| O4 | 0.695 | |||||
| IU1 | 0.477 | |||||
| IU2 | 0.823 | |||||
| IU3 | 0.688 |
Discriminant validity
| Constructs | Mean | SD | 1 | 2 | 3 | 4 | 5 | 6 |
|---|---|---|---|---|---|---|---|---|
| Relative Advantage | 3.16 | 0.81 | 0.71 | |||||
| Compatibility | 3.13 | 0.96 | 0.28 | 0.83 | ||||
| Ease of Use | 3.36 | 0.83 | 0.30 | 0.12 | 0.76 | |||
| Trialability | 3.15 | 0.90 | 0.65 | 0.25 | 0.28 | 0.70 | ||
| Observability | 3.18 | 0.81 | 0.19 | 0.37 | 0.32 | 0.12 | 0.67 | |
| Intention to Use | 3.57 | 0.76 | 0.48 | 0.37 | 0.39 | 0.43 | 0.30 | 0.77 |
Multiple regression
| β | SE | t | p | Tolerance | VIF | |
|---|---|---|---|---|---|---|
| (Constant) | 0.977 | 0.171 | 5.716 | 0.00 | ||
| Relative Advantage | 0.249 | 0.050 | 4.756 | 0.00 | 0.537 | 1.86 |
| Compatibility | 0.208 | 0.034 | 4.855 | 0.00 | 0.816 | 1.22 |
| Ease of use | 0.226 | 0.039 | 5.325 | 0.00 | 0.833 | 1.20 |
| Trialability | 0.142 | 0.044 | 2.757 | 0.00 | 0.870 | 1.15 |
| Observability | 0.085 | 0.041 | 1.948 | 0.05 | 0.782 | 1.27 |
Model summary
| Model | R | R Square | Adjusted R Square | Std. Error of the Estimate |
|---|---|---|---|---|
| 1 | 0.613a | 0.376 | 0.369 | 0.61014 |
a. Predictors: (Constant), Observability, Trialability, Ease of Use, Compatibility, Relative Advantage
Patterns for feature extraction
| Feature | Pattern |
|---|---|
| F1 | JJ NN NNS |
| F2 | NN NN + |
| F3 | VBN/VBD NN NNS |
| F4 | JJ RB/RBR/RBS NN/NNS |
| F5 | RB/RBR/RBS JJ NN/NNS |
Fig. 4Research model hypothesis testing
Fig. 5Proposed method for aspect classification
Fig. 6Output of stanford dependency parser