Literature DB >> 36128285

The Virtual Reality Technology Effects and Features in Cardiology Interventions Training: A Scoping Review.

Nasim Aslani1, Ali Behmanesh2,3, Ali Garavand1, Masoumeh Maleki4, Freshteh Davoodi5, Roshanak Shams2.   

Abstract

Background: Virtual Reality (VR) as an emerging and developing technology has received much attention in healthcare and trained different medical groups. Implementing specialized training in cardiac surgery is one of the riskiest and most sensitive issues related to clinical training. Studies have been conducted to train cardiac residents using this technology. This study aimed to identify the effects and features of VR technology in cardiology interventions training.
Methods: This scoping review was conducted in 2021 by searching PubMed, Scopus, and Web of Sciences scientific databases by combining the related keywords. A data extraction form was used for data gathering. Data analyses were done through the content analysis method, and results were reported based on the study objectives.
Results: 21 studies were included; from the 777 articles found in the initial searches, seven (33.33%) were RCT studies. VR-based education studies in cardiology interventions have grown significantly in recent years. The main effects of applying VR include improved user attitude and satisfaction, improved performance after VR training, and improved training and learning. Input devices include tracking devices, point input devices, and controllers. Output devices were three main categories include graphics audios and haptic.
Conclusion: The use of new technologies, especially VR, can improve the efficiency of medical training in clinical settings. It recommends that this technology train the necessary skills for heart surgery in cardiac residents before performing real surgery to reduce the potential risks and medical errors.
© 2022 Iran University of Medical Sciences.

Entities:  

Keywords:  Cardiology; Medical Training; Virtual Reality

Year:  2022        PMID: 36128285      PMCID: PMC9448494          DOI: 10.47176/mjiri.36.77

Source DB:  PubMed          Journal:  Med J Islam Repub Iran        ISSN: 1016-1430


Various studies have been conducted in teaching cardiovascular interventions based on virtual reality in recent years, and different results have been obtained. Identifying the features and effects of these interventions in various studies and explaining the existing challenges and gaps can increase the effectiveness of these interventions. The features of VR for training cariological intervention were include VR modeling tools, simulation platform, input device, and output device. The main effects of applying VR were include improved user attitude and satisfaction, improved performance after VR training, and improved training and learning.

Introduction

In medical education with a traditional approach, living patients should be used to strengthen the skills of specialists in various clinical fields (1,2). At the same time, educational and medical centers will be responsible for providing optimal treatment for patients and ensuring their safety and well-being (3). These conflicting needs pose a moral challenge in medical education, widely recognized (4). Also, traditional teaching methods in medical universities do not provide the power to analyze, prioritize and organize emerging knowledge required for critical and creative thinking and practical learning. In medical education, professors must constantly confront students with various issues and situations and force them to challenge themselves mentally (5). Thus, medical education has led in charge to consider the use of alternative methods; therefore, new technologies such as virtual reality (VR) have been widely used in recent years (6). As an emerging and expanding educational technology in medical education, VR is highly regarded and used in the education of various medical groups (1). This technology simulates the world around the computer and communication through the receiver (7). VR is a computer-based technology that creates a simulated and three-dimensional environment that allows the patient to perform thousands of exercises without time and space constraints and harm the patient (8). VR is a hybrid interface (human-machine), which combines various technologies such as computer graphics, image processing, pattern recognition, artificial intelligence, networking, and audio systems to produce computer simulations and interactions (9). This technology gives the user the feeling of being in an actual condition through various sensory feedback such as Visual, auditory, and tactile (10-12). Medical errors have always been a significant issue. One of the most important ways to reduce medical errors is to increase students’ practical training and increase the quality of education. While empowering medical students, VR technology can minimize the stress and mood of this group and cover the inherent disadvantages of traditional medical education (13). VR technology will provide a unique visualization for students that is not possible in traditional classrooms (14). The advantages of this technology include high safety, flexibility, and proper interaction with learners, which has increased their interest and interaction, ultimately improved the quality of education, and has led to appropriate responses to problems such as language differences (15). Implementing specialized training in various fields of cardiac is one of the riskiest and most sensitive issues related to clinical activity (16). Therefore, studies have been conducted to train cardiac residents using VR technology. Many studies have emphasized using this technology in medical education, especially in cardiology interventional education (17-20). In their study, Alfalah et al. compared the heart’s anatomy using VR with traditional methods. They showed that VR had improved the quality of heart anatomy to learners and the high level of satisfaction with this method of education (21). In their study, Abiri et al. Used a VR-based simulator to simulate the morphological changes of the heart and emphasized that the tool used could be a high-resolution tool for teaching basic and clinical sciences (22). Another study by Aeckersberg et al. found that simulated VR-based training increased motivation for novice trainees. In general, low-loyalty simulation has the potential to be useful for novice trainees, but the potential risks of simulation training need to be further assessed (23). With the increase in studies and growth of VR in cardiologists and residents’ education, the variety of tools and methods used in this field, the need to study features of these technologies felt more than ever. Scientific studies on the technologies used can help researchers and officials make more appropriate decisions in using VR. This study aimed to identify the effects and features of VR technology in cardiology interventions training in a review.

Methods

Search Strategy and data sources

This study is a scoping review done in 2021 based on scoping review and systematic review guidelines (24,25). The scoping review has three main parts: Population, Context, and Concept (PCC) (26). Therefore, it was formulated based on the scoping review parts. The searches have been done in PubMed, Scopus, and ISI Web of Sciences scientific databases to find related studies by applying associated keywords (Table 1). Also, searches are limited to English-language articles conducted in the last ten years to review the most significant changes made during this period.
Table 1

Search strategy of the study

LimitationsEnglish full-text article, During 2012-2021
#1“virtual reality” OR “augmented reality” OR “virtual realities” OR “VR” OR “mixed reality” OR “augmented realities” OR “mixed realities” OR “computer simulate”
#2“cardiology” OR “heart physician” OR “cardiologist” OR “heart surgery”
Search #1 And #2

Inclusion criteria

All original articles about VR technology in cardiology interventions training in different medical students, especially cardiologists, were included. The purpose of the intervention term was invasive and non-invasive surgeries and heart procedures.

Exclusion criteria

Other article types such as reviews, short communications, letters, commentaries, and case reports were excluded from the study. Articles that were not about applying VR to cardiology interventions training were excluded. Articles in other languages except English excluded from the study. Also, articles about different training methods in cardiology interventions, such as traditional methods or multimedia educational products, were excluded. The studies that do not implement the VR program for cardiology intervention training were excluded.

Data gathering

Two authors collected data independently (at the same time), and the inconsistency has been forwarded to the next author. Data gathering was done using a data extraction form in Excel (Microsoft Office 2019). The data extraction table includes four parts: article bibliography information, methodological information, features and effects, and other study results.

Data analyses

We used the content analyses approach to analyze the data, and the results were reported based on the study objectives.

Results

Of the 777 articles found in the initial search, finally, 21 studies were included in the study based on the inclusion and exclusion criteria (Fig. 1).
Fig. 1
Study selection steps (27) The general information of selected studies showed in Table 2. Based on this table, cardiac catheterization, angiography, and interventions for Congenital Heart Disease patients were the most popular intervention.
Table 2

The features of the selected studies

Authors, Year,CountryAimEducation topicStudy participantsData analysesMain results
Aeckersberg2019Germany(23)The relevance of low-fidelity virtual reality simulators compared with other learning modelsBasic endovascular skills50 Medical studentsNonparametric testsThe simulation system used was useful for students, but the risks of simulation should also be considered in the study.
Andersen2021Denmark(28)Evaluating the effect of VR education on a course (peripheral venous cannulation)Peripheral venous cannulation19 Medical studentsFisher exact testsUsing VR along with regular training can improve catheterization learning.There was no difference in the time of surgery between the two groups.Suggest further studies
Balian2019USA(29)Feasibility of AR cardiopulmonary resuscitation education Cardiopulmonary resuscitation51 HCPQuantitative and qualitative analysisSatisfied with the system, helpful for training, willing to use the applicationFurther studies in this area are suggested.
Chang2021Taiwan(30)The effect of using VR on knowledge related to atrial fibrillationAtrial fibrillation20 residentsDescriptive statisticsAchieve the purpose of a paperless environment
Galvez2020USA(31)Using VR to teach peripheral and lateral circulation of the heart to medical studentsPeripheral and lateral circulation of the heart32 medical studentsQuantitative and qualitativeRecommended for use in similar studies.The high willingness of participants to use this technology.The results of the study also suggest many guidelines for the use of virtual reality.
Guo2018China(32)Evaluate the performance of interventional surgeries using a virtual reality simulatorEndovascular interventional surgerySurgeonsAnalytical statisticsThe simulation method used provides the real needs of residents for endovascular interventional surgery.
Bagai2012Canada(33)Investigating the effect of VR on cardiac catheterization skillsCardiac catheterization27 residentsLinear regressionLess skilled residents have more learning to perform catheterization than more skilled residents.
Fierros2021Mexico(34)Designing a mobile-based virtual reality software to teach Cardiopulmonary Resuscitation TechniquesCardiopulmonary Resuscitation-Multifactorial ANOVA, multifactorial analysis of varianceTraining with this system increases users’ skills.
Isaranuwatchai2014Canada(35)Evaluation of the cost-effectiveness of using a VR simulator in intravenous catheterization trainingIntravenous catheterization45 medical studentsBenefit regression model to identify the most cost-effective training program via paired comparisonsThe progressive program had the highest cost. However, the high-fidelity program had the highest running costs.The progressive training program was the most cost-effective
Jaskiewicz2020Poland(36)Use of VR in the quality of pressure on the chest during cardiac arrestChest massage during heart attacks113 medical studentsQuantitative analysis using PHStat softwareFuture studies should focus on finding the most effective way to combine VR with traditional skills training in the CPR curriculum.
Jensen2016Sweden(37)explore if proficiency-based training in coronary angiography (CA) simulatorAngiographySixteen senior cardiology residentsAnalytical statisticsIn real life, the VR-trained group had shorter fluoroscopy and total procedure times than the controls
Kim2020USA(38)Development and evaluation of the usability of VR system in Congenital Heart DiseaseCongenital Heart Disease22 medical traineesIndependent T-test and ANOVA.Immersion is an important feature of displaying medical images for diagnostic accuracy in joint discussions.
Lau2021Australia(39)Comparison of the clinical value of VR compared to 3D Printing in Congenital Heart DiseaseCongenital Heart Disease35 medical practitionersDescriptive and analytical statisticsTwenty-one participants (72%) showed that VR and 3DPHM offer more benefits than conventional medical imaging. This study concludes similar clinical value of VR and 3DPHM in CHD, although more research is needed for more cardiologists to comment on the usefulness of these tools.
Li2021China(40)Design and Evaluation of Personalized Percutaneous Coronary Intervention Surgery Simulation SystemPercutaneous Coronary Intervention Surgery16 cardiologists and 20 intervention traineesAnalytical statisticsThe results confirm that the simulation system can provide a better user experience and is a good platform for training and practicing PCI surgery.
Popovic2019France(41)Training in Coronary Angiography by VRCoronary Angiography12 cardiology residentsMann Whitney U test whenunpaired and the Wilcoxon signed-rank test when pairedVirtual reality can be used as a skill assessment tool.Provides a safe environment for specialist training and leads to a coherent and standardized learning plan.
Ralston2021USA(42)training in the pediatric cardiac intensive care unit for the first timePediatric cardiac care6 participantsDescriptive statisticsFurther studies are indicated as this is a preliminary study.
Valdis2015Canada(43)Validation of a Novel Virtual Reality Training Curriculum for Robotic Cardiac SurgeryRobotic Cardiac Surgery20 surgical traineesKruskal-Wallis analysis of variance and Mann-Whitney U analysisFurther evaluation of this curriculum is needed for its widespread implementation in surgical education
Vallurupalli2013USA(44)Using AR to improve education and patientoutcomes in a cardiology fellowship programCardiology fellowship programCardiology fellows-Medical institutions should work on policies to use such technologies to enhance medical care without compromising patient privacy.Training program managers can record their trainees’ skills as a way to ensure pre-graduation competency.
Voelker2015Germany(45)The effect of simulation-based training on coronary artery interventionsCoronary artery interventionsEighteen cardiology fellowsKruskal–Wallis test, Mann–Whitey U-testThe level of performance of the cardiologist in coronary artery interventions is improved using VR.Further research is needed to assess the impact on clinical outcomes.
Zhou2014China(46)Cardiovascular-interventional-surgery virtual training platformCardiovascular-interventional-surgeryCardiologistTranslation test (a) and rotation testMore studies will be done in the future. Carry out studies to validate the present study.
Talbot2017France(47)Interactive training system for interventional electrocardiology proceduresInterventional electrocardiologyproceduresCardiologist-According to a heart arrhythmia scenario, they demonstrate the ability of the user-guided simulator to move through the catheter into the arteries and cavities of the heart and reproduce an erosive technique including extracellular potential measurements, endocardial surface reconstruction, and electrophysiological mapping.
According to Figure 2, the number of conducted studies increased in the last three years, including 2019 (3 studies), 2020 (3 studies), and 2021 (6 studies); 58% of conducted studies were in these years.
Fig. 2
Study trends based on year of publication The results showed that the conducted articles were in 11 countries. The USA has five studies (23.81%), China with three studies (14.29%), and Canada with three studies (14.29%) have the most conducted studies. Based on Table 3, the observational studies were more than interventional studies. Comparative studies (cross-sectional) were the most study type in observational studies.
Table 3

Study type of selected articles

Study typeNumber of studies%
Interventional733.33
ObservationalFeasibility study366.67
Prospective 1
Cohort 1
Comparative (cross-sectional)5
Developmental4
Table 4 shows the technical features of the VR system in the studies based on software and tools information.
Table 4

The technical features of the VR system in the selected studies

VR Modeling ToolsSimulation Open‐source Framework Architecture (SOFA) in an XML (32,47)
3D data (32)3D modeling (34) 3D-human model (36)
MENTICE VIST (Vascular Intervention Simulation Trainer) (33)
GIMIAS (an open-source framework providing image visualization, manipulation, and annotation) (47)
4D-Image based model of the heart (47)
GPU implementation (47)
Simulation platformiOS app (23)
Android platform (34)
Computer-based system (35,46)
Smartphone, tablet, or personal computer (44)
Input deviceTracking deviceA tablet-based program with Wireless connection (23)
A head-mounted device with 2 controllers, using tip tracking (28)
CPR recording manikin integrated with a head-mounted commercial AR device (Microsoft Hololens, Microsoft, Redmond WA) (29)
Computers running the VR version of Organon and Vive headsets (31)
The virtual catheterization is rendered with a real-time frame rate of 75 FPS with a single high-performance instrument (46)
HX711 integrated circuit block, an analog-digital converter that, together with the sen-1045 sensor, measures the force applied to a mannequin or substitute (34)
Live video stream from the glass (44)
Point input deviceInteractions through buttons and physical movements during the simulation (34)
ControllerANGIO Mentor simulator allows C arm movement, contrast injection, and fluoroscopic imaging, and displays direct cardiovascular monitoring (23,45)
Image detector angle and projection, and zoom features like in a real catheterization laboratory (33)
Nodemcu ESP32 microcontroller (34)
Arm simulator and SimMan (35)
Output deviceVisualSimulator monitor (23)
Tablet monitor (28)
Instructor feedback in a monitor (31)
Display some results in screen (33)
Virtual reality lenses (34)
Video and script (35)
Virtual operation scene, a CT image and a virtual ECG monitor developed to simulate the realistic virtual operation environment (46)
AudiosHololens device, in the form of a heartbeat at 110 bpm, was audible to the subject as a guide (29)
HapticPhantom (28)
Modified instruments are inserted through the access port using a haptic interface device (coronary catheters, guidewires, inject contrast dye, and perform diagnostic) (34)
Was implemented for HTC Vive (HTC, Taoyuan, Taiwan) and Noitom Hi5 VR Glove (36)
Decoupled haptic device (45)
Based on Table 5, the effects of VR-based training on cardiology interventions have three main themes and 18 Sub-themes.
Table 5

The effects of VR in cardiology interventions training

Theme Sub-theme References
Improve user attitude and satisfactionIncrease interest, (23)
Self-efficacy (30)
Increase satisfaction(30)
Enjoy learning(31)
Improve performance after training with VRHigher practical skills(23)
Improving angiography skills by cardiologist residents(37,41)
Angiography error reduction(37,41)
Improve catheterization skills(41)
Improvements in CPR(36)
Reduce catheterization time in the real environment(41)
Improving the accuracy of surgical interventions(46)
Improve training and learningIncreased the learning efficacy(28)
Positive impact on education,(29)
Useful educational tool(29)
Increase knowledge of residents(30)
Facilitate the learning of pediatric cardiac interventions(42)
Improving the efficiency and quality of learning in robotic heart surgery(43)
Improve training to run a heart fellowship program(44)
Applying VR in cardiology intervention training has some challenges. Based on Table 6, these challenges are classified into seven categories.
Table 6

The disadvantages of VR in cardiology training

RowDisadvantages References
1There was no significant performance improvement in practical skills(23)
2Further, assess the risks of VR-based education(23)
3Extra VR equipment placed on the trainee’s body may make chest tightness more difficult.(36)
4If the use of VR before training is not common, it may have adverse effects on the depth of massage and Full Chest Relaxation (FCR).(36)
5Limitations of realism in some mechanical aspects in VR(42)
6Flexibility, accuracy, and inadequate response of the mechanical system of VR(46)
7Uncertainty in generalizing the results and proposing to conduct other studies(45,46,48-50)

Discussion

The use of technological advances such as VR seems to be essential for the training of physicians and medical students. By creating a near-realistic environment for practical training for cardiac residents, VR allows residents with little experience to gain enough experience in the background and make fewer errors in the realm of intervention and patient intervention. Specialized clinical training has high sensitivities and is directly related to human lives. One of the challenges in educating medical students is their attitude and satisfaction. Based on the results of the study, it found that the attitude and satisfaction of trainers of cardiac interventions using VR increased, and they showed a greater desire to learn (23,30,31). All studies were conducted in developed countries. It suggested that other countries, including countries with serious challenges in medical education and developing countries, use these tools to improve teaching and increase the effectiveness of medical education, especially for teaching heart interventions, use VR-based tools. Using countries’ experiences that have used information technology can influence future projects’ success (48). It examined the type of studies conducted in cardiac intervention training using VR. It found that a small percentage of the studies were performed as interventional. Given the role of intervention studies in evidence-based decision-making, it suggested that more intervention studies be conducted on the use of VR to teach cardiology interventions to ensure its positive effects on resident education. A review of the trend shows that studies based on training in cardiac interventions using VR have grown significantly in recent years, which could be due to many reasons, including this increase. Studies have been done to realize the importance and role of this technology in cardiac intervention education. On the other hand, the outbreak of the COVID-19 and the closure of some face-to-face training (49), the emphasis on virtual training and reducing direct contact between people, and cutting the transmission chain can also be reasons for increasing the tendency to use VR to train heart interventions. Therefore, using this technology in critical situations like COVID-19 can be a good alternative. The study results showed that cardiac catheterization and angiography were the most emphasized in educating VR technology (33,37,41,45). Due to the high sensitivity of cardiac catheterization and angiography and the high risk of performing these interventions in novice physicians or cardiovascular residents, the use of VR for adequate training and education before entering the hospital and inpatient wards is a good option. The assessments conducted in the study showed that VR implementation time to perform cardiac interventions for residents is very sensitive and should be performed for residents who are at the beginning of the training path and have not performed the relevant intervention for actual patients. If this point is observed, it can expect that training efficiency will increase (44). If VR is added to the training of cardiac residents to perform cardiac interventions, this training should be performed by them before performing actual interventions. Studies in this field have shown that a large part of the studies on the use of VR to train medical groups in the anatomy of various body organs (50). It suggested that due to the heart organ’s nature, VR should be used more in teaching anatomical positions, especially the heart, especially for students of general medicine and other medical and paramedical departments. The results showed that different platforms such as iOS, Android, computer-based systems, and in some cases, a combination of different media (23,34,44,46) were used to design and use VR. The expansion of VR tools with the ability to run on various platforms has provided the ground for more implementation of this technology in medical education. However, for the widespread implementation of this technology in medical education, in addition to technical aspects, other factors such as economic and cultural factors should be considered. It suggested that more studies should be done in this field. Many studies have spoken cautiously about the widespread use of VR, emphasizing further studies in this area. In their research, Aeckersberg et al. pointed to the need to assess the risks of VR-based training in basic endovascular skills training (23). Other important issues in many studies in the field have been the limited sample and low chance of generalizing the study results. This is why many studies have suggested further studies in this area. Another issue with VR-based medical education is the degree to which it is realistic and provides conditions similar to reality in VR tools (46). It is necessary to ensure the level of realism of these tools and how close they are to reality and should be done more studies and experiments on the development of these tools.

Conclusion

The use of VR can improve the efficiency of medical training in clinical settings. Thus, it is recommended to use this technology to train the necessary skills for heart surgery in cardiac residents before performing real surgery to reduce the potential risks and medical errors. Although it can be cost-effective to implement VR -based programs for specialized medical training, one can hope for the cost-effectiveness of this type of training, in the long run, to reduce medical errors in the future. Due to the high risk of cardiac interventions being very sensitive, it needs a high level of clinical skills. If VR improves the skills of performing cardiac interventions by physicians and residents, it can be said that VR will be a cost-effective method. Therefore, it’s suggested that medical schools and specialized heart training hospitals set up VR -based cardiac intervention training laboratories to test these methods. In general, teaching cardiology interventions using VR cannot substitute for conventional methods of teaching residents and other medical students in this field. It is a supportive tool and can be a reliable training before entering the ward and bedside the patient. Under no circumstances should the actual training time be reduced due to VR use. It is recommended that more studies be conducted about the feasibility of VR in cardiological intervention training. Extensive studies and comparisons of the effect of education using VR with existing educational methods are other recommendations that medical universities can use.

Acknowledgment

We want to thank the school of allied medical sciences of Lorestan University of Medical Sciences for providing an appropriate condition to apply this study.

Conflict of Interests

The authors declare that they have no competing interests.
  43 in total

1.  Virtual reality training in coronary angiography and its transfer effect to real-life catheterisation lab.

Authors:  Ulf J Jensen; Jens Jensen; Gunnar Ahlberg; Per Tornvall
Journal:  EuroIntervention       Date:  2016-04-20       Impact factor: 6.534

2.  The Simulation Training in Coronary Angiography and Its Impact on Real Life Conduct in the Catheterization Laboratory.

Authors:  Batric Popovic; Samuel Pinelli; Eliane Albuisson; Pierre Adrien Metzdorf; Brice Mourer; Nguyen Tran; Edoardo Camenzind
Journal:  Am J Cardiol       Date:  2019-01-24       Impact factor: 2.778

3.  Mentored simulation training improves procedural skills in cardiac catheterization: a randomized, controlled pilot study.

Authors:  Akshay Bagai; Sean O'Brien; Hatim Al Lawati; Prateek Goyal; Warren Ball; Teodor Grantcharov; Neil Fam
Journal:  Circ Cardiovasc Interv       Date:  2012-10-09       Impact factor: 6.546

4.  Virtual reality informative aids increase residents' atrial fibrillation ablation procedures-related knowledge and patients' satisfaction.

Authors:  Shih-Lin Chang; Ming-Jen Kuo; Yenn-Jiang Lin; Shih-Ann Chen; Ying-Ying Yang; Hao-Min Cheng; Ling-Yu Yang; Shou-Yen Kao; Fa-Yauh Lee
Journal:  J Chin Med Assoc       Date:  2021-01-01       Impact factor: 2.743

5.  Design and Evaluation of Personalized Percutaneous Coronary Intervention Surgery Simulation System.

Authors:  Shuai Li; Jiahao Cui; Aimin Hao; Shuyang Zhang; Qinping Zhao
Journal:  IEEE Trans Vis Comput Graph       Date:  2021-10-27       Impact factor: 4.579

6.  PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation.

Authors:  Andrea C Tricco; Erin Lillie; Wasifa Zarin; Kelly K O'Brien; Heather Colquhoun; Danielle Levac; David Moher; Micah D J Peters; Tanya Horsley; Laura Weeks; Susanne Hempel; Elie A Akl; Christine Chang; Jessie McGowan; Lesley Stewart; Lisa Hartling; Adrian Aldcroft; Michael G Wilson; Chantelle Garritty; Simon Lewin; Christina M Godfrey; Marilyn T Macdonald; Etienne V Langlois; Karla Soares-Weiser; Jo Moriarty; Tammy Clifford; Özge Tunçalp; Sharon E Straus
Journal:  Ann Intern Med       Date:  2018-09-04       Impact factor: 25.391

7.  The PRISMA 2020 statement: an updated guideline for reporting systematic reviews.

Authors:  Matthew J Page; Joanne E McKenzie; Patrick M Bossuyt; Isabelle Boutron; Tammy C Hoffmann; Cynthia D Mulrow; Larissa Shamseer; Jennifer M Tetzlaff; Elie A Akl; Sue E Brennan; Roger Chou; Julie Glanville; Jeremy M Grimshaw; Asbjørn Hróbjartsson; Manoj M Lalu; Tianjing Li; Elizabeth W Loder; Evan Mayo-Wilson; Steve McDonald; Luke A McGuinness; Lesley A Stewart; James Thomas; Andrea C Tricco; Vivian A Welch; Penny Whiting; David Moher
Journal:  BMJ       Date:  2021-03-29

8.  Effects of mobile augmented reality learning compared to textbook learning on medical students: randomized controlled pilot study.

Authors:  Urs-Vito Albrecht; Kristian Folta-Schoofs; Marianne Behrends; Ute von Jan
Journal:  J Med Internet Res       Date:  2013-08-20       Impact factor: 5.428

9.  A Critical Review of the Use of Virtual Reality in Construction Engineering Education and Training.

Authors:  Peng Wang; Peng Wu; Jun Wang; Hung-Lin Chi; Xiangyu Wang
Journal:  Int J Environ Res Public Health       Date:  2018-06-08       Impact factor: 3.390

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.