Evaluation and assessment of virtual reality-based simulated training: exploring the human–technology frontier

• Published in: European journal of training and development Vol. 46; no. 5/6; pp. 434 - 449
• Main Authors: Akdere, Mesut, Jiang, Yeling, Lobo, Flavio Destri
• Format: Journal Article
• Language: English
• Published: Emerald Publishing Limited 26-05-2022
• Subjects: Behavior; Computer Simulation; Educational Technology; Evaluation Methods; Human Body; Measurement Techniques; Mixed Methods Research; Physiology; Program Evaluation; Qualitative Research; Statistical Analysis; Training; Data triangulation; Virtual reality simulation; Training evaluation; Biometric data; Mixed research method; Training assessment
• ISSN: 2046-9012; 2046-9020
• DOI: 10.1108/EJTD-12-2020-0178

Purpose
As new technologies such as immersive and augmented platforms emerge, training approaches are also transforming. The virtual reality (VR) platform provides a completely immersive learning experience for simulated training. Despite increased prevalence of these technologies, the extent literature is lagging behind in terms of evaluating and assessing such innovative training models. The purpose of this paper is to address this gap through exploring the traditional approaches of quantitative, qualitative and mixed methods as well as the cutting-edge biometric approach in the evaluation and assessment of the VR-based simulated training and discuss implications for simulated training based on immersive technologies.
Design/methodology/approach
Evaluation and assessment is one of the most critical components of training and development. Inaccurate or ineffective approaches to evaluate and assess training programs not only risk the successful attainment of training goals and outcomes, but they also harm trainees by misleading them about their training performances and experiences. This paper uses a review of existing literature to explore effective approaches for the evaluation and assessment of VR-based simulated training and conceptually discusses new capacities in capturing involuntary trainee reaction toward stimuli, in addition to traditional evaluation and assessment methods.
Findings
Immersive VR-based simulated training is uncharted territory for trainers and human resource development professionals. The findings indicate that existing approaches are still viable options for the evaluation and assessment of this new training technology. However, biometrics presents new frontiers in this arena through its capacity for obtaining trainee emotional responses to stimuli during training, as well as providing a venue free of personal bias and external influences in determining trainee perceptions.
Originality/value
This paper addresses an important gap in the field of training and development by studying the affordances of the latest biometric technology for evaluation and assessment in VR-based simulated training. The existing literature is very limited in its focus on immersive training technologies such as VR in general and evaluation and assessment in particular. The paper presents new insights to both researchers and practitioners in the field of training and development.