Learning from feedback: Evaluation of dynamic decision-making in virtual reality under various repetitive training frameworks

Abstract

Dynamic decision-making involves a series of interconnected interdependent confluence of decisions to be made. Experiential training is preferred over traditional methods to train individuals in dynamic decision-making. Imparting experiential training in physical settings can be very expensive and unreliable. In virtual reality (VR), synthetic environments play a significant role in providing flexible and cost-effective training environments to enhance dynamic decision-making. However, it is still unclear how VR can be used to impart dynamic decision-making training to increase cognitive performance in complex situations. Besides, different repetitive training methods like desirable difficulty framework and heterogeneity of practice have been evaluated on generic cognitive and motor tasks. However, an evaluation of how these repetitive training methods facilitate dynamic decision-making in an individual in a virtual complex environment setting is lacking in the literature. The objective of this study is to evaluate the effect of different repetitive training methods in immersive VR on dynamic decision-making in a complex search-and-shoot environment. In a lab-based experiment, 66 healthy subjects are divided equally and randomly into three between-subject training conditions: heterogenous, difficult, and sham. On Day 1, all the participants, regardless of the condition, executed an environment of a baseline difficulty level. From Days 2 to 7, the participants alternatively executed the novice difficulty and expert difficulty versions of the environment in the heterogenous condition. In difficult conditions, the participants executed the expert difficulty version of the environment from Days 2 to 7. In the sham condition, the participants executed an unrelated VR environment from Days 2 to 7. On Day 8, the participants executed the baseline difficulty version of the environment again in all the conditions. Various performance and workload-based measures were acquired. Results revealed that the participants in the heterogenous and difficult conditions performed significantly better on Day 8 compared with Day 1. The results inferred that a combination of immersive VR environment with repetitive heterogenous training maximized performance and decreased cognitive workload at transfer. We expect to use these conclusions to create effective training environments in VR for imparting training to military personnel in dynamic decision-making scenarios.

Evaluating the efficacy of a haptic feedback, 360° treadmill-integrated virtual reality framework and longitudinal training on decision-making performance in a complex search-and-shoot simulation

“…These results concurred with the work done by researchers in [28], who reasoned that due to the ability of vibrotactile feedback and 360° locomotion's ability to engage the proprioceptive senses, it manages to capture a participant's attention and exacerbates the sense of "being there" in the serious simulation, eventually managing to create a coherent and compelling perceptual experience. Researchers in [26] also reasoned that multisensory feedback was linked to embodied presence, i.e., the feeling of control and influence over the virtual actions being executed by the participants. A qualitative, formal interview with the participants in the experimental condition also revealed that positive emotional responses and excitement also contributed to a sense of immersion and presence, even though it did not translate into higher performance satisfaction.…”

“…Like haptic feedback systems, 360° locomotion treadmills signify a notable progression in virtual reality interaction, facilitating users to engage in naturalistic movement within virtual spaces [25]. In contrast to traditional VR setups that rely on handheld controllers for locomotion, these treadmills allow users to walk, run, turn, and navigate freely in all directions, enabling unrestricted movement [25][26][27]. The ability to move freely and interact with virtual spaces as they would in the physical world eliminates the disconnect between motor actions and visual feedback, reducing motion sickness and enhancing spatial presence [27].…”