Multimodal Feedback to Improve Performance of Order Picker Truck Drivers Using a Virtual Reality Simulator

Abstract

VR technology presents exciting prospects for immersive forklift training environments. VR facilitates hands-on learning without the risks of real world errors. Real-time multimodal feedback (such as visual and haptic) is an effective way to enhance learning outcomes and skill acquisition. However, the efficacy and usability of real-time multimodal feedback provided for VR-based forklift driving needs to be investigated, as its impact on training outcomes remains unexplored. We aim to understand how various feedback modalities influence task performance, perceived workload, and user preferences. Fifteen (3 female, 12 male) individuals participated and completed VR-based forklift driving tasks with four feedback conditions (No feedback, visual, haptic, combined visual and haptic). A significant main effect of Feedback was found for completion time. Mental demand and frustration were affected by the Sex and Feedback interaction. These differences in the perception of feedback modalities underscore the importance of considering diverse user demographics when designing feedback systems.