Dialogue-Based Simulation For Cultural Awareness Training

Abstract

Existing simulations designed for cultural and interpersonal skill training rely on pre-defined responses with a menu option selection interface. Using a multiple-choice interface and restricting trainees' responses may limit the trainees' ability to apply the lessons in real life situations. These systems, also rely on a simplistic evaluation model, where trainees' selected options are marked as either correct or incorrect. The model cannot capture sufficient information that could drive an adaptive feedback mechanism to improve trainees' cultural awareness. This paper describes the design of a dialogue-based simulation for cultural awareness training. The simulation, built around a disaster management scenario involving a joint coalition between the US and the Chinese armies. Trainees were able to engage in realistic dialogue with the Chinese agent. Their responses, at different points, get evaluated by different multi-label classification models. Based on training on our dataset, the models score the trainees' responses for their awareness of the Chinese culture. Trainees also get feedback that informs the cultural appropriateness of their responses. The result of this work showed the following; i) A feature-based evaluation model improves the design, modeling and computation of dialogue-based training simulation systems; ii) Output from current automatic speech recognition (ASR) systems gave comparable end results compared with the output from manual transcription; iii) A multi-label classification model trained as a cultural expert gave results which were comparable with scores assigned by human annotators.

Unsupervised Shot Boundary Detection for Temporal Segmentation of Long Capsule Endoscopy Videos

“…These probabilistic models require a good knowledge of the transition structure between the segments and also require careful pre-training to yield a competitive performance. This may not be practicable for online applications where data are acquired online [31], [40]. Parametric approaches model the distribution before and after the change based on maximum likelihood framework [41] while non-parametric methods [42] have been mostly limited to uni-variate data.…”

Graph Convolution Neural Network For Weakly Supervised Abnormality Localization In Long Capsule Endoscopy Videos

“…GCNN extends techniques such as Recursive Neural Networks (RNN) [65], [66] and Markov Chains [67], [68] while leveraging the powerful representation power of neural networks on graph structured data. Traditional deep learning models are well developed for spatial (CNN) [55], [69] and sequential (RNN) data [70] with little contribution on graph structured data. CNNs are used to learn representation on 2D spatial image data while RNNs learns to encode and represent sequential data.…”

“…Meanwhile, many natural interactions between objects can be represented as a graph with the relationship between the objects captured in the edges between the nodes of the graph. Graph Neural Networks (GNN) models are robust and generic enough to also accommodate spatial and sequence data [70], [71] by specifying the nature of the edge and node relationships.…”