The role of digital interactive technology in cultural heritage learning: Evaluating a mid‐air gesture‐based interactive media of Ruihetu

Abstract

In this study, we investigate the role of mid-air gesture-based interaction technologies in cultural heritage learning. In an experiment, a mid-air gesture-based interactive media for Chinese Song Dynasty traditional painting-Ruihetu was developed and validated. Participants tested three experimental conditions: video learning only; interactive experience first, then video learning; and video learning first, then interactive experience. According to the research results, the outcomes of participants' learning of this cultural heritage differed significantly across all three experimental conditions. This study's findings offer insights into cultural learning of Chinese traditional painting in museums using mid-air gesture-based technology, specifically that video learning exhibits should be combined with and preceded by multimedia interactive exhibits for improved memory and understanding.

A non‐verbal teaching behaviour analysis for improving pointing out gestures: The case of asynchronous video lecture analysis using deep learning

“…Recent advancements in the field include the development of deep learning models for recognizing teaching gestures in both online and offline settings (Gu et al, 2020; Wang et al, 2020). There are also emerging efforts to create automated gesture recognition technologies tailored for online teaching platforms (Liu et al, 2023). These developments hold promise for significantly aiding the training of both PTs and ITs in the foreseeable future.…”

“…As a result, the I‐frame is the most suitable frame for accurately tracing changes in body posture and identifying gestures. Prior studies have employed I‐frames as the baseline for human pose detection (Fan et al, 2021; Liu et al, 2023).…”

The “rebirth” of traditional musical instrument: An interactive installation based on augmented reality and somatosensory technology to empower the exhibition of chimes

“…Jin et al 17 examined the UX, learning outcomes of young adults using an VR environment to gain a cultural–historical understanding of the traditional paintings. Li et al 23 investigate the role of mid‐air gesture‐based interaction technologies in cultural heritage learning. Liu 24 presents a mixed‐methods study to evaluate users' expectations, acceptance of digital technologies such as VR and AR at cultural heritage sites in Taiwan.…”

Using scaffolding theory in serious games to enhance traditional Chinese murals culture learning

“…Among the content of heritage education, researchers have focused more on site-based heritage, pattern-based heritage, and text-based heritage, such as ancient books, ancient paintings, and architectural heritage. [4][5][6][7] Although the study of traditional painting has always been of interest to researchers, little attention has been paid to the traditional murals in traditional painting. The patterns and graphics contained in traditional murals have historical information and educational significance for contemporary society that cannot be ignored.…”

“…Among the forms of heritage education, more researchers in recent years have used digital technology tools to study or present traditional culture, such as VR, games, and digital interactive technologies. [4][5][6][7]10,11 A digital format will provide a better experience compared to the traditional format. 5,[10][11][12][13] Games are an important form of expression in the digital format.…”