Ongoing Challenges of Evaluating Mulsemedia QoE

Abstract

Multimedia applications are usually limited to stimulating only two human senses: vision and hearing. Recent studies seek to expand the definition of multimedia applications to include stimuli for other human senses. In this way, sensory effects that should be triggered in synchrony with the audiovisual content being presented are included in the applications. By including sensory effects in multimedia, we aim to improve the Quality of Experience (QoE) with these mulsemedia environments. Usually, two approaches are being used for performing QoE evaluations these environments. The first, more common, is performed by subjective evaluation approaches, i.e. through questionnaires, interrogations, oral responses, etc. The second, rarer but growing, uses objective approaches by collecting physiological data from the user when dealing with the system being evaluated. Such data is gathered in real time or not, however, it is considered objective because it is "involuntary", that is, data is not the result of the user’s intention. This paper will address both the these methods to evaluate QoE and what the respective obstacles are when dealing with in mulsemedia systems.

Mulsemedia communication research challenges for metaverse in 6G wireless systems

“…QoE measures the degree of delight or annoyance of users. It can be obtained by using subjective measures, where users rate their experience after using the service or application, and objective measures, where physiological signals such as accelerometers, video recordings, and biosignals are used to evaluate users' biofeedback and responses [10], [79]. A model of QoE is essential to design optimal mulsemedia communication systems.…”

Technology Enhanced Mulsemedia Learning (TEML) for Learners with Dyslexia

“…The assessment included questions about learning content, questions about specific elements such as olfactory, airflow, vibration and QoE questions to evaluate the mulsemedia experience. Here, Open-ended questions allow participants to provide detailed and personalized responses, while Likert scale questions can provide quantitative data that can be analyzed statistically [4,19]. Participants fill out the questionnaire after watching the learning with mulsemedia effects.…”

“…These subjective measures of quality of experience are important to consider alongside the objective measures of cognitive and emotional response recorded in the Technology-enhanced Mulsemedia learning (TEML) Web portal [4]. It provides a holistic understanding of the listener's experience with the TEML web portal and suggests that multisensorial elements can contribute to a positive listening experience.…”

“…STEM education gives special attention to practical training that facilitates a deep understanding of design procedures, practical limitations, and engineering trade-offs. Due to technological development, different kinds of technology are involved in engineering education such as multisensory virtual and augmented reality and game-based learning [3,4]. Designing mulsemedia content includes the real-time environment experience when reading e-content.…”

Wireless communication research challenges for Extended Reality (XR)

“…QoE measures the degree of delight or annoyance of users. It can be obtained by using subjective measures, where users rate their experience after using the service or application, and objective measures, where physiological signals such as accelerometers, video recordings, and biosignals are used to evaluate users' biofeedback and responses [10], [75]. A model of QoE is essential to design optimal mulsemedia communications systems.…”