MulseBox: Portable Multisensory Interactive Device

PRIM Project: Playing and Recording with Interactivity and Multisensoriality

“…Therefore, as it seems to increase human efficiency [10] and improve learning processes [5], the use of multisensory interaction appears as a promising research field [4]. And we can hypothesize that adding sensory modalities to technological systems may improve Human-Technology Interaction (term given by Dix [1]).…”

“…A Human-Computer Interaction is considered as multisensory if it stimulates at least three of the user's senses through sensory effects such as wind (via fan), water (via sprayer), light (via lamp), vibrations (via haptic vest), body motion (via a movable seat), in isolation or in combination [3]. Designing these sensory effects (what, when, why and how) means designing the user's environment and perception, that has the potential to improve the user's Quality of Experience (QoE) [4], which is the current main goal in the Human-Computer Interaction field [1]. But to reach the goal of well designing M.I., there are many challenges to face.…”

Using Multisensory Technologies to Stimulate People: a Reflexive Paper on Scenagrams

“…For example, if PlaySEM could be able to send perceptions during the movie playback, these perceptions could be used by algorithms designed with AmbiProg, which would allow to take humans actions into account during the mulsemedia. The second approach was investigated in the StimSense project [6] where we developed MulseBox, a portable multisensory interactive device (see Figure 2). It is limited in terms of perceptions and actions.…”

“…With time, we understood that multisensory interaction had the potential to reproduce real-life, allowing creating an infinity of activities in controlled ecology. In our literature review [6], we draw up a list of at least 8 disciplines currently investigating multisensory interaction and at least 18 possibles application scopes: cinema, telecommunication, education, telemedicine, health, commerce, advertising/marketing, gaming/entertainment, multimedia, art, storytelling, museum, attractions, theater, product design, virtual reality, music, and home. We can also add driving [20].…”

“…Permission to reproduce or distribute this work, in part or in whole, verbatim, adapted, or remixed, is granted without fee, provided that the appropriate credits are given to the original work, not implying any endorsement by the authors or by SBC. 2021 Brazilian Computing Society really good user experiences thanks to technological multisensory interaction, but also some really bad experiences [6]. And more and more researchers from different disciplines are currently focusing on two main issues.…”