Changing perception of physical properties using multimodal augmented reality

Lugtenberg, Geert; Sandor, Christian; Hürst, Wolfgang; Plopski, Alexander; Taketomi, Takafumi; Kato, Hirokazu

doi:10.1145/3001959.3001968

Cited by 3 publications

(1 citation statement)

References 9 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In particular, a dot pattern projected on one's hand is used to manipulate the perception of resistive force when touching something. Lugtenberg et al [4] present a position paper aiming at changes of physical property perception, such as object density, using the modality of sound.…”

Section: Research Domains Categories and Future Challengesmentioning

confidence: 99%

International workshop on multimodal virtual and augmented reality (workshop summary)

Hürst

Iwai

Balakrishnan³

2016

Proceedings of the 18th ACM International Conference on Multimodal Interaction

Self Cite

View full text Add to dashboard Cite

Virtual reality (VR) and augmented reality (AR) are expected by many to become the next wave of computing with significant impacts on our daily lives. Motivated by this, we organized a workshop on "Multimodal Virtual and Augmented Reality (MVAR)" at the 18 th ACM International Conference on Multimodal Interaction (ICMI 2016). While current VR and AR installations mostly focus on the visual domain, we expect multimodality to play a crucial role in future, next generation VR/AR systems. The submissions for this workshop reflect the potential of multimodality for VR and AR, illustrate interesting new directions, and pinpoint important issues. This paper gives a short motivation for the workshop and its aim, and summarizes the aforementioned trends and challenges identified from the submissions. CCS Concepts• Human-centered computing~Mixed / augmented reality KeywordsMultimodal virtual reality; multimodal mixed reality; multimodal augmented reality. MOVTIVATIONVirtual reality (VR) and augmented reality (AR) are currently two of the "hottest" topics in the IT industries. Many consider them to be the next wave in computing with a similar impact as the shift from desktop systems to mobiles and wearables. The related hype is rooted in technological improvements (such as mass-produced high-resolution mobile displays), which resulted in cheaper, highperformant devices ready for the common consumer market. Examples include Facebook's Oculus Rift and Microsoft's HoloLens for VR and AR scenarios, respectively.Despite this progress, we are still far from the ultimate goal of creating new virtual environments or augmentations of existing ones that feel and react similarly as their real counterparts. Many challenges and open research questions remain -mostly in the areas of multimodality and interaction. For example, current setups predominantly focus on visual and auditory senses, neglecting other modalities such as touch and smell that are an integral part of how we experience the real world around us. Likewise, it is still an open question how to best interact and communicate with a virtual world or virtual objects in AR. Multimodal interaction offers great potential to not only make this experience more realistic, but also to provide more powerful and efficient means of interacting with virtual and augmented worlds.In order to address related questions and to identify current trends and future challenges, we organized a workshop on "Multimodal Virtual and Augmented Reality (MVAR)" at the 18 th ACM International Conference on Multimodal Interaction (ICMI 2016). The aim of this workshop was to investigate any aspects about multimodality and multimodal interaction in relation to VR and AR. What are the most pressing research questions? What are the challenges? What opportunities do other modalities than vision offer for VR and AR? What are new and better ways for interaction with virtual objects and for an improved experience of VR and AR worlds? We invited researchers, practitioners, and visionaries to contribute thei...

show abstract

Section: Research Domains Categories and Future Challengesmentioning

confidence: 99%