Multimodal Media Center Interface Based on Speech, Gestures and Haptic Feedback

Turunen, Markku; Hakulinen, Jaakko; Hella, Juho; Rajaniemi, Juha-Pekka; Melto, Aleksi; Mäkinen, Erkki; Rantala, Jussi; Heimonen, Tomi; Laivo, Tuuli; Soronen, Hannu; Hansen, Mervi; Valkama, Pellervo; Miettinen, Toni; Raisamo, Roope

doi:10.1007/978-3-642-03658-3_9

Cited by 4 publications

(3 citation statements)

References 5 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Thus, in addition to more general user experience aspects the questionnaire inquired about immersion and the appeal of the system in the context of a (automobile) museum. The questionnaire design was based on our earlier user experience evaluations and questionnaire development [e.g., 15,35], including our earlier museum installation evaluations [34]. The questionnaire includes ten statements with a five-step rating scale on the range of Totally disagree -Neither agree or disagree -Totally agree.…”

Section: Discussionmentioning

confidence: 99%

Omnidirectional Video in Museums – Authentic, Immersive and Entertaining

Hakulinen

Keskinen

Mäkelä

et al. 2018

Advances in Computer Entertainment Technology

Self Cite

View full text Add to dashboard Cite

Omnidirectional video (ODV) provides possibilities for capture and presentation of cultural content for museums and other exhibitions. 360° video capture can record authentic environments and activities, and enables immersive viewing of such material. We present the potential of ODV by reporting the learnings from long-term user experience data collection with two ODV-based museum installations; a head mounted display (HMD) based rally simulator, and a road grader simulator utilizing three projectors and haptic feedback. The results show the value of immersion, provide insights into the possibilities and challenges of interactivity, and show, how haptic feedback can improve the overall experience. The results also provide support to the use of physical elements in museum installations. In addition, we managed to avoid cyber sickness, a common problem with immersive VR content, in the installations. Overall, the respondents strongly support the conception that these kinds of installations would make museums more desirable places to visit.

show abstract

Section: Discussionmentioning

confidence: 99%

Omnidirectional Video in Museums – Authentic, Immersive and Entertaining

Hakulinen

Keskinen

Mäkelä

et al. 2018

Advances in Computer Entertainment Technology

Self Cite

View full text Add to dashboard Cite

show abstract

“…To further increase their perceived usefulness, media centers have extended their interaction modalities beyond the traditional remote controller, by integrating speech, touch, and gestures. These multimodal facilities have widened the user base of media centers [45] by permitting users with disabilities to interact with their advanced features beyond simple TV content consumption using their preferred interaction modality [46]. Besides multimodal interaction, multimedia content is also tailored to the preferences of each user to address the continuously growing number of data sources that hinder manual discovery and selection (i.e., recommendation systems [47] of highly-rated internet sites such as Amazon, YouTube, Netflix).…”

Section: Related Workmentioning

confidence: 99%

Ambient Intelligence in the Living Room

Leonidis

Korozi

Kouroumalis

et al. 2019

Sensors

View full text Add to dashboard Cite

The emergence of the Ambient Intelligence (AmI) paradigm and the proliferation of Internet of Things (IoT) devices and services unveiled new potentials for the domain of domestic living, where the line between “the computer” and the (intelligent) environment becomes altogether invisible. Particularly, the residents of a house can use the living room not only as a traditional social and individual space where many activities take place, but also as a smart ecosystem that (a) enhances leisure activities by providing a rich suite of entertainment applications, (b) implements a home control middleware, (c) acts as an intervention host that is able to display appropriate content when the users need help or support, (d) behaves as an intelligent agent that communicates with the users in a natural manner and assists them throughout their daily activities, (e) presents a notification hub that provides personalized alerts according to contextual information, and (f) becomes an intermediary communication center for the family. This paper (i) describes how the “Intelligent Living Room” realizes these newly emerged roles, (ii) presents the process that was followed in order to design the living room environment, (iii) introduces the hardware and software facilities that were developed in order to improve quality of life, and (iv) reports the findings of various evaluation experiments conducted to assess the overall User Experience (UX).

show abstract

“…This demonstration shows how speech, gestures, and haptic feedback can provide an efficient and accessible interface for a media center for different user groups (regular users, blind users, visually impaired users, and physically impaired users). The media center application [1] is based on a low-cost PC (Athlon X2 3800) running the media center server software, a mobile device (Nokia N95) for interacting with the user and running the client software, a wireless access point to connect these together, and a high-definition 40" digital television displaying the user interface. The server software implements the media center application functionality and includes speech recognition and speech synthesis.…”

Section: Media Center Application and Its Multimodal Interfacementioning

confidence: 99%