Adaptive interactions in shared virtual environments for heterogeneous devices

Abstract

In this research, we propose a method to adapt the interfaces and interaction processes of heterogeneous devices. The proposed method models the interaction capability of the devices. The interaction is modeled by categorizing elementary actions and measuring its effect in semantic behaviors. With this model, an interaction process can be modified to a given device by changing sequence of elementary actions for each behavior. In the pilot test, we showed the possibility of interaction adaptation for different situations. With the proposed adaptation mechanism, interface and interaction can be modeled for the device independently and can be transferred over different interaction environments. Copyright © 2010 John Wiley & Sons, Ltd.KEY WORDS: adaptive interface; interaction adaptation; ubiquitous; service IntroductionModern ubiquitous environments are characterized by heterogeneous sensors, networks, and devices. In the ubiquitous environment, support for a variety of heterogeneous devices is essential, especially with embedded small devices and mobile devices. A multimedia service in ubiquitous environments needs to consider different devices capabilities, such as a mobile device with a small screen, interactive kiosks with higher resolution, media boards with HD-level qualities and desktop computers. A service is a set of multimedia contents that interacts with the user via the device that he/she is using. Each device has a different capability to process content that may be textual, a 2D image and/or 3D virtual worlds. Furthermore, each device has a different capability to interact with the user, with different button sets and metaphors, including touch screens and motion sensors. When a multimedia service is provided to the user, the device should be able to present the contents and should support the interactions to utilize the service. The issue is that presentation quality and content interactions may appear quite different for *Correspondence to: HyungSeok Kim, Department of Internet & Multimedia Engineering, Konkuk University, Seoul, Korea. E-mail: hyuskim@konkuk.ac.kr different devices. For example, in a web navigation service, a web page would be displayed as designed on desktop devices, but it would not be easy to see the contents on mobile devices due to their limited screen resolution. In addition, navigating pages in a mobile device is quite difficult due to limited control and screen resolution. Thus, the content and interaction are required to be adapted to effectively provide multimedia content for heterogeneous devices. So far, various methods have been proposed to adapt video, audio, and 3D animation content for different devices by adjusting the resolution, sampling rate, level of detail, etc.1 In this paper, we propose a method to adapt interfaces and interactions by utilizing device capabilities and user contexts for interactive multimedia services with 2D and 3D content. There have been many approaches to employ user context in multimedia services. For example, LBS (Location-based Services)...

Profile Management System for Adaptive Content of Heterogeneous Devices

“…You can find more detail on adaptive interactions in our previous paper [13]. In that paper, we discussed a method to adapt the interfaces and interaction processes of heterogeneous devices.…”

Providing Context-Based Adaptation in Collaborative Virtual Environments and Video

“…Adaptation of the user interfaces and interactions to the context of used devices, the user's needs and the environment has also been studied in [7].…”