On the design of a Dual-Mode User Interface for accessing 3D content on the World Wide Web

Abstract

The World Wide Web, today's largest and most important online information infrastructure, does not support 3D content and, although various approaches have been proposed, there is still no clear design methodology for user interfaces that tightly integrate hypertext and interactive 3D graphics. This paper presents a novel strategy for accessing information spaces, where hypertext and 3D graphics data are simultaneously available and interlinked. We introduce a Dual-Mode User Interface that has two modes between which a user can switch anytime: the driven by simple hypertext-based interactions "hypertext mode", where a 3D scene is embedded in hypertext and the more immersive "3D mode", which immerses the hypertextual annotations into the 3D scene. A user study is presented, which characterizes the interface in terms of its efficiency and usability.

IMPART: Big media data processing and analysis for film production

“…Our work extends and goes beyond the dual-mode user interface paradigm of Jankowski and Decker [10], which proposed a tighter integration between traditional web hypermedia and 3D web graphics. We use the multimodal data of the project to create a hybrid visualization, which mixes visualization of 2D images and video with registered 3D data, allowing users to obtain an overview of all the recorded data in a single application.…”

Big Data Analysis for Media Production

“…This is aligned with the current cinema professional practices, which needs to understand the actual content to assess some aspects of quality. This hybrid visualization is inspired by [119], which showed efficiency gains, but our paradigm proposes a much higher stage of integration.…”

“…In parallel, combinations of 3D and other modalities on the web have recently appeared, as exemplified by Jankowski et al [119] [120], who presented an interface combining hypertext and simple 3D graphics and showed that the performance with this so called "dual-mode" interface was better than for single modalities (even taking into account switches). Inspired by this paradigm, the visualisation work presented below goes beyond a simple dual-mode interface, in the sense that it is a truly hybrid interactive visualization, tightly integrating video, static image, hypertext and real-time 3D graphics.…”

“…Web-based 3D applications share many of the advantages common to all web-based technology, namely platform independence, no reliance on 3rd party software, and ease of distribution and maintenance. Using WebGL also allows a seamless integration of 2D and 3D, which facilitates the creation of powerful and innovative interfaces [119], [123], which would be more difficult to create with nonbrowser-based software. However, the difficulties inherent to many client-server based technologies, such as those relating to bandwidth and synchronisation, are particularly present in all web 3D applications, due to the typically large file size of the assets used.…”

Webized 3D experience by HTML5 annotation in 3D web

“…In order to connect the user annotation to 3D objects, Jankowski and Decker [2013] introduced a dual-mode user interface that has different integration level modes (i.e., a hypertext mode and a 3D mode), with the user able to switch anytime between modes. In the hypertext mode, a 3D scene is embedded in hypertext and the user performs simple hypertext-based interactions.…”