Dynamic Decals

Abstract

Pervasive interfaces can present relevant information anywhere in our environment, and they are thus challenged by the non rectilinearity of the display surface (e.g. circular table) and by the presence of objects that can partially occlude the interface (e.g. a book or cup on the table). To tackle this problem, we propose a novel solution based on two core contributions: the decomposition of the interface into deformable graphical units, called Dynamic Decals, and the control of their position and behaviour by a constraint-based approach. Our approach dynamically deforms the interface when needed while minimizing the impact on its visibility and layout properties. To do so, we extend previous work on implicit deformations to propose and experimentally validate functions defining different decal shapes and new deformers modeling decal deformations when they collide. Then, we interactively optimize the decal placements according to the interface geometry and their interrelations. Relations are modeled as constraints and the interface evolution results from an easy and efficient to solve minimization problem. Our approach is validated by a user study showing that, compared to two baselines, Dynamic decals is an aesthetically pleasant interface that preserves visibility, layout and aesthetic properties.

A toolkit for automatically generating and modifying VR hierarchy tile menus

“…As presented in Table 2, previous toolkits primarily focused on auto‐generating menus or interfaces in virtual environments, lacking support for packing nonrectangular UI elements in nonrectangular display spaces 7,12,13,35,36,39 . While some works addressed packing rectangles in nonrectangular space, they were either geometric algorithms 15,16 or interfaces without user input and realignment of layout 17 . The development of hierarchical menus with nonrectangular‐shaped buttons in nonrectangular display spaces using the Unity engine is complex and time‐consuming.…”

“…Riemann et al 32 utilized environmental constraints, such as projection quality, proximity to the desired location, orientation, and scale, to project content on and around tangible objects. 17 decomposed the interface into deformable graphical units and controlled their positions and behaviors using a constraint-based approach to pack nonrectangular UI elements in a nonrectangular display space, even in scenarios where objects can partially occlude the interface. However, none of the existing approaches have addressed the challenge of readjusting nonrectangular UI elements in a freeform display space.…”

“…7,12,13,35,36,39 While some works addressed packing rectangles in nonrectangular space, they were either geometric algorithms 15,16 or interfaces without user input and realignment of layout. 17 The development of hierarchical menus with nonrectangular-shaped buttons in nonrectangular display spaces using the Unity engine is complex and time-consuming. To our knowledge, no prior has effectively addressed both the challenge of automatically generating hierarchical menus with nonrectangular shaped buttons and supporting users in interactively readjusting the tiles (e.g., location, size, shape) and flexibly designing various layouts by combining tiles according to their preferences or needs.…”

“…The number of displayed items is a crucial aspect of virtual graphics menus. In VR/AR environments, although there is more available space to display menu items compared to traditional desktop computers, overcrowding the interface with too many items can reduce the efficiency of menu navigation and selection operations, 17 particularly in applications with numerous menu items.…”

“…In contrast, several approaches have been proposed to pack rectangular UI elements in a freeform display space. Riemann et al 32 utilized environmental constraints, such as projection quality, proximity to the desired location, orientation, and scale, to project content on and around tangible objects 17 . decomposed the interface into deformable graphical units and controlled their positions and behaviors using a constraint‐based approach to pack nonrectangular UI elements in a nonrectangular display space, even in scenarios where objects can partially occlude the interface.…”