Tangible menus and interaction trays

Ullmer, Brygg; Sankaran, Rajesh; Jandhyala, Srikanth; Tregre, Blake; Toole, Cornelius; Kallakuri, Karun; Laan, Christopher; Hess, Matthew; Harhad, Farid; Wiggins, Urban Terrell

doi:10.1145/1347390.1347436

Cited by 14 publications

(2 citation statements)

References 17 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Les menus complètement physiques sont beaucoup moins courants. Ullmer et al ont proposé le concept de menus tangibles : des liens numériques (comme des commandes "ouvrir" et "sauvegarder") sur des surfaces physiques (papier, bois, plastique) [44].…”

Section: Physicalité Des Menusunclassified

See 1 more Smart Citation

Exploration de la Physicalité des Widgets pour l’Interaction Basée sur des mouvements de la Tête le Cas des Menus en Réalité Mixte

Bailly

Leitner

Nigay

2021

32e Conférence Francophone Sur l'Interaction Homme-Machine

View full text Add to dashboard Cite

Mixed Reality with a Head-Mounted Display (HMD) offers unique perspectives for head-based interaction with virtual content and widgets. Besides virtual widgets, physical objects can be anchors (mixed widgets) or directly materialised widgets (physical widgets). The physicality (virtual-mixed-physical) of widgets defines a new dimension for Mixed Reality (MR) interaction that extends existing taxonomies of widgets in MR. As a first step to explore this new dimension, we focus on a commonly used widget: a menu. We thus evaluate the performance and usability of head pointing to a virtual, a mixed and a physical menu. Results suggest that pointing to a physical menu was on average 2s faster than pointing to a mixed or a virtual menu and preferred by participants. Virtual and mixed menus led to similar performances, but 11 participants over 15 preferred mixed menus over virtual ones. Based on our findings, we provide recommendations (benefits/limitations) for virtual, mixed and physical menus in MR. CCS CONCEPTS• Human-centered computing → Mixed / augmented reality; Pointing.

show abstract

Section: Physicalité Des Menusunclassified

“…dans la RA tangible [7], des widgets mixtes tels que des menus mixtes [31,45] sont physiquement manipulés par les utilisateurs. De plus certains widgets peuvent être purement physiques, comme le menu tangible proposé par Ullmer et al [44]. Ces approches impliquant des widgets mixtes ou physiques se concentrent sur l'interaction tangible en entrée.…”

Section: Introductionunclassified

Exploration de la Physicalité des Widgets pour l’Interaction Basée sur des mouvements de la Tête le Cas des Menus en Réalité Mixte

Bailly

Leitner

Nigay

2021

32e Conférence Francophone Sur l'Interaction Homme-Machine

View full text Add to dashboard Cite

show abstract

Head-Controlled Menu in Mixed Reality with a HMD

Bailly

Leitner

Nigay

2019

Human-Computer Interaction – INTERACT 2019

View full text Add to dashboard Cite

We present a design-space and three new techniques for headbased interaction with menus in Mixed Reality (MR) with a Head-Mounted Display (HMD). Usual input modalities such as hand gestures and voice commands are not suitable in noisy MR contexts where the users have both hands occupied as in augmented surgery and machine maintenance. To address the two issues of noisy MR contexts and hand-free interaction, we systematically explore the design space of headcontrolled menu interaction by considering two design factors: 1) headcontrolled menu versus head-controlled cursor 2) virtual targets versus mixed targets anchored on physical objects. Based on the design space, we present three novel menu techniques that we compared with a baseline head-controlled cursor technique. Experimental results suggest that head-controlled menu and head-controlled cursor techniques offer similar performance. In addition, the study found that mixed targets do not impact ultimate user performance when users are trained enough, but improve the learning phase. When using virtual targets, users still progressed after the training phase by reducing their mean selection time by 0.84s. When using mixed targets, the improvement was limited to 0.3s.

show abstract