A generalized God-object method for plausible finger-based interactions in virtual environments

Jacobs, Jan W. M.; Stengel, Michael; Froehlich, Bernd

doi:10.1109/3dui.2012.6184183

Cited by 29 publications

(27 citation statements)

References 23 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…An early solution providing more natural interfaces involved the use of multimodal interactions, combining depictive gestures with speech [15,17,16]. We are more interested in the case of DM, i.e., interacting with the environment in a natural manner with the users hands [19,26,14,10].…”

Section: Previous Workmentioning

confidence: 99%

“…was performed. More recent work has concentrated on developing appropriate soft models [13] and efficient solvers to avoid interpenetration of God objects and other objects in the scene [14], mainly in the context of automotive project review. The latter uses a setup similar to ours, with the same finger tracking system; however a three-sided display system is used, with the floor projection from above.…”

Section: Previous Workmentioning

confidence: 99%

“…As a result, objects tend to bounce between the fingers instead of being grasped, and the contacts are unstable. Many recent solutions improve physics simulation, most notably to avoid inter-penetration of the hand and other objects in the scene (e.g., [14,22]), while other approaches [25,12] avoid the need for complex -and often expensive -precise simulation using specific algorithms. In contrast, we use a fast but simple physics simulation, combining it with an approach for basic DM such as grasping and releasing, and a finite-state machine to handle sequences of manipulations (e.g., moving from one-hand to two-hand grasping etc.…”

Section: A Heuristic Approach For Direct Manipulation With Physicsmentioning

confidence: 99%

“…In such a context, these devices can potentially degrade the realism and naturalness of the virtual environment (VE). To avoid this shortcoming, we investigate the use of direct manipulation (DM) using finger tracking as close as possible to the manipulation used in the real world [19,26,14,10].…”

Section: Introductionmentioning

confidence: 99%

“…With the advent of hand and finger tracking solutions, there has been recent interest in using DM and gestures in immersive systems to achieve specific tasks, such as automotive design [14,19], focusing on carefully handling the physics of collisions between hands and virtual objects in specific tasks. However, little has been done to investigate the usability of DM in a fully immersive setting for relatively complex, general-purpose tasks.…”

Section: Introductionmentioning

confidence: 99%

See 4 more Smart Citations

Evaluation of direct manipulation using finger tracking for complex tasks in an immersive cube

et al. 2014

View full text Add to dashboard Cite

Abstract:We present a solution for interaction using finger tracking in a cubic immersive virtual reality system (or immersive cube). Rather than using a traditional wand device, users can manipulate objects with fingers of both hands in a close-to-natural manner for moderately complex, general purpose tasks. Our solution couples finger tracking with a real-time physics engine, combined with a heuristic approach for hand manipulation, which is robust to tracker noise and simulation instabilities. We performed an exploratory study to evaluate our interface, with tasks involving complex manipulations, such as balancing objects while walking in the cube. The user's finger-tracked manipulation was compared to manipulation with a 6-DOF wand (or flystick), as well as with carrying out the same task in the real world. Users were also asked to perform a free task, allowing us to observe their perceived level of presence in the scene. Our results show that our approach provides a feasible interface for immersive cube environments and is perceived by users as being closer to the real experience compared to the wand. However, the wand outperforms direct manipulation in terms of speed and precision. We conclude with a discussion of the results and implications for further research. This project has been submitted to Virtual Reality journal in March 2013. Évaluation de la manipulation directe par finger tracking pour des tâches complexes dans un cube immersif Résumé :Nous présentons une solution permettant d'interagir dans un système de réalité virtuelle de type cube immersif grâce au tracking des doigts. Plutôt que d'utiliser une manette traditionnelle, les utilisateurs peuvent manipuler les objets avec les doigts de façon quasi naturelle et ce pour des tâches générales modérément complexes. Notre solution associe le finger tracking à un moteur physique temps réel, ceci combiné à une approche heuristique de la manipulation manuelle qui est robuste aux signaux bruités des trackers et aux instabilités de simulation. Nous avons effectué une étude exploratoire afin d'évaluer notre interface. Elle comporte des tâches impliquant des manipulations complexes telles que tenir des objets en équilibre en même temps que l'on marche dans le cube. La manipulation avec finger tracking a été comparée à la manipulation avec une manette à 6 degrés de liberté, ainsi qu'à l'exécution de la tâche en condition réelle. Les utilisateurs ont également dû effectuer une tâche avec quasiment aucune instruction afin que nous puissions évaluer leur sensation de présence dans la scène. Nos résultats montrent que notre approche fournit une interface appropriée pour les cubes immersifs tout en étant perçue par les utilisateurs comme plus proche de l'expérience réelle qu'avec la manette. Cependant, la manette dépasse les capacités de la manipulation directe en termes de rapidité et de précision. Nous concluons par une discussion des résultats et des implications pour les prochains travaux de recherche. Ce projet a été soumis au journal Virtual Reality en ma...

show abstract

Section: Previous Workmentioning

confidence: 99%

Section: Previous Workmentioning

confidence: 99%

Section: A Heuristic Approach For Direct Manipulation With Physicsmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

See 3 more Smart Citations

Evaluation of direct manipulation using finger tracking for complex tasks in an immersive cube

et al. 2014

View full text Add to dashboard Cite

show abstract

Comparative evaluation of WIMP and immersive natural finger interaction: a user study on CAD assembly modeling

2021

View full text Add to dashboard Cite

Virtual and augmented reality allows the utilization of natural user interfaces, such as realistic finger interaction, even for purposes that were previously dominated by the WIMP paradigm. This new form of interaction is particularly suitable for applications involving manipulation tasks in 3D space, such as CAD assembly modeling. The objective of this paper is to evaluate the suitability of natural interaction for CAD assembly modeling in virtual reality. An advantage of the natural interaction compared to the conventional operation by computer mouse would indicate development potential for user interfaces of current CAD applications. Our approach bases on two main elements. Firstly, a novel natural user interface for realistic finger interaction enables the user to interact with virtual objects similar to physical ones. Secondly, an algorithm automatically detects constraints between CAD components based solely on their geometry and spatial location. In order to prove the usability of the natural CAD assembly modeling approach in comparison with the assembly procedure in current WIMP operated CAD software, we present a comparative user study. Results show that the VR method including natural finger interaction significantly outperforms the desktop-based CAD application in terms of efficiency and ease of use.

show abstract

Enhancing hand-object interactions in virtual reality for precision manual tasks

Mangalam,

Oruganti,

Buckingham

et al. 2024

Virtual Reality

View full text Add to dashboard Cite

A generalized God-object method for plausible finger-based interactions in virtual environments

Cited by 29 publications

References 23 publications

Evaluation of direct manipulation using finger tracking for complex tasks in an immersive cube

Evaluation of direct manipulation using finger tracking for complex tasks in an immersive cube

Comparative evaluation of WIMP and immersive natural finger interaction: a user study on CAD assembly modeling

Enhancing hand-object interactions in virtual reality for precision manual tasks

Contact Info

Product

Resources

About