GIFT: Gesture-Based Interaction by Fingers Tracking, an Interaction Technique for Virtual Environment

Raees, Muhammad; Ullah, Sadiq

doi:10.9781/ijimai.2019.01.002

Cited by 9 publications

(4 citation statements)

References 27 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Both one-way interaction mode 34 and multi-modal interaction methods 35 are commonly used to interact with virtual objects. Additionally, eye gaze interaction, [36][37][38] gesture interaction, 39,40 speech input interaction, 41,42 sensor-based interaction, 43,44 and physiological signal interaction 45,46 are used to interact with virtual objects. However, it is necessary to interact with physical objects in a VRF system.…”

Section: Interaction Methods In Mr Environmentsmentioning

confidence: 99%

Synchronous mixed reality (SMR): A personalized virtual‐real fusion framework with high immersion and effective interaction

Guo,

Ma,

Weng

2023

J Soc Info Display

View full text Add to dashboard Cite

Virtual‐real fusion (VRF) technology plays a crucial role in the meta‐universe by bridging the gap between virtual environments (VEs) and physical environments (PEs). However, the current VRF system has the problem of single function and fixed integration, limiting the popularization and application of VRF technology. Therefore, this paper proposes a framework named synchronous mixed reality (SMR) to personalize the VRF system and maintain the balance between interaction efficiency and environmental immersion. We combine an instance segmentation algorithm with an interaction prediction algorithm to achieve this balance. To evaluate the effectiveness of the SMR framework, we design three scenarios based on the interaction properties of physical objects and measure environmental immersion, systematic interaction efficiency, and user experience. Our results demonstrate that the SMR framework meets diverse needs in various PEs while balancing immersion and interaction efficiency. Additionally, our framework significantly reduces collisions and negative emotions experienced by users in VEs. We anticipate that this framework will serve as a guide for constructing virtual‐real fusion systems in the future.

show abstract

Section: Interaction Methods In Mr Environmentsmentioning

confidence: 99%

Synchronous mixed reality (SMR): A personalized virtual‐real fusion framework with high immersion and effective interaction

Guo,

Ma,

Weng

2023

J Soc Info Display

View full text Add to dashboard Cite

show abstract

“…Raees and Ullah [57] used the fingertips-based interaction system for VEs using an RGB camera. They used colored tips made gestures and performed different interaction tasks.…”

Section: Related Workmentioning

confidence: 99%

Fingertip Gestures Recognition Using Leap Motion and Camera for Interaction with Virtual Environment

et al. 2020

View full text Add to dashboard Cite

The emergence in computing and the latest hardware technologies realized the use of natural interaction with computers. Gesture-based interaction is one of the prominent fields of natural interactions. The recognition and application of hand gestures in virtual environments (VEs) need extensive calculations due to the complexities involved, which directly affect the performance and realism of interaction. In this paper, we propose a new interaction technique that uses single fingertip-based gestures for interaction with VEs. The objective of the study is to minimize the computational cost, increase performance, and improve usability. The interaction involves navigation, selection, translation, and release of objects. For this purpose, we propose a low-cost camera-based system that uses a colored fingertip for the fastest and accurate recognition of gestures. We also implemented the proposed interaction technique using the Leap Motion controller. We present a comparative analysis of the proposed system with the Leap Motion controller for gesture recognition and operation. A VE was developed for experimental purposes. Moreover, we conducted a comprehensive analysis of two different recognition setups including video camera and the Leap Motion sensor. The key parameters for analysis were task accuracy, interaction volume, update rate, and spatial distortion of accuracy. We used the Standard Usability Scale (SUS) for system usability analysis. The experiments revealed that camera implementation was found with good performance, less spatial distortion of accuracy, and large interaction volume as compared to the Leap Motion sensor. We also found the proposed interaction technique highly usable in terms of user satisfaction, user-friendliness, learning, and consistency.

show abstract

“…The proposed technique is implemented via a VE for experimental purposes. In paper [8], presented an interaction technique where manipulation is performed by the perceptive gestures of the two dominant fingers: thumb and index. In paper [9], a low-cost exoskeleton for the elbow that is connected to a context-aware architecture is presented.…”

Section: Introductionmentioning

confidence: 99%

Tele-operation of an industrial robot by an arm exoskeleton for peg-in-hole operation using immersive environments

et al. 2021

View full text Add to dashboard Cite

The design and development of an upper limb exoskeleton are being discussed for the tele-operation in order to control the KUKA KR5 industrial robot. When sufficient resolution is not provided by the visual feedback, feedback of haptic provides a qualitative understanding of changes in the remote conditions. This also provides tactile feedback from the virtual and real environment. Peg in a hole operation using exoskeleton works as the master for tele-operation in order to control the robot using immersive environment as visual feedback for the operator. The application of this work can be implemented as a nuclear power generation plant.

show abstract

GIFT: Gesture-Based Interaction by Fingers Tracking, an Interaction Technique for Virtual Environment

Cited by 9 publications

References 27 publications

Synchronous mixed reality (SMR): A personalized virtual‐real fusion framework with high immersion and effective interaction

Synchronous mixed reality (SMR): A personalized virtual‐real fusion framework with high immersion and effective interaction

Fingertip Gestures Recognition Using Leap Motion and Camera for Interaction with Virtual Environment

Tele-operation of an industrial robot by an arm exoskeleton for peg-in-hole operation using immersive environments

Contact Info

Product

Resources

About