Fingertips Interaction Method in Handheld Augmented Reality for 3D Manipulation

Nor’a, Muhammad Nur Affendy; Fadzli, Fazliaty Edora; Ismail, Ajune Wanis; Vicubelab, Zuraifah Syazrah Othman; Aladin, Mohamad Yahya Fekri; Hanif, Wan Ahmad Asyraf Wan

doi:10.1109/iccca49541.2020.9250913

Cited by 8 publications

(8 citation statements)

References 15 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Otherwise, the data transmission can be delayed to obtain real-time hand movement if the network is weak. To accomplish this, a multiplayer networking is enabled in the system, adopted from the study by Nor'a et al [37]. In this study, photon unity networking (PUN) is utilized to enable data transmission between devices where the attached leap motion device is connected to the Laptop (computer) to recognize the hand gesture and send the fingers' position and orientation to the server.…”

Section: Transferring Gesture Data In Handheldmentioning

confidence: 99%

Target selection method on the occluded and distant object in handheld augmented reality

Ismail

Halim²,

Talib³

et al. 2023

IJEECS

View full text Add to dashboard Cite

<span lang="EN-US">Existing interaction techniques within handheld augmented reality (AR) have frequently used touchscreen input (pure two-dimensional (2D) pointing and clicking) from the handheld device's display for target selection on the virtual object. However, performing accurate target selection on a distant target object becomes challenging as the target object will appear smaller when the distance increases. Aside from that, the difficulty increases in performing target selection when another virtual object obscures the distant virtual object. Therefore, this study aims to present a target selection method to perform the target selection. We enable the raycasting technique with real hand gesture for the target selection method on the occluded and distant object in handheld AR. The leap motion device is mounted at the back of the handheld device to track the real hand gesture. The markerless tracking technology of simultaneous localization and mapping (SLAM) is implemented to enable the AR environment. Based on the results, the aim of this study was achieved.</span>

show abstract

Section: Transferring Gesture Data In Handheldmentioning

confidence: 99%

Target selection method on the occluded and distant object in handheld augmented reality

Ismail

Halim²,

Talib³

et al. 2023

IJEECS

View full text Add to dashboard Cite

show abstract

“…A suitable technique for the interaction is critical since they allow a smooth experience while interacting with the virtual object, which is a significant field of AR research. A study by [12] introduce a manipulation method by using fingertip-based to interact with the virtual object in AR application as shown in Fig. 3(b).…”

Section: Related Workmentioning

confidence: 99%

“…Tangible interaction for handheld AR Based on Table 1, recently researchers have been more interested in hand gesture-based metaphor to perform an interaction with the virtual content within the environment. [12] has presented a prototype that allows fingertip manipulation method in handheld AR interface for the user to interact and manipulate the virtual 3D objects. Within this study, the hand gestures were tracked using a sensor tracking device that is being attached to the back of the handheld device.…”

Section: Related Workmentioning

confidence: 99%

“…To accomplish this, we allow multiplayer networking, as illustrated in Fig. 13 adopted from [12]. The data from the tracked and captured hand gestures in real time (position and orientation) by Leap Motion will be transmitted through PUN (Photon Unity Networking) [38] as the network protocol in the handheld AR application.…”

Section: A Enabling Ar Trackingmentioning

confidence: 99%

“…13. Flow of the data send by sender and receive with PUN to client [12] PUN always enables the use of a master server with one or more game servers. The master server is responsible for managing the games that are currently playable as well as for matchmaking.…”

Section: A Enabling Ar Trackingmentioning

confidence: 99%

See 2 more Smart Citations

Designing Ray-Pointing using Real hand and Touch-based in Handheld Augmented Reality for Object Selection

Halim

Ismail

2021

Int J Innov Comp

Self Cite

View full text Add to dashboard Cite

Augmented Reality (AR) have been widely explored worldwide for their potential as a technology that enhances information representation. As technology progresses, smartphones (handheld devices) now have sophisticated processors and cameras for capturing static photographs and video, as well as a variety of sensors for tracking the user's position, orientation, and motion. Hence, this paper would discuss a finger-ray pointing technique in real-time for interaction in handheld AR and comparing the technique with the conventional technique in handheld, touch-screen interaction. The aim of this paper is to explore the ray pointing interaction in handheld AR for 3D object selection. Previous works in handheld AR and also covers Mixed Reality (MR) have been recapped.

show abstract