Mid-air interaction with optical tracking for 3D modeling

Cui, Jian; Sourin, Alexei

doi:10.1016/j.cag.2018.04.004

Cited by 17 publications

(6 citation statements)

References 43 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…We compare our method with three other similar studies. Cui and Sourin (2018) used the left hand to start and stop the deformation process and the right hand to specify the amount of deformation. By closing the left hand, the deformation process starts and the pointer on the desktop moves by moving the right hand.…”

Section: Comparison With the Other Methodsmentioning

confidence: 99%

“…All the deformations have been applied globally and symmetrically. Cui and Sourin (2018) studied the occlusion problem of the LMC and proposed to partition the desktop screen into two parts without considering the viewing angle of the LMC. To evaluate this system 29 participants completed a series of tasks.…”

Section: Comparison With the Other Methodsmentioning

confidence: 99%

“…In their work, three patterns are defined to create concave and flat features, including pulling, pushing, and smoothing. Cui and Sourin (2018) used hand gestures to move the mouse pointer over the desktop. In their work, the area of the deformation and its type must be determined by the mouse before starting to interact with hand.…”

Section: Object Deformation By Hand Gesturesmentioning

confidence: 99%

See 2 more Smart Citations

Object manipulation and deformation using hand gestures

Mahdikhanlou

Ebrahimnezhad

2021

J Ambient Intell Human Comput

View full text Add to dashboard Cite

Compared to the mouse, as a two-dimensional and precise interface device, hand gestures provide more degrees of freedom for users to interact with computers by employing intelligent computing methods. Leap Motion Controller is gaining more popularity due to its ability to detect and track hand joints in three dimensions. However, in some cases, the Leap Motion Controller measurements are not correct enough. We show that the occlusion, palm angle, and the limited field of view are the main downsides of the Leap Motion Controller. In this paper, a framework is proposed to manipulate and deform a three-dimensional object by hand gestures. We select only a few gestures so that the system instructions can be easily memorized. The gestures are not defined very strictly, so users can do them properly without getting tired. We propose that calculating a reliable space from a Leap Motion Controller can significantly reduce these problems. To deform objects, the Free Form Deformation technique is used, which allows for more local deformation. The selected gestures and determined space for interaction make the deformation framework achieve a balance between the accuracy, user-factors, required tasks for deformation, and limitation of the hand tracking device. The proposed method, compared to related studies, offers more creative methods for deforming objects and more natural movements to interact with the system. According to the conducted user study, a significant difference is observed between hand gesture interaction and mouse in terms of speed and number of attempts.

show abstract

Section: Comparison With the Other Methodsmentioning

confidence: 99%

Section: Comparison With the Other Methodsmentioning

confidence: 99%

Section: Object Deformation By Hand Gesturesmentioning

confidence: 99%

See 1 more Smart Citation

Object manipulation and deformation using hand gestures

Mahdikhanlou

Ebrahimnezhad

2021

J Ambient Intell Human Comput

View full text Add to dashboard Cite

show abstract

“…The freehand-gesture technique is a direct mapping of the user's hand motions in the physical world to the affected motions in a computer system. With the rapid development of computer vision techniques, sensor technologies, and human-computer interaction techniques, freehand gestures have been applied in many VR applications for tasks such as object manipulation [12][13][14][15][16][17], navigation [18][19][20], and system control [21,22]. 1 https ://invrs ion.com/shelf zone 2 https ://vr.ebay.com.au.…”

Section: Gestural Interaction In Vr Shopping Applicationsmentioning

confidence: 99%

Understanding freehand gestures: a study of freehand gestural interaction for immersive VR shopping applications

Luo

Pan

et al. 2019

Hum. Cent. Comput. Inf. Sci.

View full text Add to dashboard Cite

Compared to brick-and-mortar retail stores, online shopping has many advantages, such as unrestricted shopping hours as well as a greater focus on functionality and more efficient information retrieval. However, the current online shopping systems only present products using text and images, and they cannot provide end-users with an immersive shopping experience [1-4]. For end-users, the product representations in the form of images and text in scrollable lists are difficult to understand, i.e., end-users cannot obtain a clear sense of the size, weight, and shape of the product. In addition, the unnatural interaction techniques, such as scrolling a list or navigating through product

show abstract

“…In [27], a feasibility study on using Leap Motion for shape modeling in VRML/X3D environments was introduced. In [28], a set of interaction techniques such as rotation, tilting, twisting, and bending was described for 3D shape modeling. In [20], real-time structural design exploration was carried out using 3D direct manipulation to improve the structural performance.…”

Section: Introduction and Future Workmentioning

confidence: 99%

CAD Learning in Mechanical Engineering at Universities

Ramos¹,

Pedrosa

2020

CADandA

View full text Add to dashboard Cite

Intuitive interactive methods for novice users to create 3D content and 3D geometry have eluded the CAGD community for several decades, and they continue to be critical yet unresolved challenges. The need for such methods is even more acute considering the fact that 3D printing is becoming a commodity. In contrast, modern geometric modeling tools are very complex and continue to be used primarily by professionals such as architects and engineers.Part of the difficulty of novice users to create 3D content might be found in the fact that input/output devices are mostly 2D. While novice users, in real life, do interact daily in 3D environments, typically, they do not create 3D content. In this work, we combine a Leap Motion device [42] / mouse+keyboard with the intuitive notion of sand art, or the creation of 3D artifacts on the seashore, using droplets of wet sand. The result is a very simple, yet highly interactive 3D modeling interface that is also demonstrated on several applications.

show abstract

Mid-air interaction with optical tracking for 3D modeling

Cited by 17 publications

References 43 publications

Object manipulation and deformation using hand gestures

Object manipulation and deformation using hand gestures

Understanding freehand gestures: a study of freehand gestural interaction for immersive VR shopping applications

CAD Learning in Mechanical Engineering at Universities

Contact Info

Product

Resources

About