On attaining user-friendly hand gesture interfaces to control existing GUIs

Ertuğrul, Egemen; Li, Ping; Sheng, Bin

doi:10.1016/j.vrih.2020.02.001

Cited by 16 publications

(5 citation statements)

References 1 publication

Supporting

Mentioning

Contrasting

Order By: Relevance

“… Pose Estimation: With MediaPipe's pose estimation capabilities, the system accurately captures the user's body poses and movements. This functionality enables the recognition of complex gestures and actions performed by the user [13].  Facial Landmark Detection: MediaPipe includes facial landmark detection algorithms, allowing the system to identify key facial landmarks such as eyes, nose, and mouth.…”

Section: Augmented Realitymentioning

confidence: 99%

Optical Gesture Recognition for Virtual Cursor Navigation

Mr. Suresh K,

Sanjay R,

Vinoth M

et al. 2024

Int Res J Adv Engg Hub

View full text Add to dashboard Cite

In the rapidly evolving landscape of technology, there is a constant quest for innovations that set themselves apart. Gestures emerge as a highly coveted means of communication with machines. The significance of Human-Computer Interaction becomes evident when harnessing human gestures to govern computer applications. While conventional controls like mice, keyboards, and laser pointers have been commonplace, recent technological strides have introduced more effective techniques for application control. Numerous Gesture Recognition methods, leveraging image processing, have been explored in the past. However, the challenge of recognizing gestures in noisy backgrounds has persistently posed difficulties. In our proposed system, we intend to employ a technique known as Augmentation in Image processing to command a Media Player. This involves recognizing gestures to manipulate operations on the Media Player. Augmentation proves advantageous, particularly in the realm of virtual reality, as it is not constrained by background limitations. Additionally, it eliminates dependencies on specific accessories like gloves or color pointers for gesture recognition. The proposed system caters to users seeking a simplified and enhanced interaction with their computers.

show abstract

Section: Augmented Realitymentioning

confidence: 99%

Optical Gesture Recognition for Virtual Cursor Navigation

Mr. Suresh K,

Sanjay R,

Vinoth M

et al. 2024

Int Res J Adv Engg Hub

View full text Add to dashboard Cite

show abstract

“…These interfaces provide the advantage of convenience, allowing users to communicate with devices in the most natural way possible. This technology has shown great potential in human-machine interaction and is becoming more prevalent in games and other applications (Ertugrul, Li and Sheng, 2020).…”

Section: Achievements Designmentioning

confidence: 99%

Turning Grey to Green: Engaging Gamification in Sustainability Education with Augmented Reality Technology

Ma,

Dik,

Fung

2023

ECGBL

View full text Add to dashboard Cite

In recent decades, topics of sustainability and carbon neutrality are getting more attention from society and academia in the sense of urbanization and social innovation. Scholars have been proposing methods to achieve sustainability and they emphasize the importance of educating citizens about the ethics of sustainability. Also, in the educational context, there is a trend in applying gamification concepts to promote sustainability. Previous studies have demonstrated that gamification can engage students through interactive content and reward systems, so that they can be motivated to learn and apply knowledge. Nevertheless, limited articles can be found to propose methods for developing technological applications for green innovation education. In addition, scant interest has been shown to include gamification in sustainability education, especially in Hong Kong. Knowing that simulation games may raise students’ curiosity to learn, we designed an augmented-reality-based educational mobile application to investigate their perception of engaging technologies and gamification in the learning process of sustainability education. In this application, there are three major components to be presented. First, various simulation games are included to educate learners with practical skills to nurture sustainable living habits. Cartoons and animations are added to better explain abstract ecological theories, and learners can interact with game characters / elements in real-time motion for an advanced gaming experience. Second, to motivate students to learn the content, digital achievement badges can be earned after winning the mini-games and they can be shared on social media platforms. It is expected that the reward system can attract students to participate actively. Last but not least, the application is hoped to engage Hong Kong citizens and the globe in the Green Deck project of Hong Kong and encourage more social involvement. With reference to the application structure, this study is expected to explore the effects of implementing games and augmented reality on education for sustainable development. Two surveys (pre- and post-surveys) would be established to evaluate the students’ learning experience and knowledge acquisition on sustainability.

show abstract

“…In their research, Ertugrul et al [9] suggested a novel gestural interface that leverages Finite State Machine (FSM) technology to allow users to personalize GUI activities. This is achieved by modifying gesture-specific parameters, including the distance from the camera, distance between hands, and timing of events.…”

Section: Literature Reviewmentioning

confidence: 99%

A Deep Learning Framework for Hand Gesture Recognition and Multimodal Interface Control

Elmagrouni,

Ettaoufik,

Aouad

et al. 2023

RIA

View full text Add to dashboard Cite

Hand gesture recognition (HGR) is an essential technology with applications spanning human-computer interaction, robotics, augmented reality, and virtual reality. This technology enables more natural and effortless interaction with computers, resulting in an enhanced user experience. As HGR adoption increases, it plays a crucial role in bridging the gap between humans and technology, facilitating seamless communication and interaction. In this study, a novel deep learning approach is proposed for the development of a Hand Gesture Interface (HGI) that enables the control of graphical user interfaces without physical touch on personal computers. The methodology encompasses the analysis, design, implementation, and deployment of the HGI. Experimental results on a hand gesture recognition system indicate that the proposed approach improves accuracy and reduces response time compared to existing methods. The system is capable of controlling various multimedia applications, including VLC media player, Microsoft Word, and PowerPoint. In conclusion, this approach offers a promising solution for the development of HGIs that facilitate efficient and intuitive interactions with computers, making communication more natural and accessible for users.

show abstract

On attaining user-friendly hand gesture interfaces to control existing GUIs

Cited by 16 publications

References 1 publication

Optical Gesture Recognition for Virtual Cursor Navigation

Optical Gesture Recognition for Virtual Cursor Navigation

Turning Grey to Green: Engaging Gamification in Sustainability Education with Augmented Reality Technology

A Deep Learning Framework for Hand Gesture Recognition and Multimodal Interface Control

Contact Info

Product

Resources

About