A virtual keyboard implementation based on finger recognition

Zhang, Y.; Yan, Wei; Narayanan, Anantha

doi:10.1109/ivcnz.2017.8402452

Cited by 14 publications

(3 citation statements)

References 67 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In future, we will continue collecting the word-based braille images and added them into the dataset to uplift the performance. Also, further experiments for real-time detection are needed, we will set up a suitable camera as the source of real-time input and implement the real-time scene text detection for translating the braille words from natural scenes [15,16,17,18,19,20,21].…”

Section: Resultsmentioning

confidence: 99%

Braille Recognition Using Deep Learning

Wan

2021

2021 4th International Conference on Control and Computer Vision

View full text Add to dashboard Cite

Text is the media to convey and transmit information. Braille is extremely important for vision impaired people to exchange information through reading and writing. A braille translator is crucial tool for aiding people to understand braille messages.In this paper, we implement character-based braille translator using ResNet, there are three versions of ResNet we implement for braille classifiers, including ResNet-18, ResNet-34, and ResNet-50. We also implement a word-based braille detector using a novel solution called Adaptive Bezier-Curve Network (ABCNet), which is a Scene Text Recognition (STR) method for detecting word-based text in natural scenes. A comparison is present to evaluate the performance of ABCNet.

show abstract

Section: Resultsmentioning

confidence: 99%

Braille Recognition Using Deep Learning

Wan

2021

2021 4th International Conference on Control and Computer Vision

View full text Add to dashboard Cite

show abstract

“…Also, as it requires only a piece of paper, so its economic in terms of cost. This keyboard's accuracy is claimed to be 94.62% [2]. There exist some limitations including lots of computations, with requirements of this project.…”

Section: Literature Survey a "A Virtual Keyboard Implementation Based...mentioning

confidence: 99%

Implementation of Virtual Keyboard Using Hand Gestures

Naaz,

Babu

2023

IJRASET

View full text Add to dashboard Cite

Human interaction with computers is increasing everyday with the advancement in Technology. The different ways of interaction with computers have become an important factor in choosing devices. Humans are more interested in lightweight, touchless technologies that can make the work easier and easier. In this Paper, a virtual keyboard and mouse that act as touchless input medium to Computers and eliminates the use of physical keyboard and mouse has been proposed. The virtual keyboard and mouse are designed to execute its functionality by recognizing hand gestures. The project is build using Python, OpenCV, MediaPipe technologies which provides features for hand gesture controls. It requires a computer or laptop with camera. The idea is to display the customized keyboard layout on the computer screen and the built-in camera captures the hands and its movements over the virtual keyboard layout. A forefinger hovering over the keyboard keys highlights those keys and when the tips of forefinger and middle finger met, then that key is clicked, which is taken as input to computer and displayed on the screen. A virtual mouse has been designed to function as a physical mouse based on hand gestures. The virtual mouse recognizes the fingertip of forefinger and movement of that finger is considered as cursor movements. When the forefinger points to the elements on the screen, it is highlighted as if the cursor is placed over those elements. The overlapping of tips of forefinger and middle finger are designed as a click.

show abstract

“…The languages Python and OpenCV. Y. Zhang, W. Yan and A. Narayanan [5] developed a brand-new virtual keyboard that enables users to text on any surface, on any kind of device. Customized and printed on simple paper, the virtual keyboard can be affixed to a wall or mounted on any oblique plane.…”

mentioning

confidence: 99%

Implementation of Gesture-Based Virtual Keyboard and Mouse

2024

IJSREM

View full text Add to dashboard Cite

The development of human-computer interaction has seen a major change in the last few years, moving in the direction of more user-friendly and effective interfaces. This tendency has prompted researchers to investigate new input techniques, especially in the field of gesture-based control systems. By utilizing both hand and eye gestures to create a gesture-based virtual mouse and keyboard, this paper introduces a novel method of human-computer interaction. The suggested system offers users a smooth and simple way to interact with computers by combining hand gesture recognition and eye-tracking technology. Users can control cursor movement and keyboard inputs without the use of physical peripherals by using the system to track their hand and eye movements and interpret them as commands. The incorporation of eye-tracking technology improves the system's accuracy and responsiveness, enabling more precise cursor control and interaction with elements displayed on the screen. Hand gesture recognition, on the other hand, gives users an ergonomic and natural way to input data, allowing them to carry out commands with straightforward motions. The architecture of the system combines real-time processing capabilities to guarantee low latency and high responsiveness with sophisticated machine-learning algorithms for gesture recognition. Additionally, users can define their gesture commands according to their needs and preferences because the system is flexible and customizable. The suggested gesture-based virtual mouse and keyboard system has undergone rigorous testing and evaluation, and the results show promising performance and usability in a range of scenarios and applications. This novel method of interacting with computers has the potential to improve user experience, accessibility, and productivity in a variety of computing contexts. Keywords: Human-Computer Interaction, Gesture Recognition, Eye-Tracking

show abstract

A virtual keyboard implementation based on finger recognition

Cited by 14 publications

References 67 publications

Braille Recognition Using Deep Learning

Braille Recognition Using Deep Learning

Implementation of Virtual Keyboard Using Hand Gestures

Implementation of Gesture-Based Virtual Keyboard and Mouse

Contact Info

Product

Resources

About