Fast hand and finger detection algorithm for interaction on smart display

Lee, Donghyeon; Kim, Jin-Sung; Lee, Hyuk-Jae

doi:10.1016/j.displa.2018.02.001

Cited by 9 publications

(2 citation statements)

References 28 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Button number, size (Huang and Wu, 2015), and position (Huang and Lai, 2008) also affect operating performance (Lindberg et al, 2006). Lee et al (2018), indicated that hand detection, hand-shape recognition, and hand tracking have been emerging topics in research on human-computer interaction (HCI).…”

Section: Research Backgroundmentioning

confidence: 99%

Impact of button position and touchscreen font size on healthcare device operation by older adults

Yeh

2020

Heliyon

View full text Add to dashboard Cite

In 1993, Taiwan officially became an aging society. Degradation of physiological function during aging is inevitable; visual and physical reactions are especially vulnerable. Given the popularity of electronic devices and their vigorous development in recent years, touchscreen use is now commonplace. As society ages, many people use devices to monitor their health. Some products have gradually eschewed their traditional interfaces, which have been replaced by touchscreens. Touchscreen operation and interpretation differ between older and younger populations. Here, we focus on healthcare equipment, exploring the effects of button position and touchscreen font size on operation by older people. To understand differences between older and younger people, we invited 32 people aged 18-35 years, and 32 people aged over 65 years, to participate in our experiment. Each subject tested four button positions and four font sizes, thus 16 test interfaces in all. We found that young people found no differences among the 16 interfaces, but the older group did. Larger fonts reduced operation time for older participants. At a font size of 22 pt, the older group performed as well as the young participants. When buttons were positioned at the top of the interface, the performance of the older participants improved. Overall, use of a font size of 22 pt and top-positioned buttons optimized the performance of the older participants while use of a font size of 10 pt and bottom-positioned buttons maximally degraded their performance. Our results can be used to design interfaces appropriate for older people, thus improving their autonomy.

show abstract

Section: Research Backgroundmentioning

confidence: 99%

Impact of button position and touchscreen font size on healthcare device operation by older adults

Yeh

2020

Heliyon

View full text Add to dashboard Cite

show abstract

“…The authors in [15,16] used a tracking device and reveals temporal division and spatial division gesture techniques to interact with the large public display. To formulate the best technique for hand gesture [17] used the object contour method for fast and accurate hand detection and tracking algorithm. The author in [18] improve gesture recognition by focusing spatial channels on hands.…”

Section: Literature Reviewmentioning

confidence: 99%

Design and Experimental Analysis of Touchless Interactive Mirror using Raspberry Pi

Memon¹,

Mudassir²,

Baqai³

et al. 2020

IJACSA

View full text Add to dashboard Cite

A prototype of a smart gesture-controlled mirror with enhanced interactivity is proposed and designed in this paper. With the help of hand gestures, the mirror provides some basic amenities like time, news, weather etc. The designed system uses Pi cam for image acquisition to perform the functions like gesture recognition and an ultrasonic sensor for presence detection. This paper also discusses the experimental analysis of human gesture interaction using parameters like the angle which ranges its horizon from 0 to 37 degree when tilting the forearm up and down and 0 to 15 degrees when the forearm is twisted right to left and otherwise based on yellow, pink and white background colours. Additionally, the range of detection using an ultrasonic sensor is restricted to the active region of 69.6 to 112.5 degrees. Moreover, time delay which takes half a second for a time as retrieve with the system and take 6 to 10 seconds for fetching headlines and weather information from the internet. These analyses are taken into account to subsequently improve the design algorithm of the gesture-controlled smart mirror. The framework developed comprises of three different gesture defects under which mirror will display the mentioned information on its screen.

show abstract

Visual rendering of shapes on 2D display devices guided by hand gestures

2019

View full text Add to dashboard Cite

Designing of touchless user interface is gaining popularity in various contexts. Using such interfaces, users can interact with electronic devices even when the hands are dirty or nonconductive. Also, user with partial physical disability can interact with electronic devices using such systems. Research in this direction has got major boost because of the emergence of low-cost sensors such as Leap Motion, Kinect or RealSense devices. In this paper, we propose a Leap Motion controller-based methodology to facilitate rendering of 2D and 3D shapes on display devices. The proposed method tracks finger movements while users perform natural gestures within the field of view of the sensor. In the next phase, trajectories are analyzed to extract extended Npen++ features in 3D. These features represent finger movements during the gestures and they are fed to unidirectional left-to-right Hidden Markov Model (HMM) for training. A one-to-one mapping between gestures and shapes is proposed. Finally, shapes corresponding to these gestures are rendered over the display using MuPad interface. We have created a dataset of 5400 samples recorded by 10 volunteers. Our dataset contains 18 geometric and 18 non-geometric shapes such as "circle", "rectangle", "flower", "cone", "sphere" etc. The proposed methodology achieves an accuracy of 92.87% when evaluated using 5-fold cross validation method. Our experiments revel that the extended 3D features perform better than existing 3D features in the context of shape representation and classification. The method can be used for developing useful HCI applications for smart display devices.

show abstract

Fast hand and finger detection algorithm for interaction on smart display

Cited by 9 publications

References 28 publications

Impact of button position and touchscreen font size on healthcare device operation by older adults

Impact of button position and touchscreen font size on healthcare device operation by older adults

Design and Experimental Analysis of Touchless Interactive Mirror using Raspberry Pi

Visual rendering of shapes on 2D display devices guided by hand gestures

Contact Info

Product

Resources

About