A basic hand gesture control system for PC applications

Cohen, Charles J.; Beach, Glenn; Foulk, G.

doi:10.1109/aipr.2001.991206

Cited by 20 publications

(5 citation statements)

References 2 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…These are typically detected using either RGB, infrared (IR), or depth cameras. There exists a large body of work focusing on detecting and tracking hands and fingers to enable multi-touch and mid-air gestures using RGB cameras [7,21,18,25]. Such systems typically use skin color detectors [18] or template matching [21] to segment the hand and then calculate contour and convexity defects [25] to identify fingers.…”

Section: Interaction With Projected Surfacesmentioning

confidence: 99%

Exploiting thermal reflection for interactive systems

Shirazi

Abdelrahman

Henze

et al. 2014

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

View full text Add to dashboard Cite

a) Aluminum (b) Glass (c) MDF (d) Tile Figure 1: We explored the thermal reflectivity of different surfaces for interaction with projected surfaces. The thermal reflectivity allows to sense users that perform in-air gestures inside and outside the thermal camera's direct field-of-view. Four of the eight surfaces we analyzed and which can be found in normal office environments are presented above. ABSTRACTThermal cameras have recently drawn the attention of HCI researchers as a new sensory system enabling novel interactive systems. They are robust to illumination changes and make it easy to separate human bodies from the image background. Far-infrared radiation, however, has another characteristic that distinguishes thermal cameras from their RGB or depth counterparts, namely thermal reflection. Common surfaces reflect thermal radiation differently than visual light and can be perfect thermal mirrors. In this paper, we show that through thermal reflection, thermal cameras can sense the space beyond their direct field-of-view. A thermal camera can sense areas besides and even behind its field-of-view through thermal reflection. We investigate how thermal reflection can increase the interaction space of projected surfaces using camera-projection systems. We moreover discuss the reflection characteristics of common surfaces in our vicinity in both the visual and thermal radiation bands. Using a proof-of-concept prototype, we demonstrate the increased interaction space for hand-held camera-projection system. Furthermore, we depict a number of promising application examples that can benefit from the thermal reflection characteristics of surfaces.

show abstract

Section: Interaction With Projected Surfacesmentioning

confidence: 99%

Exploiting thermal reflection for interactive systems

Shirazi

Abdelrahman

Henze

et al. 2014

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

View full text Add to dashboard Cite

show abstract

“…To enable multi-touch interfaces using RGB cameras [4,12,37] there has been substantial work in image segmentation that tracks and identifies various body parts [20]. Typically these systems use skin color matching, edge or contour detection, and motion tracking to segment fingers and hands [12].…”

Section: Surface and Gesture Interactionmentioning

confidence: 99%

HeatWave

Larson

Cohn

Gupta

et al. 2011

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

View full text Add to dashboard Cite

We present HeatWave, a system that uses digital thermal imaging cameras to detect, track, and support user interaction on arbitrary surfaces. Thermal sensing has had limited examination in the HCI research community and is generally under-explored outside of law enforcement and energy auditing applications. We examine the role of thermal imaging as a new sensing solution for enhancing user surface interaction. In particular, we demonstrate how thermal imaging in combination with existing computer vision techniques can make segmentation and detection of routine interaction techniques possible in real-time, and can be used to complement or simplify algorithms for traditional RGB and depth cameras. Example interactions include (1) distinguishing hovering above a surface from touch events, (2) shape-based gestures similar to ink strokes, (3) pressure based gestures, and (4) multi-finger gestures. We close by discussing the practicality of thermal sensing for naturalistic user interaction and opportunities for future work.

show abstract

“…Lenman et al explored the use of pie-and marking menus in hand gesturebased interaction [16]. Cohen et al studied the issues involved in controlling computer applications via hand gestures composed of both static and dynamic symbols [7]. Head pose and gesture offer several key conversational grounding cues and are used extensively in face-to-face interaction among people.…”

Section: Related Workmentioning

confidence: 99%

Head gestures for perceptual interfaces: The role of context in improving recognition

Morency¹,

Sidner

Lee

et al. 2007

Artificial Intelligence

View full text Add to dashboard Cite

Head pose and gesture offer several conversational grounding cues and are used extensively in face-to-face interaction among people. To recognize visual feedback efficiently, humans often use contextual knowledge from previous and current events to anticipate when feedback is most likely to occur. In this paper we describe how contextual information can be used to predict visual feedback and improve recognition of head gestures in human-computer interfaces. Lexical, prosodic, timing, and gesture features can be used to predict a user's visual feedback during conversational dialog with a robotic or virtual agent. In nonconversational interfaces, context features based on user-interface system events can improve detection of head gestures for dialog box confirmation or document browsing. Our user study with prototype gesture-based components indicate quantitative and qualitative benefits of gesture-based confirmation over conventional alternatives. Using a discriminative approach to contextual prediction and multimodal integration, performance of head gesture detection was improved with context features even when the topic of the test set was significantly different than the training set.

show abstract

A basic hand gesture control system for PC applications

Cited by 20 publications

References 2 publications

Exploiting thermal reflection for interactive systems

Exploiting thermal reflection for interactive systems

HeatWave

Head gestures for perceptual interfaces: The role of context in improving recognition

Contact Info

Product

Resources

About