Smart-Pockets: Body-deictic gestures for fast access to personal data during ambient interactions

Vatavu, Radu-Daniel

doi:10.1016/j.ijhcs.2017.01.005

Cited by 32 publications

(4 citation statements)

References 115 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…I/O Braid [50,51] advances cord-based interfaces, implementing both the continuous and discrete gesture control for headphones. Some other studies explore the interaction modality on the skin [4,85] and pocket [14,68,75] and combine touch with other modal interactions. The zPatch [65] is an eTEXTile patch using both resistive and capacitive sensing, supporting hovering, touch, and pressure input.…”

Section: Interaction On Flexible Touch Sensormentioning

confidence: 99%

Handwriting Velcro

Fang

Zhang

Zhan

et al. 2022

Proc. ACM Interact. Mob. Wearable Ubiquitous Technol.

View full text Add to dashboard Cite

Text input is a desired feature for AR glasses. While there already exist various input modalities (e.g., voice, mid-air gesture), the diverse demands required by different input scenarios can hardly be met by the small number of fixed input postures offered by existing solutions. In this paper, we present Handwriting Velcro, a novel text input solution for AR glasses based on flexible touch sensors. The distinct advantage of our system is that it can easily stick to different body parts, thus endowing AR glasses with posture-adaptive handwriting input. We explored the design space of on-body device positions and identified the best interaction positions for various user postures. To flatten users' learning curves, we adapt our device to the established writing habits of different users by training a 36-character (i.e., A-Z, 0-9) recognition neural network in a human-in-the-loop manner. Such a personalization attempt ultimately achieves a low error rate of 0.005 on average for users with different writing styles. Subjective feedback shows that our solution has a good performance in system practicability and social acceptance. Empirically, we conducted a heuristic study to explore and identify the best interaction Position-Posture Correlation. Experimental results show that our Handwriting Velcro excels similar work [6] and commercial product in both practicality (12.3 WPM) and user-friendliness in different contexts.

show abstract

Section: Interaction On Flexible Touch Sensormentioning

confidence: 99%

Handwriting Velcro

Fang

Zhang

Zhan

et al. 2022

Proc. ACM Interact. Mob. Wearable Ubiquitous Technol.

View full text Add to dashboard Cite

show abstract

“…The PalmRC system of Dezfuli et al [8] enabled viewers to control the TV set by touching specifc areas on their palms. Popovici et al [31] integrated "smart pockets" [42] with smart TVs, enabling users to take out digital content from their pockets, e.g., a movie fle, and display it on the TV screen.…”

Section: Augmented Reality Televisionmentioning

confidence: 99%

AR-TV and AR-Diànshì: Cultural Differences in Users’ Preferences for Augmented Reality Television

Popovici¹,

Vatavu²,

Feng³

et al. 2021

ACM International Conference on Interactive Media Experiences

Self Cite

View full text Add to dashboard Cite

As Augmented Reality television gains momentum, it is important to understand whether cultural diferences among viewers favor diferent expectations and preferences for immersion in such new television environments. A previous study documented the preferences of 172 participants from various European countries for twenty application scenarios for ARTV, such as virtual objects coming out of the TV screen into the room. In this work, we conduct an empirical generalization of this previous study to understand potential cultural diferences in users' preferences for and expectations of ARTV. To this end, we report insights from data collected from a sample of 147 participants from China, which we compare against the preferences expressed by the participants from Europe from the original study. Our fndings reveal similarities, but also diferences in terms of expectations of ARTV across the two cultural groups. We draw implications for future research on culturally-aware augmentations of the television watching experience. CCS CONCEPTS• Human-centered computing → Mixed / augmented reality; Empirical studies in HCI.

show abstract

“…Iconic gestures are those in which the form of the gesture or its manner of execution embodies picturable aspects of semantic content [35]. For example, Vatavu [36] evaluated a smart-pocket gesture that can transfer information from a pocket device to the large display by raising the hand and then pointing forward. Loehmann's concept design [37] enabled drivers to exchange music or initiate calls with nearby cars through a from-outside-to-inside hand gesture depicting the process an object is grasped from outside the window.…”

Section: Command-to-gesture Mappings For Mid-air Unistroke Gesturementioning

confidence: 99%

Mapping Directional Mid-Air Unistroke Gestures to Interaction Commands: A User Elicitation and Evaluation Study

2021

View full text Add to dashboard Cite

A stroke is the basic limb movement that both humans and animals naturally and repetitiously perform. Having been introduced into gestural interaction, mid-air stroke gestures saw a wide application range and quite intuitive use. In this paper, we present an approach for building command-to-gesture mapping that exploits the semantic association between interactive commands and the directions of mid-air unistroke gestures. Directional unistroke gestures make use of the symmetry of the semantics of commands, which makes a more systematic gesture set for users’ cognition and reduces the number of gestures users need to learn. However, the learnability of the directional unistroke gestures is varying with different commands. Through a user elicitation study, a gesture set containing eight directional mid-air unistroke gestures was selected by subjective ratings of the direction in respect to its association degree with the corresponding command. We evaluated this gesture set in a following study to investigate the learnability issue, and the directional mid-air unistroke gestures and user-preferred freehand gestures were compared. Our findings can offer preliminary evidence that “return”, “save”, “turn-off” and “mute” are the interaction commands more applicable to using directional mid-air unistrokes, which may have implication for the design of mid-air gestures in human–computer interaction.

show abstract

Smart-Pockets: Body-deictic gestures for fast access to personal data during ambient interactions

Cited by 32 publications

References 115 publications

Handwriting Velcro

Handwriting Velcro

AR-TV and AR-Diànshì: Cultural Differences in Users’ Preferences for Augmented Reality Television

Mapping Directional Mid-Air Unistroke Gestures to Interaction Commands: A User Elicitation and Evaluation Study

Contact Info

Product

Resources

About