Byte.it

Gálvez, Tomás Vega; Sapkota, Shardul; Dancu, Alexandru; Maes, Pattie

doi:10.1145/3290607.3312925

Cited by 12 publications

(4 citation statements)

References 6 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Zhong et al and Kuzume et al both used in-ear bone conduction microphones to detect the occurrence of a tooth click [19,48]. Bitey [3] expands upon this work to allow for distinguishing different pairs of teeth clicking, and Byte.it [40] demonstrates that the interaction technique can be implemented with other commodity sensors like an accelerometer or gyroscope. Additionally, Xu et al proposed a system of clench interactions that differentiate different degrees of force when biting down and found that users appreciated the clench interaction as a hands-free technique [45].…”

Section: Teeth Interactionsmentioning

confidence: 92%

“…Many of the final selected gestures involve tongue movements to different areas of the mouth which have been shown to be possible to detect in [9], [29], and [15]. We envision that recent work using sensors around the ear including acoustic sensing [1], electric field sensing [24] and motion sensor [40], are promising avenues to making mouth microgestures more adoptable. Some of the microgestures may be subtle enough to pose a challenge to detect with a single sensing modality.…”

Section: Technological Contextmentioning

confidence: 99%

“…Nowadays, with the advances of electronic technology, wearable devices such as earbuds and head-mounted displays are becoming increasingly ubiquitous and providing new sensing techniques around the face and the mouth. Therefore, there has been emerging research on mouth-related gestures recently, such as teeth clicking [3,40,45], humming [17], or chewing [6]. These gestures are usually subtle, requiring little effort from users, enabling eyes-and hands-free interactions, and having a tendency to be more socially acceptable.…”

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Understanding the Design Space of Mouth Microgestures

Chen

et al. 2021

Designing Interactive Systems Conference 2021

View full text Add to dashboard Cite

As wearable devices move toward the face (i.e. smart earbuds, glasses), there is an increasing need to facilitate intuitive interactions with these devices. Current sensing techniques can already detect many mouth-based gestures; however, users' preferences of these gestures are not fully understood. In this paper, we investigate the design space and usability of mouth-based microgestures. We first conducted brainstorming sessions (N=16) and compiled an extensive set of 86 user-defined gestures. Then, with an online survey (N=50), we assessed the physical and mental demand of our gesture set and identified a subset of 14 gestures that can be performed easily and naturally. Finally, we conducted a remote Wizard-of-Oz usability study (N=11) mapping gestures to various daily smartphone operations under a sitting and walking context. From these studies, we develop a taxonomy for mouth gestures, finalize a practical gesture set for common applications, and provide design guidelines for future mouth-based gesture interactions. CCS CONCEPTS• Human-centered computing → Human computer interaction (HCI); HCI design and evaluation methods; Interaction paradigms; Empirical studies in HCI .

show abstract

Section: Teeth Interactionsmentioning

confidence: 92%

Section: Technological Contextmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Understanding the Design Space of Mouth Microgestures

Chen

et al. 2021

Designing Interactive Systems Conference 2021

View full text Add to dashboard Cite

show abstract

“…A custom 3D-printed enclosure houses the components and provides two separate channels for the speaker and pressure sensor. [19,52]. The use of the ear is underexplored, and EarRumble enables interaction in which users can do less and are not impaired in other actions, as well as provide hidden interaction that is undetectable by, and non-disruptive to, others.…”

Section: Subtle and Discreet Interactionsmentioning

confidence: 99%

EarRumble: Discreet Hands- and Eyes-Free Input by Voluntary Tensor Tympani Muscle Contraction

Röddiger

Clarke

Wolffram

et al. 2021

Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems

View full text Add to dashboard Cite

Figure 1: We present EarRumble, a technique that uses "ear rumbling" for interaction. (a) The tensor tympani muscle can be contracted voluntarily which displaces the eardrum and induces a pressure change within the sealed ear canal; (b) Custombuilt earables detect ear rumbling using an in-ear pressure sensor; (c) Eyes-and hands-free discreet input can be provided by performing diferent rumbling gestures by voluntarily contracting the tensor tympani muscle.

show abstract

Hands-Free Accessible Digital Musical Instruments: Conceptual Framework, Challenges, and Perspectives

Davanzo

Avanzini

2020

IEEE Access

View full text Add to dashboard Cite

Exponential increases of available computational resources, miniaturization, and sensors, are enabling the development of digital musical instruments that use non-conventional interaction paradigms and interfaces. This scenario opens up new opportunities and challenges in the creation of accessible instruments to include persons with disabilities into music practice. This work focuses in particular on instruments dedicated to people who can not use limbs, for whom the only means for musical expression are the voice and a small number of traditional instruments. First, a modular and adaptable conceptual framework is discussed for the design of accessible digital musical instruments targeted at performers with motor impairments. Physical interaction channels available from the neck upwards (head, mouth, eyes, brain) are analyzed in terms of potential and limitations for musical interaction. Second, a systematic survey of previously developed instruments is presented: each is analyzed in terms of design choices, physical interaction channels and related sensors, mapping strategies, performer interface and feedback. As a result of this survey, several open research directions are discussed, including the use of unconventional interaction channels, musical control mappings, multisensory feedback, design, evaluation, and adaptation. INDEX TERMS Accessibile interfaces, Music technology, Digital musical instruments, Inclusive music practice VOLUME ...

show abstract

Byte.it

Cited by 12 publications

References 6 publications

Understanding the Design Space of Mouth Microgestures

Understanding the Design Space of Mouth Microgestures

EarRumble: Discreet Hands- and Eyes-Free Input by Voluntary Tensor Tympani Muscle Contraction

Hands-Free Accessible Digital Musical Instruments: Conceptual Framework, Challenges, and Perspectives

Contact Info

Product

Resources

About