Selection and Manipulation Whole-Body Gesture Elicitation Study In Virtual Reality

Ortega, Francisco R.; Tarre, Katherine; Barreto, Armando; Kress, Mathew; Rishe, Naphtali; Williams, Adam S.

doi:10.1109/vr.2019.8798105

Cited by 10 publications

(3 citation statements)

References 17 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Additionally, Hoff et al's [71] study suggests that the actual effectiveness of these techniques is usually not statistically significant. Similar conclusions were found in the studies of R. Ortega et al [72] and S. Williams et al [70], which argued that using production technique may reduce legacy bias only in a few cases, with a decrease in agreement rates. The overall legacy still seems to exist, so it is not entirely clear whether the production technique reduces legacy bias or not.…”

Section: ) Bias Reductionsupporting

confidence: 87%

Exploring Methods to Optimize Gesture Elicitation Studies: A Systematic Literature Review

Cheng,

Wu,

Xiao

2024

IEEE Access

View full text Add to dashboard Cite

Gesture elicitation is a fundamental method for constructing gesture-based interactive systems. Existing research has shown that this method allows users' knowledge to serve as a design basis, minimizing biases that may occur from relying excessively on an expert's preference. However, how to conduct effective gesture elicitation studies remains an uncertain and open-ended issue. Through a thorough literature review, this study aims to identify important aspects that have significant impacts on the implementation of the elicitation study. The main findings of this paper are as follows: (1) Factors such as the choice of participants, referents, elicitation techniques, elicitation environments, and tasks can have a significant impact on the results of gesture elicitation; (2) Researchers have proposed various metrics for selecting gesture sets and evaluating their effects, but there is still debate over the sufficiency of these metrics; (3) Various methods have been proposed to improve gesture elicitation research, but there is still a lack of broad consensus on the best practices for gesture elicitation research, how to evaluate and report results, and how to compare results across studies. These findings indicate that gesture elicitation has become a valuable research and practical tool, but further study is needed to utilize it better.

show abstract

Section: ) Bias Reductionsupporting

confidence: 87%

Exploring Methods to Optimize Gesture Elicitation Studies: A Systematic Literature Review

Cheng,

Wu,

Xiao

2024

IEEE Access

View full text Add to dashboard Cite

show abstract

“…This work contributes to findings on multimodal interactions and touches on some of the potential pitfalls of referent display which would cause reproduction to be difficult, as mentioned by Villarreal-Narvaez et al [59]. The impact of referent display on proposals is seen most saliently in the low AR for the select referent which often received high AR in prior studies [43,50]. The timing information and patterns here provide insight into the formation of these interactions and extends the timing windows constructed by Lee et al [30] by adding the phase of the interaction by the time of that phases initiation.…”

Section: Discussionmentioning

confidence: 56%

“…A second product of elicitation studies is a better understanding of user behavior. Elicitation studies have shown that upper-body gestures are preferred in whole-body gesture systems [43], and that gestures produced are impacted by the size of the object [51,55]. Elicitation has seen use for many input domains such as multi-touch surfaces [10,34], and mobile devices [53], to internet of things use [63].…”

Section: Gesture Elicitationmentioning

confidence: 99%

Understanding Gesture and Speech Multimodal Interactions for Manipulation Tasks in Augmented Reality Using Unconstrained Elicitation

Williams

Ortega

2020

Proc. ACM Hum.-Comput. Interact.

Self Cite

View full text Add to dashboard Cite

This research establishes a better understanding of the syntax choices in speech interactions and of how speech, gesture, and multimodal gesture and speech interactions are produced by users in unconstrained object manipulation environments using augmented reality. The work presents a multimodal elicitation study conducted with 24 participants. The canonical referents for translation, rotation, and scale were used along with some abstract referents (create, destroy, and select). In this study time windows for gesture and speech multimodal interactions are developed using the start and stop times of gestures and speech as well as the stoke times for gestures. While gestures commonly precede speech by 81 ms we find that the stroke of the gesture is commonly within 10 ms of the start of speech. Indicating that the information content of a gesture and its co-occurring speech are well aligned to each other. Lastly, the trends across the most common proposals for each modality are examined. Showing that the disagreement between proposals is often caused by a variation of hand posture or syntax. Allowing us to present aliasing recommendations to increase the percentage of users' natural interactions captured by future multimodal interactive systems. CCS Concepts: • Human-centered computing → Human computer interaction (HCI); User studies; Mixed / augmented reality; Interaction techniques; Empirical studies in HCI; User centered design.

show abstract

Factors Affecting the Results of Gesture Elicitation: A Review

Cheng,

Wu,

Xiao

2023

2023 11th International Conference in Software Engineering Research and Innovation (CONISOFT)

View full text Add to dashboard Cite

Selection and Manipulation Whole-Body Gesture Elicitation Study In Virtual Reality

Cited by 10 publications

References 17 publications

Exploring Methods to Optimize Gesture Elicitation Studies: A Systematic Literature Review

Exploring Methods to Optimize Gesture Elicitation Studies: A Systematic Literature Review

Understanding Gesture and Speech Multimodal Interactions for Manipulation Tasks in Augmented Reality Using Unconstrained Elicitation

Factors Affecting the Results of Gesture Elicitation: A Review

Contact Info

Product

Resources

About