Understanding Gesture and Speech Multimodal Interactions for Manipulation Tasks in Augmented Reality Using Unconstrained Elicitation

Williams, Adam S.; Ortega, Francisco R.

doi:10.1145/3427330

Cited by 22 publications

(29 citation statements)

References 57 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…At the same time, the use of appropriate software in the digital educational space of the university, according to A.S. Williams, F.R. Ortega, changes not only the forms of presentation and processing of information, but also the very way, style of interaction between participants of the information process (Williams, Ortega, 2020).…”

Section: Relevance 21 Analysis Of Russian Scientific and Pedagogical Literaturementioning

confidence: 99%

See 1 more Smart Citation

Using Methods and Means of the Augmented Reality Technology When Training Future Teachers of the Digital School

2021

European Journal of Contemporary Education

View full text Add to dashboard Cite

The problem which is studied is due to the need to solve the contradiction between the needs of society for the quality of training future teachers of the digital school regarding to formation of skills related to innovative technologies, communicative competences, the ability to work in the information environment and insufficient elaboration of the methodological base for training graduates that satisfies this requirements.The purpose of the study is to theoretically substantiate and experimentally verify the need to apply methods and means of the augmented reality technology when training future teachers of the digital school.The research methodology is the analysis and generalization of scientific works on the problems and prospects of using the augmented reality (AR) technology in the university, formation of the professional competence of the future teacher of the digital school. Mind Mapping 3D, Google Lens, augmented reality browsers, WallaMe service are used as software implementation tools. The experiment is presented using the example of assessing changes in levels of skills that make up the essence of the professional competence of the future teacher of the digital school.Research results. The authors clarified the potential of the augmented reality technology, the advantages and disadvantages in terms of development professional competences of future specialists (training program 44.03.05 Pedagogical education (two training program specializations). The options for using the AR technology to improve the quality of education, formation of digital literacy and development of personal qualities are identified. Specific materials on the use of methods, means of the augmented reality technology are proposed on the example of

show abstract

Section: Relevance 21 Analysis Of Russian Scientific and Pedagogical Literaturementioning

confidence: 99%

“…Trolling, outing and fraping are all new ways to negatively influence the consciousness of the personality. Each of these psychological phenomena, according to A. S. Williams, F. R. Ortega, requires additional studies in science and the pedagogical theory (Williams, Ortega, 2020). For example, as F.K.M.…”

mentioning

confidence: 99%

Using Methods and Means of the Augmented Reality Technology When Training Future Teachers of the Digital School

2021

European Journal of Contemporary Education

View full text Add to dashboard Cite

show abstract

“…In the arsenal of mentors, which is described in detail by E. A. Plakhova, E. N. Kharapudko, R. R. Nurmieva [15], not only interactive resources, gaming educational platforms, cloud services, but also technologies of augmented and virtual reality appear. At the same time, the use of appropriate software in the digital educational space of the university, according to A. S. Williams, F. R. Ortega [12], changes not only the forms of presentation and processing of information, but also the very way, style of interaction between participants in the information process.…”

Section: Literature Reviewmentioning

confidence: 99%

“…Trolling, outing and fraping are all new ways to negatively influence the consciousness of the person. Each of these psychological phenomena, according to A. S. Williams, F. R. Ortega [12], requires additional study in science and pedagogical theory. For example, the constant appeal to modern technologies and their inclusion in the educational process can lead to oversaturation: students get used to everything interactive, and traditional educational tools become uninteresting to them.…”

Section: Introductionmentioning

confidence: 99%

Features of using methods and means of the augmented reality technology when teaching a foreign language

Сергеева¹,

Захарова²,

Tyutyunnik³

2021

P Sci Edu

View full text Add to dashboard Cite

The problem and the aim of the study. The integration of digital technologies into modern curricula in a foreign language supports the solution of tasks of higher professional education in terms of training a demanded and competitive specialist. The purpose of the work is to study the features of using methods and means of the augmented reality technology in the process of forming students' professional foreign language competence. Research methods. To obtain theoretical generalizations the analysis of scientific works on problems and prospects of using the augmented reality (AR) technology in the process of teaching a foreign language and on formation of the professional foreign language competence was used. AR tools (Google Lens, augmented reality browsers, WallaMe service) were mastered as part of the course “Virtual and Augmented Reality Technologies” Stepik platform (https://stepik.org/course/62107/syllabus). The study involved 40 first-year students of Vyatka State University of the training program “Teacher education”. In the experiment, the Pearson χ2 (chi-square) criterion was applied. Results. In the experimental group, when studying scientific terms, vocabulary and grammar of the foreign language, for communication and cultural exchange, the methods and means of the AR technology were used. Assessment of formation of the professional foreign language competence was carried out and statistically significant differences in the qualitative changes that occurred in the pedagogical system were revealed, χ2obs. 2 > χ2crit0.05 (7,14 > 5,99). In conclusion factors that make it possible to effectively use the augmented reality technology in foreign language classes (time regulation; alternation of activities, traditional methods and means with innovative ones; inclusion of physical activity breaks and elements of neuro-gymnastics; instruction on safe networking) are summarized.

show abstract

“…In gesture elicitation studies these will be gesture proposals for multi-touch devices [3,8], or mid-air gestures [9]. Other modalities such as gesture and speech [10][11][12][13] can be elicited. Upon the generation of a proposal, the experimenter will trigger the reaction of the system to that proposal.…”

Section: Introductionmentioning

confidence: 99%

The Cost of Production in Elicitation Studies and the Legacy Bias-Consensus Trade off

Williams

Garcia

Zayas

et al. 2020

MTI

Self Cite

View full text Add to dashboard Cite

Gesture elicitation studies are a popular means of gaining valuable insights into how users interact with novel input devices. One of the problems elicitation faces is that of legacy bias, when elicited interactions are biased by prior technologies use. In response, methodologies have been introduced to reduce legacy bias. This is the first study that formally examines the production method of reducing legacy bias (i.e., repeated proposals for a single referent). This is done through a between-subject study that had 27 participants per group (control and production) with 17 referents placed in a virtual environment using a head-mounted display. This study found that over a range of referents, legacy bias was not significantly reduced over production trials. Instead, production reduced participant consensus on proposals. However, in the set of referents that elicited the most legacy biased proposals, production was an effective means of reducing legacy bias, with an overall reduction of 11.93% for the chance of eliciting a legacy bias proposal.

show abstract

Understanding Gesture and Speech Multimodal Interactions for Manipulation Tasks in Augmented Reality Using Unconstrained Elicitation

Cited by 22 publications

References 57 publications

Using Methods and Means of the Augmented Reality Technology When Training Future Teachers of the Digital School

Using Methods and Means of the Augmented Reality Technology When Training Future Teachers of the Digital School

Features of using methods and means of the augmented reality technology when teaching a foreign language

The Cost of Production in Elicitation Studies and the Legacy Bias-Consensus Trade off

Contact Info

Product

Resources

About