Signing avatars: making education more inclusive

Martino, José Mario De; Silva, Ivani Rodrigues; Bolognini, Carmen Zink; Costa, Paula Dornhofer Paro; Kumada, Kate Mamhy Oliveira; Coradine, Luis Cláudius; Brito, Patrick H. S.; Amaral, Wanessa Machado do; Benetti, Ângelo; Poeta, Enzo Telles; Angare, Leandro Martin; Ferreira, Carolina Monteiro; Conti, Davi Faria de

doi:10.1007/s10209-016-0504-x

Cited by 14 publications

(22 citation statements)

References 29 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Based on the information of the authors Jaime-Gil et Optical as well as nonoptical systems were used by the studies in our review. Within the group of optical MCSs, the systems can be further distinguished depending on whether or not they use markers: nine studies used markerless systems [12,14,16,17,[48][49][50][51][52] and eight studies used marker-based systems [11,15,18,[53][54][55][56][57]. Among markerless systems, the Kinect was used in six out of nine studies.…”

Section: The Types Of Systems and The Systems Usedmentioning

confidence: 99%

See 1 more Smart Citation

Motion Capture Systems and Their Use in Educational Research: Insights from a Systematic Literature Review

Reuter

2023

Education Sciences

View full text Add to dashboard Cite

Motion capture is gaining significance in educational research. Different motion capture systems (MCSs) are used in educational research for different purposes and in different ways, which creates a diversity that is difficult to monitor. The aim of this article is to provide an overview of MCSs and their uses in educational research addressing primary and secondary school education. We conducted a systematic review focusing on the types of MCSs and the concrete systems being used, looking at how they are used, the purposes of their use, the aims and the research questions under investigation, the subjects/topics addressed in the studies, the locations/places of use, the potential benefits of using MCSs perceived by the researchers, and the underlying theories of movement. Based on n = 20 studies focusing on primary and secondary school education identified in our database search, we found that these studies mainly used optical MCSs. Furthermore, we identified three main purposes of their use: to directly support the learning process of students, as analysis tools, or for developing tutoring systems that support students in their learning. This paper gives insights into the use of MCSs in educational research and provides a springboard for further research using MCSs in educational research.

show abstract

Section: The Types Of Systems and The Systems Usedmentioning

confidence: 99%

“…The Vicon system was used three times [18,53,54]. De Martino et al [54] stated that they used Vicon Cara.…”

Section: The Types Of Systems and The Systems Usedmentioning

confidence: 99%

Motion Capture Systems and Their Use in Educational Research: Insights from a Systematic Literature Review

Reuter

2023

Education Sciences

View full text Add to dashboard Cite

show abstract

“…Not much research has been done on technology-based products for learning sign language in the initial stages . The user interaction provided by current technology based application is minimal (Cempre et al, 2013;Reis et al, 2015;Mokhtar and Anuar, 2015;Boulares and Jemni, 2012;Kasim and Wai, 2013;De Martino et al, 2017). Most of the existing products available as mobile applications could convert only displayed text/character into the corresponding sign language.…”

Section: Tools For Sign Language Learningmentioning

confidence: 99%

SiLearn: an intelligent sign vocabulary learning tool

Joy

Balakrishnan

Sreeraj³

2019

JET

View full text Add to dashboard Cite

Purpose Vocabulary learning is a difficult task for children without hearing ability. Absence of enough learning centers and effective learning tools aggravate the problem. Modern technology can be utilized fruitfully to find solutions to the learning difficulties experienced by the deaf. The purpose of this paper is to present SiLearn – a novel technology based tool for teaching/learning sign vocabulary. Design/methodology/approach The proposed mobile application can act as a visual dictionary for deaf people. SiLearn is equipped with features that can automatically detect both text and physical objects and convert them to their corresponding signs. For testing the effectiveness of the proposed mobile application quantitative analyses were done. Quantitative analysis is based on testing a class of 28 students belonging to St Clare Oral School for the Deaf, Kerala, India. This group consisted of 17 boys and 11 girls. Analysis was also done through questionnaire. Questionnaires were given to teachers, parents of deaf students learning sign language and other sign language learners. Findings Results indicate that as SiLearn is very effective in sign vocabulary development. It can enhance vocabulary learning rate considerably. Originality/value This is the first time that artificial intelligence (AI) based techniques are used for early stage sign language learning. SiLearn can equally be used by children, parents and teachers for learning sign language.

show abstract

“…Virtual avatars are used extensively in different research fields such as gaming [9,37], education [11,54,81], or social virtual environments (VE) [15,16,29,36,88]. There is a large body of work that investigated the perception of virtual avatars (e.g., [62]) or studied people's body ownership of a virtual avatar (e.g., [25]).…”

Section: Introductionmentioning

confidence: 99%

Observing Virtual Avatars: The Impact of Avatars’ Fidelity on Identifying Interactions

Mathis

Vaniea

Khamis

2021

Academic Mindtrek 2021

View full text Add to dashboard Cite

Figure 1: We investigate the impact of an avatar's fidelity on a bystander's performance when identifying the avatar's touch, mid-air, and eye gaze gestures. We had an abstract avatar (➋) and two more realistic avatars (➌, ➍), which are provided by Microsoft Research [24] and modified based on our investigation. We use touch, mid-air, and eye gaze gestures performed by a human in the real world (➊) as our baseline.

show abstract

Signing avatars: making education more inclusive

Cited by 14 publications

References 29 publications

Motion Capture Systems and Their Use in Educational Research: Insights from a Systematic Literature Review

Motion Capture Systems and Their Use in Educational Research: Insights from a Systematic Literature Review

SiLearn: an intelligent sign vocabulary learning tool

Observing Virtual Avatars: The Impact of Avatars’ Fidelity on Identifying Interactions

Contact Info

Product

Resources

About