“Avatar to Person” (ATP) Virtual Human Social Ability Enhanced System for Disabled People

Abstract

How to make communication more effective has been underlined unprecedentedly in the artificial intelligence (AI) era. Nowadays, with the improvement of affective computing and big data, people have generally adapted to construct social networks relying on social robots and smartphones. Although the technologies above have been widely discussed and used, researches on disabled people in the social field are still very limited. In particular, facial disabled people, deaf-mutes, and autistic patients are still meeting great difficulty when interacting with strangers using online video technology. This project creates a virtual human social system called “Avatar to Person” (ATP) based on artificial intelligence and three-dimensional (3D) simulation technology, with which disabled people can complete tasks such as “virtual face repair” and “simulated voice generation,” in order to conduct face-to-face video communication freely and confidently. The system has been proven effective in the enhancement of the sense of online social participation for people with disabilities through user tests. ATP is certain to be a unique area of inquiry and design for disabled people that is categorically different from other types of human-robot interaction.

Digital accessibility in the era of artificial intelligence—Bibliometric analysis and systematic review

“…Second, Ingavelez-Guerra et al ( 2022) implemented a multilevel methodological approach to automatically adapt open educational resources within e-learning environments, considering the diverse needs and preferences of students with various disabilities, including hearing impairments, physical disabilities, intellectual and developmental disabilities, visual impairments, and mental health issues. Third, Guo et al (2021) presented a virtual human social system that empowered individuals with facial disabilities, deafmutes, and autism to engage in face-to-face video communication. Additionally, Hezam et al ( 2023) utilized a hybrid multi-criteria decision-making method to prioritize digital technologies for enhancing transportation accessibility for people with disabilities, addressing barriers, and selecting technologies through an uncertain decision-making framework.…”

“…Similarly, the development of digitally accessible games introduced ethical dilemmas, encompassing issues of player autonomy, privacy, and potential unintended consequences tied to partial automation. Privacy and security concerns were also integral to the challenges faced in designing an indoor navigation system (Lo Valvo et al, 2021) and developing the avatar-to-person system (Guo et al, 2021), emphasizing the necessity for technical expertise in AI and 3D modeling. The study conducted by Zaid alahmadi and Alsulami (2020) faced challenges linked to the need to navigate privacy concerns, especially given the impact of including only female participants.…”

“…Lo Valvo et al (2021 faced challenges related to physical infrastructure adaptation, 3D object registration, and accessibility design. Guo et al (2021) identified challenges related to psychological barriers, accessibility issues, the need for technical expertise in relevant areas, and the importance of user acceptance and adoption influenced by factors such as ease of use and perceived usefulness.…”

Real-Time Transcriptionist Based on Artificial Intelligence to Facilitate Learning for People with Hearing Disabilities in Virtual Classes

“…In [10], research was conducted to assist individuals with autism, facial disabilities (facial paralysis), and deaf-mutes in the communication process. The project, referred to by the authors as a virtual human social system called "Avatar to Person," aimed to address these communication challenges.…”