This research proposed a mobile application prototype to translate Indonesian text into SIBI (Sign System for the Indonesian Language) 3D gestures animation to bridge the communication gap between the deaf and the other. To communicate in sign language, the signer will use his/her hands and fingers to demonstrate the word gesture, and at the same time, his/her mouth will pronounce the word being expressed. Therefore, the proposed mobile application needs two animation generator components: the hand gesture and the lip movement generator. Hand gestures are made using a motion capture sensor. Mouth movements are created for all syllables available in the SIBI dictionary using the Dirichlet Free-Form Deformation (DFFD) method. The subsequent challenging work is synchronizing these two components and adding transitional gestures. A transitional gesture done by the cross-fading method is needed to make a word gesture that can smoothly connect with the next word gesture. The Mean Opinion Score (MOS) test was run to measure the mouth movements in 3D animation. The MOS score is 4.422. There are four surveys conducted to measure user satisfaction. The surveys showed that the animation generated did not significantly differ from the original video. The Sistem Usability Score (SUS) is 76.25. The score means that prototype is in the GOOD category. The average time needed to generate an animation from Indonesian input text is less than 100ms.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
customersupport@researchsolutions.com
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.
Copyright © 2025 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.