You as a Puppet

Sakashita, Mose; Minagawa, Tatsuya; Koike, Amy; Suzuki, I.; Kawahara, Keisuke; Ochiai, Yoichi

doi:10.1145/3126594.3126608

Cited by 36 publications

(3 citation statements)

References 26 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Mimicat [31] demonstrated a camera-based method to recognize face movement, in particular the opening / closing motion of the mouth and eyes. Sakashita et al [29] demonstrated the usability of photo reflective arrays to detect the opening / closing of the mouth. In a similar way to these works, we utilized photo reflective sensors as part of our facial expression recognition method.…”

Section: Facial Expression Recognition Interfacementioning

confidence: 99%

Digital Full-Face Mask Display with Expression Recognition using Embedded Photo Reflective Sensor Arrays

Takegawa

Tokuda²,

Umezawa

et al. 2020

2020 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)

View full text Add to dashboard Cite

This paper presents a thin digital full-face mask display that can reflect an entire facial expression of a user onto an avatar to support augmented face-to-face communication in real environments. Although camera-based facial expression recognition technology has enabled people to augment their faces with avatars, application was limited to face-to-face communication in virtual environments. To enable digital facial augmentation with an avatar in a real space, we propose a digital face mask display system that integrates a lightweight flexible display with a thin facial expression recognition system. The thin wearable facial expression recognition system was implemented with photo reflective sensor arrays which can measure facial expressions at 40 feature points distributed across an entire face. We investigated a ten-class facial expression identification model based on an SVM training algorithm. The trained model achieved an average accuracy of 79% when identifying the facial expressions of multiple users. User experiments indicated that the proposed thin digital full-face mask display allows the wearer to control the facial expression of the avatar with a fast response rate and create a positive sense of self-agency and self-ownership toward the augmented avatar face.

show abstract

Section: Facial Expression Recognition Interfacementioning

confidence: 99%

Digital Full-Face Mask Display with Expression Recognition using Embedded Photo Reflective Sensor Arrays

Takegawa

Tokuda²,

Umezawa

et al. 2020

2020 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)

View full text Add to dashboard Cite

show abstract

“…Wayang holds a versatile nature that allows its application in various contexts [18], [19]. A wayang performance carries numerous valuable lessons and life principles.…”

Section: Introductionmentioning

confidence: 99%

Preserving Cultural Heritage Through AI: Developing LeNet Architecture for Wayang Image Classification

Khairina,

Barus

et al. 2023

IJACSA

View full text Add to dashboard Cite

Wayang, an ancient cultural tradition in Java, has been an integral part of Indonesian culture for 1500 years. Rooted in Hindu cultural influences, wayang has evolved into a highly esteemed and beloved performance art. In the form of wayang kulit, this tradition conveys profound philosophical messages and implicit meanings that resonate with Javanese society. This research aims to develop an artificial intelligence (AI) model using deep learning with the LeNet architecture to accurately classify wayang images. The model was tested with 2515 Punakawan wayang images, showing excellent performance with an accuracy of 80% to 85%. Although the model successfully recognizes and distinguishes wayang classes, it faces some challenges in classifying specific classes, particularly in scenarios 2 and 4. Nevertheless, this research has a positive impact on cultural preservation, as the developed AI model can be used for automatic wayang image recognition. These implications open opportunities to better understand and preserve this rich cultural heritage through AI technology. With further improvements, this model has the potential to become a valuable tool in the efforts to preserve and introduce wayang culture to future generations.

show abstract

“…Marvin Minsky from [5], one of the first to use the phrase "telepresence" to describe the sensation of being far away while using a teleoperator, is where the concept of telepresence originates. Numerous methods have been developed to enable telepresence since Marvin Minsky from [6] first expressed the theory.…”

Section: Introductionmentioning

confidence: 99%

Life-size telepresence using holographic display

Ishigaki,

Ismail,

Halim

et al. 2023

IJEECS

View full text Add to dashboard Cite

Despite massive advancements in the telecommunications industry over the last few decades, telepresence video-based teleconferencing is still far from giving a physical co-presence experience. Applications like Skype, Zoom and WebEx are constrained as it is only able to display the head and shoulders of the users on one monitor. It offers the user flat two-dimensional (2D) upper body imageries, a fixed viewpoint, inconsistent gaze direction, and restriction. Therefore, the problem arises when video-based teleconferencing is unable to support effective communication in telepresence. Thus, this research aims to propose life-size telepresence by using a projector-based holographic display. To actualize the aim, there are three phases have been proposed in this research. The first phase is to enable the tracking technique using the Kinect sensor. The second phase is to enable networking using Agora.io. The last phase is to set up the holographic display using a projector before the evaluation phase. Based on the evaluation results, the life-size telepresence using holographic display application has succeeded in achieving the project aim and shown the life-size display increases the co-presence experience of the users and increases the efficient communication between the users.

show abstract

You as a Puppet

Cited by 36 publications

References 26 publications

Digital Full-Face Mask Display with Expression Recognition using Embedded Photo Reflective Sensor Arrays

Digital Full-Face Mask Display with Expression Recognition using Embedded Photo Reflective Sensor Arrays

Preserving Cultural Heritage Through AI: Developing LeNet Architecture for Wayang Image Classification

Life-size telepresence using holographic display

Contact Info

Product

Resources

About