Abstmct : Tiris paper &scribes a pamllel computing system anda sofrwan algorithm for d -t i m e intemetion between a hlc man rserandsynthesizedmoving gol@sh images. Two realistic goldfish tgents appeming on a dsplay can recognize the palm position andfinger motion cfinger sign) of the mer, then respondto them in naltime. We have named this kind of intemetive agent a 'koftwam tvbot't A modcling named 'WSSM (BoneStnrtmdSolidModcler)'~ which is suitable for representing &-formable objects such 4~ living things, plays an important role in thesynthesis of realisticgoldfish inupge. To realize the maltime intemetion, we have cleveloped an image recognition and synthesis system 'TN-VIT (TmnspJer Network with Visual Interface for Tmnsp&etx)'! The i q e synthesis speedof the TN-VIT is abou t 25 fmnres per second including the finger-sign recognition process. The technology discussed in this paper is expectedto play an impottant mle in the realization offutloe visual human interfaces.
To realize a human-like software-robot for better human interface system, we must integrate the technologies of computer graphics, computer vision, speech recognition, voice synthesis and others. We have named this type of the software robot to be served in an advanced human interface system as important to realize real-time processing of several tasks to achieve the real-time response of the software robot. In this paper, we describe a real-time image recognition and image synthesis system, operators and changes his/her facial expressions in response to operator's hand shape in real-time. Therefore, the system recognizes hand shape of an operator, then synthesizes huaman facial expressions in real-time. The VIT is our original Transputer board with functional 32-bit parallel visual data bus. The maximum visual data transfer speed of our VIT is 100 Mbyte per second. The TN-VIT system consists of 16 VITs, 16 normal Tranputers, 1 personal computer, 1 CCD camera, 1 A/D board and 1 D/A board. The 16 VITs are connected as a ring-type bus, and 2 of them are used for image recognition and the rest of them are used for image synthesis. Experiments show that the TN-VIT system can synthesize natural moving human face images and his/her emotional expressions at 8 frames per second in response to the hand shape of an operator. Details of the hardware and software are described in this paper along with experimental results including some samples of original image and synthesized images.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.