No abstract

No abstract

To build smart human interfaces, it is necessary for a system to know a user's intention and point of attention. Since the motion of a person's head pose and gaze direction are deeply related with his/her intention and attention, detection of such information can be utilized to build natural and intuitive interfaces.In this paper, we describe our real-time stereo face tracking and gaze detection system to measure head pose and gaze direction simultaneously. The key aspect of our system is the use of real-time stereo vision together with a simple algorithm which is suitable for real-time processing. Since the 3D coordinates of the features on a face can be directly measured in our system, we can significantly simplify the algorithm for 3D model fitting to obtain the full 3D pose of the head compared with conventional systems that use monocular camera. Consequently we achieved a non-contact, passive, real-time, robust, accurate and compact measurement system for head pose and gaze direction.

Internal (neuronal) representations in the brain are modified by our experiences, and this phenomenon is not unique to sensory and motor systems. Here, we show that different impressions obtained through social interaction with a variety of agents uniquely modulate activity of dorsal and ventral pathways of the brain network that mediates human social behavior. We scanned brain activity with functional magnetic resonance imaging (fMRI) in 16 healthy volunteers when they performed a simple matching-pennies game with a human, human-like android, mechanical robot, interactive robot, and a computer. Before playing this game in the scanner, participants experienced social interactions with each opponent separately and scored their initial impressions using two questionnaires. We found that the participants perceived opponents in two mental dimensions: one represented "mind-holderness" in which participants attributed anthropomorphic impressions to some of the opponents that had mental functions, while the other dimension represented "mind-readerness" in which participants characterized opponents as intelligent. Interestingly, this "mind-readerness" dimension correlated to participants frequently changing their game tactic to prevent opponents from envisioning their strategy, and this was corroborated by increased entropy during the game. We also found that the two factors separately modulated activity in distinct social brain regions. Specifically, mind-holderness modulated activity in the dorsal aspect of the temporoparietal junction (TPJ) and medial prefrontal and posterior paracingulate cortices, while mind-readerness modulated activity in the ventral aspect of TPJ and the temporal pole. These results clearly demonstrate that activity in social brain networks is modulated through pre-scanning experiences of social interaction with a variety of agents. Furthermore, our findings elucidated the existence of two distinct functional networks in the social human brain. Social interaction with anthropomorphic or intelligent-looking agents may distinctly shape the internal representation of our social brain, which may in turn determine how we behave for various agents that we encounter in our society.

The feasibility and preliminary efficacy of an android robot-mediated mock job interview training in terms of both bolstering self-confidence and reducing biological levels of stress in comparison to a psycho-educational approach human interview was assessed in a randomized study. Young adults (ages 18–25 years) with autism spectrum disorder (ASD) were randomized to participate either in a mock job interview training with our android robot system (n = 7) or a self-paced review of materials about job-interviewing skills (n = 8). Baseline and outcome measurements of self-reported performance/efficacy and salivary cortisol were obtained after a mock job interview with a human interviewer. After training sessions, individuals with ASD participating in the android robot-mediated sessions reported marginally improved self-confidence and demonstrated significantly lower levels of salivary cortisol as compared to the control condition. These results provide preliminary support for the feasibility and efficacy of android robot-mediated learning.