Yet another gaze detector: An embodied calibration free system for the iCub robot

Schillingmann, Lars; Nagai, Yukie

doi:10.1109/humanoids.2015.7363515

Cited by 15 publications

(11 citation statements)

References 15 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Figure 3) displayed on a screen in the kitchen area of the smart apartment. The agent is able to detect faces and estimate the current visual focus of attention of the human interaction partner [43] with the help of a web-cam installed on top of the screen.…”

Section: Methodsmentioning

confidence: 99%

Interactive Hesitation Synthesis: Modelling and Evaluation

Betz

Carlmeyer

Wagner

et al. 2018

MTI

View full text Add to dashboard Cite

Abstract:Conversational spoken dialogue systems that interact with the user rather than merely reading the text can be equipped with hesitations to manage dialogue flow and user attention. Based on a series of empirical studies, we elaborated a hesitation synthesis strategy for dialogue systems, which inserts hesitations of a scalable extent wherever needed in the ongoing utterance. Previously, evaluations of hesitation systems have shown that synthesis quality is affected negatively by hesitations, but that they result in improvements of interaction quality. We argue that due to its conversational nature, hesitation synthesis needs interactive evaluation rather than traditional mean opinion score (MOS)-based questionnaires. To validate this claim, we dually evaluate our system's speech synthesis component, on the one hand, linked to the dialogue system evaluation, and on the other hand, in a traditional MOS way. We are thus able to analyze and discuss differences that arise due to the evaluation methodology. Our results suggest that MOS scales are not sufficient to assess speech synthesis quality, leading to implications for future research that are discussed in this paper. Furthermore, our results indicate that synthetic hesitations are able to increase task performance and that an elaborated hesitation strategy is necessary to avoid likability issues.

show abstract

Section: Methodsmentioning

confidence: 99%

Interactive Hesitation Synthesis: Modelling and Evaluation

Betz

Carlmeyer

Wagner

et al. 2018

MTI

View full text Add to dashboard Cite

show abstract

“…In the original RT-GENE work, this sub-dataset is used to train the GANs that "remove" the eyetracking glasses from the subject's face. [29] and Schillingmann and Nagai [40], rely on features extracted by SIFT and HOG with a subsequent classification stage. However, the accuracy of these methods is reduced for extreme head angles and under varying skin colour and illumination.…”

Section: Related Workmentioning

confidence: 99%

“…Joint blink and gaze estimation There have been several preliminary works to integrate gaze estimation and blink detection in unified frameworks. Schillingmann and Nagai [40] use HOG features for both pupil location estimation and blink detection. Similarly, Chen et al [7] employ a heuristic based on the shape of the iris area.…”

Section: Related Workmentioning

confidence: 99%

RT-BENE: A Dataset and Baselines for Real-Time Blink Estimation in Natural Environments

Cortacero

Fischer

Demiris

2019

2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW)

View full text Add to dashboard Cite

In recent years gaze estimation methods have made substantial progress, driven by the numerous application areas including human-robot interaction, visual attention estimation and foveated rendering for virtual reality headsets. However, many gaze estimation methods typically assume that the subject's eyes are open; for closed eyes, these methods provide irregular gaze estimates. Here, we address this assumption by first introducing a new open-sourced dataset with annotations of the eye-openness of more than 200,000 eye images, including more than 10,000 images where the eyes are closed. We further present baseline methods that allow for blink detection using convolutional neural networks. In extensive experiments, we show that the proposed baselines perform favourably in terms of precision and recall. We further incorporate our proposed RT-BENE baselines in the recently presented RT-GENE gaze estimation framework where it provides a real-time inference of the openness of the eyes. We argue that our work will benefit both gaze estimation and blink estimation methods, and we take steps towards unifying these methods.

show abstract

“…To assess the gaze direction of currently observable persons the gaze detector from Schillingmann et al [29] is used. The implementation was extended to be able to receive video data via ROS and publish its results, containing relative gaze directions and face landmarks [19] for all observed persons via RSB for further processing.…”

Section: Addressee Recognitionmentioning

confidence: 99%

Are you talking to me?

Richter

Carlmeyer

Lier

et al. 2016

Proceedings of the Fourth International Conference on Human Agent Interaction

View full text Add to dashboard Cite

In this paper, we present our humanoid robot Meka, participating in a multi party human robot dialogue scenario. Active arbitration of the robot's attention based on multi-modal stimuli is utilised to observe persons which are outside of the robots field of view. We investigate the impact of this attention management and addressee recognition on the robot's capability to distinguish utterances directed at it from communication between humans. Based on the results of a user study, we show that mutual gaze at the end of an utterance, as a means of yielding a turn, is a substantial cue for addressee recognition. Verification of a speaker through the detection of lip movements can be used to further increase precision. Furthermore, we show that even a rather simplistic fusion of gaze and lip movement cues allows a considerable enhancement in addressee estimation, and can be altered to adapt to the requirements of a particular scenario.

show abstract

Yet another gaze detector: An embodied calibration free system for the iCub robot

Cited by 15 publications

References 15 publications

Interactive Hesitation Synthesis: Modelling and Evaluation

Interactive Hesitation Synthesis: Modelling and Evaluation

RT-BENE: A Dataset and Baselines for Real-Time Blink Estimation in Natural Environments

Are you talking to me?

Contact Info

Product

Resources

About