Effect of robot operation by a camera with the eye tracking control

Minamoto, Masahiko; Suzuki, Yutaro; Kanno, Takahiro; Kawashima, Kenji

doi:10.1109/icma.2017.8016122

Search citation statements

Order By: Relevance

Paper Sections

Select...

Introduction1

Citation Types

Supporting

Mentioning

Contrasting

Year Published

2018

2023

Publication Types

Select...

Other4

Article2

Relationship

Self Cite1

Independent5

Authors

Journals

Cited by 12 publications

(1 citation statement)

References 9 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Interfaces that can be used to operate robots using eye tracking have been proposed. (9)(10)(11)(12)(13)(14) However, controlling zoom in and out of the camera is difficult with eye tracking.…”

Section: Introductionmentioning

confidence: 99%

Detection of Head Motion from Facial Feature Points Using Deep Learning for Tele-operation of Robot

Minamoto¹,

Hori²,

Kobayashi³

et al. 2020

Sensors and Materials

Self Cite

View full text Add to dashboard Cite

We propose an interface for the tele-operation of a laparoscope-holder robot via head movement using facial feature point detection. Fourteen feature points on the operator's face are detected using a camera. The vertical and horizontal rotation angles and the distance between the face and the camera are estimated from the points using deep learning. The training data for deep learning are obtained using a dummy face. The root-mean-square error (RMSE) between the estimated and directly measured values is calculated for different numbers of nodes, layers, and epochs, and suitable numbers are determined from the RMSE values. The trained data are evaluated with four subjects. The effectiveness of the proposed method is demonstrated experimentally.

show abstract