Gaze-based interaction in various environments

Bardins, Stanislavs; Poitschke, Tony; Kohlbecher, Stefan

doi:10.1145/1461893.1461903

Cited by 23 publications

(10 citation statements)

References 9 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…This projection unit is also used to provide the next assembly instructions in an ergonomic way. However, an additional input channel was setup by introducing eye-tracking glasses, as presented and discussed in [131], into this working environment. This allows the human worker to enable system functionalities by the use of gaze information or to select options by simply looking at the buttons.…”

Section: A Human-robot Cooperation 1) Motivationmentioning

confidence: 99%

Artificial Cognition in Production Systems

Bannat¹,

Bautze²,

Beetz³

et al. 2011

IEEE Trans. Automat. Sci. Eng.

103

View full text Add to dashboard Cite

Abstract-Today's manufacturing and assembly systems have to be flexible to adapt quickly to an increasing number and variety of products, and changing market volumes. To manage these dynamics, several production concepts (e.g., flexible, reconfigurable, changeable or autonomous manufacturing and assembly systems) were proposed and partly realized in the past years. This paper presents the general principles of autonomy and the proposed concepts, methods and technologies to realize cognitive planning, cognitive control and cognitive operation of production systems. Starting with an introduction on the historical context of different paradigms of production (e.g., evolution of production and planning systems), different approaches for the design, planning, and operation of production systems are lined out and future trends towards fully autonomous components of an production system as well as autonomous parts and products are discussed. In flexible production systems with manual and automatic assembly tasks, human-robot cooperation is an opportunity for an ergonomic and economic manufacturing system especially for low lot sizes. The state-of-the-art and a cognitive approach in this area are outlined. Furthermore, introducing self-optimizing and self-learning control systems is a crucial factor for cognitive systems. This principles are demonstrated by a quality assurance and process control in laser welding that is used to perform improved quality monitoring. Finally, as the integration of human workers into the workflow of a production system is of the highest priority for an efficient production, worker guidance systems for manual assembly with environmentally-and situationally dependent triggered paths on state-based graphs are described in this paper.Note to Practitioners-Today's manufacturing enterprises have to face a number of challenges in a turbulent environment that originates amongst other from saturated markets, unprecedented and abrupt changes in market demands, an ever increasing number of product variants and smaller lot sizes. A recent research trend in Germany is the so called Cognitive Factory, where artificial cognitive capabilities are introduced to the control of production systems. The applications range from production planning and control, human-robot-cooperation, automatic robot programming to intuitive worker guidance systems.The concept of fully automated production systems is no longer a viable vision, as it has been shown, that the conventional automa- tion is not able to deal with the ever-rising complexity of modern production systems. Especially, a high reactivity, agility and adaptivity that is required by modern production systems, can only be reached by human operators with their immense cognitive capabilities, which enable them to react to unpredictable situations, to plan their further actions, to learn and to gain experience and to communicate with others. Thus, new concepts are required, that apply these cognitive principles to the planning processes and control systems of pr...

show abstract

Section: A Human-robot Cooperation 1) Motivationmentioning

confidence: 99%

Artificial Cognition in Production Systems

Bannat¹,

Bautze²,

Beetz³

et al. 2011

IEEE Trans. Automat. Sci. Eng.

103

View full text Add to dashboard Cite

show abstract

“…This is also evidenced by an increasing amount of papers and projects discussing various concepts, interaction techniques, and experiments related to eye gaze as an input modality [2,7,8,11,13]. In addition, eye tracking-related conferences (e.g., ETRA and NGCA) and workshops (e.g., IWGSI, IUI, PETMEI, and DUET) have proliferated, indicating increased interest and growth of the research community.…”

Section: Related Venues and Workhop Objectivesmentioning

confidence: 97%

Gaze interaction in the Post-WIMP world

Bulling

Dachselt

Duchowski

et al. 2013

CHI '13 Extended Abstracts on Human Factors in Computing Systems

View full text Add to dashboard Cite

This workshop is a follow-up to our successful Special Interest Group (SIG) meeting at CHI '12. The SIG focused on eye gaze as a highly effective, seamless, and fast means of human-computer interaction in various contexts, but showed that suitable applications and overall convenience are still lacking. Consequently, we see an expressive need for continued in-depth discussion on how the diversity of application contexts could specifically benefit from the incorporation of the user's gaze. In this regard, we concentrate on gaze interaction in combination with post-WIMP interaction styles as opposed to traditional desktop setups to broaden the view for novel ways to interact with eye gaze. The objective of the CHI '13 workshop is to further promote this emerging field by addressing fundamental research questions regarding novel gaze-based interaction in the post-WIMP world. Novel ways of interaction are fueled by continuous advancement of eye tracking technology offering new opportunities for incorporating eye gaze as a supporting input modality. However, while eye tracking technology is improving and the general course of research is clear (e.g., calibration-free and even mobile gaze tracking), a clear vision of gaze as an interaction modality is missing. To foster novel means of interaction, a number of issues need to be carefully dissected, including aspects of interaction design, technological development, evaluation issues as well as of privacy and of social implications. The goal of this workshop is to bring together researchers and practitioners who are concerned with the design, development, and implementation of new applications and services combining gaze with other input modalities. Keywords Related Venues and Workshop ObjectivesIn recent years, the interest in gaze-based interaction has increased as more comfortable, affordable and precise tracking systems become available [1,4]. This is also evidenced by an increasing amount of papers and projects discussing various concepts, interaction techniques, and experiments related to eye gaze as an input modality [2,7,8,11,13]. In addition, eye tracking-related conferences (e.g., ETRA and NGCA) and workshops (e.g., IWGSI, IUI, PETMEI, and DUET) have proliferated, indicating increased interest and growth of the research community. While these venues are all related to eye tracking, the topics are often specialized, focusing on improved tracking algorithms, human machine communication, pervasive eye tracking and mobile eye-based interaction, and gaze-controlled applications. The SIGGRAPH 2010 course on gaze input in games and Special Interest Groups (SIGs) at CHI 2011 and CHI 2012 suggest a need for discussing gaze as an input modality in a more general sense.At our CHI '12 SIG we emphasized the need for more indepth discussions on gaze as a supplementary interaction modality in the post-WIMP world, including various application areas. However, the time slot of the SIG only allowed us to scratch the surface, identifying several interesting application ex...

show abstract

“…A third camera is used to record the scene for acquiring the transformation matrix between the head related gaze vector and the world coordinate system to extract gaze in space information. More details on the used hardware and methods for the gaze-based interaction can be found in [26]. This gaze information provides a cue for the current focus of attention of the user.…”

Section: Multi-modal In-and Outputmentioning

confidence: 99%

A skill-based approach towards hybrid assembly

Wallhoff

Blume

Bannat

et al. 2010

Advanced Engineering Informatics

View full text Add to dashboard Cite

a b s t r a c tEfficient cooperation of humans and industrial robots is based on a common understanding of the task as well as the perception and understanding of the partner's action in the next step. In this article, a hybrid assembly station is presented, in which an industrial robot can learn new tasks from worker instructions. The learned task is performed by both the robot and the human worker together in a shared workspace. This workspace is monitored using multi-sensory perception for detecting persons as well as objects. The environmental data are processed within the collision avoidance module to provide safety for persons and equipment. The real-time capable software architecture and the orchestration of the involved modules using a knowledge-based system controller is presented. Finally, the functionality is demonstrated within an experimental cell in a real-world production scenario.

show abstract

Gaze-based interaction in various environments

Cited by 23 publications

References 9 publications

Artificial Cognition in Production Systems

Artificial Cognition in Production Systems

Gaze interaction in the Post-WIMP world

A skill-based approach towards hybrid assembly

Contact Info

Product

Resources

About