Eine Graphikkomponente zur Integration von Zeigehandlungen in natürlichsprachliche KI- Systeme

Allgayer, Jürgen

doi:10.1007/978-3-642-71388-0_22

Cited by 4 publications

(5 citation statements)

References 2 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The gesture-analyzing component TACTILUS (Allgayer, 1986) of the XTRA system has three tasks: it permits the interactive construction of forms, makes possible the input of simulated pointing gestures on a form and analyzes these gestures. Since the present domain is the assistance to a user filling in his/her income tax form, such a form has been constructed using TACTI-LUS.…”

Section: Simulation Of Pointing Gestures With Xtramentioning

confidence: 99%

Integration of communicative hand movements into human-computer-interaction

Schmauks

Wille

1991

Comput Hum

View full text Add to dashboard Cite

During face-to-face communication, the dialog partners can see and hear each other. Each speaker produces a variety of phenomena parallel to speech. Some of them, e.g. intonation, are coded vocally, others are coded by motor responses (facial expression, gestures, etc.). If human-computer-interaction (HCI) tries to mimic this situation, at least some non-verbal phenomena have to be integrated into natural language input and output. A multitude of new devices (mouse, joystick, touch-screens, etc.) have enabled this transition to multimodal HCI. Gestures which illustrate the content of the verbal message are especially suitable for integration into HCI. A relevant subset of them is pointing gestures, which specify elements of the visual context. They are performed frequently because their use shortens and simplifies the verbal output. As an illustration of these considerations, the NL dialog system XTRA (University of Dagmar Schmauks is a researcher in the AI laboratory at the University of Saarbriicken. She has pursued studies in philosophy, linguistics and psychology. Her doctoral thesis (1990) was entitled "Deixis in Man-Machine-Interaction." Since 1985 she has worked in a special collaborative program on AI and knowledge-based systems at the University of Saarbriicken. Her main research interest is multimedia interaction. Michael Wille is a researcher in the AI laboratory at the University of Saarbrficken. He has studied computer science, economics and cognitive psychology. He has worked on expert systems for SIEMENS (hardware diagnosis). His master's thesis (1989) was called "Evaluation and Extension of a Module for the Simulation and Analysis of Pointing Gestures." His main research interest is multimedia interaction.Computers and the Humanities 25: 129--140, 1991. © 1991 Saarbriicken) is presented. It allows reference to elements of a tax form by the combination of textual input and simulated pointing gestures. In order to explore the regularities of this "form deixis," an experiment has been carried out within the framework of the XTRA-project. Furthermore, its results were taken for an evaluation of the currently used simulation technique.

show abstract

Section: Simulation Of Pointing Gestures With Xtramentioning

confidence: 99%

Integration of communicative hand movements into human-computer-interaction

Schmauks

Wille

1991

Comput Hum

View full text Add to dashboard Cite

show abstract

“…In this loop, the possible gestures are processed by the analysis component TACTILUS-II (2) to simulate the user's understanding of the gesture. The first is the preprocessing phase which computes geometric features of the object to point at.…”

Section: The Gesture Generator Zoramentioning

confidence: 99%

“…2 As a complement to this kind of detailed and explicit model we can explore an abstract one, which is what I will do in this paper. The value of doing this is that we can then develop a very detailed and explicit model since we can simplify or set aside a number of the factors that have to be taken into consideration when we build lexical models.…”

Section: The Problem: Lexical Choice In Text Generationmentioning

confidence: 99%

“…2 It is interesting to note that in French, neither the manner of locomotion modifier nor the rate adverbial can be merged with the motion verb meaning in such sentences. But since they have distributed the same semantic material differently, they give rise to different direct lexicalizations.…”

Section: And (3b) Fred Hurried Across the Road With A Limpmentioning

confidence: 99%

“…There is very little for their generators to do in the way of lexical selection beyond reading out and artfully composing what has already been fixed within the underlying application program. 2 This paper presents a few steps towards a model of the place of words with respect to underlying conceptual representations and of the process of lexical choice. We can begin to see rationales for complex texts but cannot find legitimate sources or motivations for these rationales in the programs we have to work with.…”

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations