Fully automatic user interface generation from discourse models

Falb, Jürgen; Kavaldjian, Sevan; Popp, Roman; Raneburger, David; Arnautovic, Edin; Kaindl, Hermann

doi:10.1145/1502650.1502722

Cited by 23 publications

(10 citation statements)

References 6 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…We implemented and tested the algorithm as part of our UI generation framework [5]. It turned out while implementing the algorithm that it is more efficient to assemble the composite state machinet and immediately analyze it incrementally in each Discourse Model node compared to assembling the state machine for the whole Discourse Model upfront before analyzing it.…”

Section: Implementation and Generation Examplesmentioning

confidence: 99%

See 1 more Smart Citation

Automated WIMP-UI behavior generation: Parallelism and granularity of communication units

Raneburger

Popp

Kaindl

et al. 2011

2011 IEEE International Conference on Systems, Man, and Cybernetics

Self Cite

View full text Add to dashboard Cite

Automated generation of Window / Icon / Menu / Pointing Device User Interfaces (WIMP UIs) has some potential, but there are still many unresolved issues involved, that lead, e.g., to usability problems. In particular, there are several problems concerning the derivation of behavior models of such user interfaces from a high-level interaction model. These problems are related to parallelism and granularity of communication units. In this paper, we present a new process for the automated derivation of a WIMP-UI behavior model from a given high-level Discourse Model. Our new process can handle parallelism in these models and supports different granularities of communication units. This solves certain problems of WIMP-UI generation related to behavior models.

show abstract

Section: Implementation and Generation Examplesmentioning

confidence: 99%

“…The Discourse-based approach [4], [5], [14] models interaction in the form of classes of dialogues. The intention of an interaction is captured by Communicative Acts that will be uttered (i.e., sent) by either the user or the system.…”

Section: Introductionmentioning

confidence: 99%

Automated WIMP-UI behavior generation: Parallelism and granularity of communication units

Raneburger

Popp

Kaindl

et al. 2011

2011 IEEE International Conference on Systems, Man, and Cybernetics

Self Cite

View full text Add to dashboard Cite

show abstract

“…However, we use a different data analysis approach, directed by the discourse planning process; and we produce multimedia presentations. Our system can also be related partially to user interface generation using high level models [8]. Compared to this, our solution also uses high level models (discourse plans with rhetorical relations) to genérate output presentations.…”

Section: Applications and Related Workmentioning

confidence: 99%

Using the Journalistic Metaphor to Design User Interfaces That Explain Sensor Data

Molina

Parodi

Stent

2011

Human-Computer Interaction – INTERACT 2011

View full text Add to dashboard Cite

Abstract.Facilitating general access to data from sensor networks (including traffic, hydrology and other domains) increases their utility. In this paper we argüe that the journalistic metaphor can be effectively used to automatically genérate multimedia presentations that help non-expert users analyze and understand sensor data. The journalistic layout and style are familiar to most users. Furthermore, the journalistic approach of ordering information from most general to most specific helps users obtain a high-level understanding while providing them the freedom to choose the depth of analysis to which they want to go. We describe the general characteristics and architectural requirements for an interactive intelligent user interface for exploring sensor data that uses the journalistic metaphor. We also describe our experience in developing this interface in real-world domains (e.g., hydrology).

show abstract

“…Several application scenarios may use this adaptable presentation planning process, which has presentation parameters to encode user preferences. Our fission approach is similar, but it is based on a modality-independent interaction design based on discourses [4], which we also use for semi-automatic generation of modality fusion [2] and multimodal UIs [1].…”

Section: A Fission For Multimodal User Interfacesmentioning

confidence: 99%

“…It does not really matter in principle, whether this implementation is hand-crafted or semi-automatically generated. In fact, we have already developed a (modeldriven) approach for semi-automatic generation of WIMP interfaces [4]. It currently leads to a final implementation of the UI in Java Swing.…”

Section: Modalities For Our Fission Approachmentioning

confidence: 99%

Semi-automatically Configured Fission for Multimodal User Interfaces

Ertl

Falb

Kaindl

2010

2010 Third International Conference on Advances in Computer-Human Interactions

Self Cite

View full text Add to dashboard Cite

Fission of several output modalities poses hard problems, and (semi-)automatically configuring it is even more difficult. However, it is important to address the latter in order to broaden the scope of providing user interfaces semiautomatically.Our approach starts from a high-level discourse model created by a human interaction designer. It is modalityindependent, so a modality-annotated discourse model is semiautomatically generated. Based on it, our fission is semiautomatically configured. It currently supports output modalities graphical user interface, (canned) speech output, and a new modality that we call movement as communication. The latter involves movements of a semi-autonomous robot in 2D-space for reinforcing the communication of the other modalities.

show abstract

Fully automatic user interface generation from discourse models

Cited by 23 publications

References 6 publications

Automated WIMP-UI behavior generation: Parallelism and granularity of communication units

Automated WIMP-UI behavior generation: Parallelism and granularity of communication units

Using the Journalistic Metaphor to Design User Interfaces That Explain Sensor Data

Semi-automatically Configured Fission for Multimodal User Interfaces

Contact Info

Product

Resources

About