Automatic generation of multimodal weather reports from datasets

Kerpedjiev, Stephan

doi:10.3115/974499.974509

Cited by 17 publications

(11 citation statements)

References 6 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…[34,41,52,63]) generate both forms of presentation from a common representation and therefore can explicitly address the problem of media choice and coordination.…”

Section: Related Researchmentioning

confidence: 99%

Plan-based integration of natural language and graphics generation

Wahlster

André

Finkler

et al. 1993

Artificial Intelligence

107

View full text Add to dashboard Cite

Multimodal interfaces combining natural language and graphics take advantage of both the individual strength of each communication mode and the fact that several modes can be employed in parallel. The central claim of this paper is that the generation of a multimodal presentation can be considered as an incremental planning process that aims to achieve a given communicative goal. We describe the multimodal presentation system WIP which allows the generation of alternate presentations of the same content taking into account various contextual factors. We discuss how the plan-based approach to presentation design can be exploited so that graphics generation influences the production of text and vice versa. We show that wellknown concepts from the area of natural language processing like speech acts, anaphora, and rhetorical relations take on an extended meaning in the context of multimodal communication. Finally, we discuss two detailed examples illustrating and reinforcing our theoretical claims.

show abstract

“…[34,41,52,63]) generate both forms of presentation from a common representation and therefore can explicitly address the problem of media choice and coordination.…”

Section: Related Researchmentioning

confidence: 99%

Plan-based integration of natural language and graphics generation

Wahlster

André

Finkler

et al. 1993

Artificial Intelligence

107

View full text Add to dashboard Cite

show abstract

“…Unlike previous projects, which used generated text to provide explanations for graphical devices ( [18], [19]) or as an alternative means of describing data ( [20], [21]), our emphasis is on text generated interactively as a response to the user interaction with the visual display.…”

Section: Related Workmentioning

confidence: 99%

Multi-modal presentation of medical histories

Hallett

2008

Proceedings of the 13th International Conference on Intelligent User Interfaces

View full text Add to dashboard Cite

This paper describes a visualisation architecture that integrates graphical devices and natural language in a cooperative system for navigating through complex images of medical histories. We show how the addition of automatically generated natural language can be used to improve the usability of a graphical user interface and conversely how the graphical user interface can be used to specify the content of user customizable medical reports.

show abstract

“…For example, our method shares some general ideas about presentation planning and rhetorical relations as it is done by WIP Wahlster, André, Finkler, Profitlich, & Rist, 1993) and COMET (McKeown & Feiner, 1990). The system of Kerpedjiev in the field of meteorology (Kerpedjiev, 1992) follows a similar planning approach. The goal of COMET and WIP is to generate text explanations accompanied with static illustrations that help users to manipulate a device (e.g., a radio receiver-transmitter or a coffee machine).…”

Section: Related Workmentioning

confidence: 99%

Generating multimedia presentations that summarize the behavior of dynamic systems using a model-based approach

Molina

Flores

2012

Expert Systems with Applications

View full text Add to dashboard Cite

a b s t r a c tThis article describes a knowledge-based method for generating multimedia descriptions that summarize the behavior of dynamic systems. We designed this method for users who monitor the behavior of a dynamic system with the help of sensor networks and make decisions according to prefixed management goals. Our method generates presentations using different modes such as text in natural language, 2D graphics and 3D animations. The method uses a qualitative representation of the dynamic system based on hierarchies of components and causal influences. The method includes an abstraction generator that uses the system representation to find and aggregate relevant data at an appropriate level of abstraction. In addition, the method includes a hierarchical planner to generate a presentation using a model with discourse patterns. Our method provides an efficient and flexible solution to generate concise and adapted multimedia presentations that summarize thousands of time series. It is general to be adapted to different dynamic systems with acceptable knowledge acquisition effort by reusing and adapting intuitive representations. We validated our method and evaluated its practical utility by developing several models for an application that worked in continuous real time operation for more than 1 year, summarizing sensor data of a national hydrologic information system in Spain.

show abstract

Automatic generation of multimodal weather reports from datasets

Cited by 17 publications

References 6 publications

Plan-based integration of natural language and graphics generation

Plan-based integration of natural language and graphics generation

Multi-modal presentation of medical histories

Generating multimedia presentations that summarize the behavior of dynamic systems using a model-based approach

Contact Info

Product

Resources

About