Combining Text and Graphics for Interactive Exploration of Behavior Datasets

Abstract

Abstract-Modern sensor technologies and simulators applied to large and complex dynamic systems (such as road traffic networks, sets of river channels, etc.) produce large amounts of behavior data that are difficult for users to interpret and analyze. Software tools that generate presentations combining text and graphics can help users understand this data. In this paper we describe the results of our research on automatic multimedia presentation generation (including text, graphics, maps, images, etc.) for interactive exploration of behavior datasets. We designed a novel user interface that combines automatically generated text and graphical resources. We describe the general knowledge-based design of our presentation generation tool. We also present applications that we developed to validate the method, and a comparison with related work.

Using the Journalistic Metaphor to Design User Interfaces That Explain Sensor Data

“…It also included a preliminary versión of our architecture with domain specific knowledge bases and abstraction methods (more details about this application domain can be found at [16]). We have also applied our design partially to other domains: ship data from the VOSclim project [23], Twitter data with measures of sentiment [4], general geographical movements [17], and aircraft data [15]. As a result of fhese applications, we generalized some components of our design as they are described in this paper.…”