Multimodal Interaction Techniques in Scientific Data Visualization - An Analytical Survey

Abstract

The interpretation process of complex data sets makes the integration of effective interaction techniques crucial. Recent work in the field of human-computer interaction has shown that there is strong evidence that multimodal user interaction, i.e. the integration of various input modalities and interaction techniques into one comprehensive user interface, can improve human performance when interacting with complex data sets. However, it is still unclear which factors make these user interfaces superior to unimodal user interfaces. The contribution of this work is an analytical comparison of a multimodal and a unimodal user interface for a scientific visualization application. We show that multimodal user interaction with simultaneously integrated speech and gesture input improves user performance regarding efficiency and ease of use.

Visualisation for ontology sense-making: A tree-map based algorithmic approach

“…These categories are namely; force-directed, radial, inverted-radial, circular and tree-maps. Radial, inverted-radial, and circular layouts are criticised for their excessive space wastage, rotated text representation and loss of hierarchical structure, which cause additional cognitive overload on the user for the realizations [6], [7]. Similarly, force-directed method also causes information losses [6].…”

“…Moreover, all these features contribute towards effective handling of "scale versus information problem" that was already discussed. Hence, the tree-map layout has been effectively used for the visualisation of the concepts of Gene Ontology as many users have commended, due to its capability of reducing the cognitive overload [6], [8], [15], [24]- [26].…”

“…Furthermore, tree-maps preserve the hierarchical organisation of the information schemata and make the comprehension easier even for the non-technical specialists facilitated via the traversal interaction experience [6], [8], [15], [24]- [26]. Multiple literatures [27]- [29] have depicted that, tree-maps visualisation techniques can be fine-tuned to address most of the aforementioned requirements, since these are identified as a layout-based visualisation mechanism with the screen space-filling capability.…”

“…This paper discusses the existing challenges associated with ontology visualisation and proposes a resolution to overcome existing challenges. As elaborated in the related work section beneath, among multiple visualization techniques, tree-maps are commended for their drill down enabled traversal facility and knowledge abstraction aspects contributing for the simplicity [6], [7]. Hence, the main objective of this research is to propose a fully automated tree-map generation algorithm, which can function regardless of the domain or the schemata to facilitate ontology sense making.…”

Visualisation for ontology sense-making: A tree-map based algorithmic approach

“…3D is not a good solution for ontology visualization requirements, since it causes stress escalation and cognitive overload to the users [6]- [8].…”