A model-based recognition engine for sketched diagrams

Abstract

Many of today's recognition approaches for hand-drawn sketches are feature-based, which is conceptually similar to the recognition of hand-written text. While very suitable for the latter (and more tasks, e.g., for entering commands), such approaches do not easily allow for clustering and segmentation of strokes, which is crucial to their recognition. This results in applications which do not feel natural but impose artificial restrictions on the user regarding how diagrams and single components are to be drawn.In this paper we propose a recognition approach based on models, which is designed for the mentioned issue of clustering and segmentation. All strokes are fed into different models, where each model is responsible for a certain type of primitive, e.g., a line or an arc. The recognition of a component in the drawing is then decomposed into the recognition of its primitives, which can be directly searched for in the models. Finally, the identified primitives are assembled to the complete component.In several case studies we also show the applicability and generality of our approach, as very different types of components can be recognized. Furthermore, the proposed approach is part of a complete system to sketch understanding which can not only recognize single components, but can also reason about diagrams as a whole, consisting of a set of these components.

Pattern-based development of Domain-Specific Modelling Languages

“…Many tools to develop graphical tools for different applications have emerged along the years, like meta-CASE tools [22], diagram sketching [7], or multi-formalism modelling and simulation [12]. The advent of Eclipse has promoted frameworks to build visual editors as plugins, like GMF [16], Eugenia [23], Spray [31], Graphiti [18], or Sirius [29].…”

Módulo de generación de aplicaciones multi-dispositivo a partir del procesamiento de imágenes

“…En [20] se propuso un concepto y la arquitectura de un producto genérico basado en un reconocedor geométrico para la agrupación y segmentación de trazos. Reconoce componentes individuales, diagramas esbozados como un conjunto y permite resolver las ambigüedades mediante análisis sintáctico y semántico.…”

Towards the Generation of Graphical Modelling Environments Aided by Patterns

“…There are many tools to develop graphical modelling environments for different applications, like meta-CASE tools [8], diagram sketching [3] or multi-formalism modelling and simulation [4]. The advent of Eclipse has promoted frameworks to construct visual editors as plugins, like Tiger [1], GMF [6], Eugenia [9], Spray [11], Graphiti [7], or Sirius [10].…”