Interactive Competitive Breadth-First Exploration for Sketch Interpretation

Abstract

In this paper, we present a new generic method for an interactive interpretation of sketches. This method is based on a competitive breadth-first exploration of the analysis tree. As opposed to well known structural approaches, this method allows to evaluate simultaneously several possible hypotheses of recognition in a dynamic local context of document. At each step of the analysis, the decision process selects the best hypotheses. If it detects an ambiguity, it will solicit the user to select the right hypothesis. In fact, the user participation has a great impact to avoid error accumulation during the analysis step and overcomes the combinatory due to the sketch complexity. This paper demonstrates this interactive method on 2D architectural floor plans.

Incremental Learning for Interactive Sketch Recognition

“…In this section, we summarize our interactive method of structured document interpretation (referred as IMISketch) [5] in which we propose to integrate our incremental classifier. This analyzer is based on the following characteristics:…”

“…To avoid the verification phase on the one hand, and avoid error accumulation during the analysis step on the other hand, we proposed an interactive method of analysis of off-line structured document where the decision process solicits the user if necessary. In our previous work [5], the role of user was limited to validate the right hypothesis and then unlock a situation where the decision process is not sure to make the right decision. In summary, the process can solicit the user to be sure to make the correct decision.…”

Application of the Resources Model to the Supervision of an Automated Process

“…The specific functionality we tested here is the software's ability to highlight areas carrying a risk of error. Our software is able to assign a likelihood score to each of its symbol interpretations, that is, to assess its own risk of error for each interpretation (Ghorbel, Almaksour, Lemaitre, & Anquetil, 2011;Ghorbel, Macé, Lemaitre, & Anquetil, 2011).…”

Optimization Analysis Based on a Breadth-First Exploration for a Structural Approach of Sketches Interpretation

“…While syntactic approaches can bring out the structural elements of the analysis document, statistical approaches provide a better ability to incorporate uncertainty. Our recent work [5] is focused on designing a new approach for interpreting documents, described as interactive. While most syntactic approaches are based on a depthfirst exploration for interpreting structured document [2], we focused on the development of a breadth-first exploration allowing a confrontation, between several competitive hypotheses of interpretation for targeted context analysis.…”

“…While most syntactic approaches are based on a depthfirst exploration for interpreting structured document [2], we focused on the development of a breadth-first exploration allowing a confrontation, between several competitive hypotheses of interpretation for targeted context analysis. This strategy explicitly incorporate, if necessary, the user in the loop of analysis to raise ambiguities recognition [5], or to enrich the a priori knowledge of the system [6]. The user integration in the recognition loop avoids a fastidious a posteriori correction of errors recognition while allowing to have an auto-evolving system for interpreting sketches.…”