Handwriting Prediction Considering Inter-Class Bifurcation Structures

Yamagata, Masaki; Hayashi, H.; Uchida, Seiichi

doi:10.1109/icfhr2020.2020.00029

Cited by 2 publications

(2 citation statements)

References 13 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Another classifier combination approach is also used in the work of Chen et al [6], they designed length-dependent classifiers and a reject system based on the confidence scores and repetition of prediction. Yamagata et al [9] designed an approach explicitly modeling the trajectory bifurcations between handwritten digits, an LSTM network is used to predict class and the future trajectory. Recently, a new approach based on a 3D Convolutional Neural Network (CNN) called OLT-C3D (for Online Long-Term Convolutional 3D) [7] has been designed to handle long-term visibility without the need of any recurrence layer thanks to temporal dilated convolutions.…”

Section: Related Workmentioning

confidence: 99%

Early Recognition of Untrimmed Handwritten Gestures with Spatio-Temporal 3D CNN

Mocaër

Anquetil

Kulpa³

2022

2022 26th International Conference on Pattern Recognition (ICPR)

View full text Add to dashboard Cite

Early recognition of untrimmed handwritten gestures is the task of recognizing as soon as possible gestures drawn in a continuous stream, one after another. This is particularly challenging for multi-touch gestures because it is impossible to know when the gesture has started and finished. For mono-stroke gestures, in an application context where the finger is never removed from the device between gestures, the recognition is even more complex. In this work we present an extension of the Online Long-Term Convolutional 3D (OLT-C3D) network to address the task of early recognition of untrimmed gestures which have been addressed by very few works. To evaluate our approach, we created two synthetic datasets using freely available benchmarks, MTGSetB and ILGDB, simulating the streaming data in two different application scenarios. Furthermore, we propose a new evaluation metric for this specific task. Our approach achieves good performances on the two new datasets and will be a baseline for future works on this challenging task.

show abstract

Section: Related Workmentioning

confidence: 99%

Early Recognition of Untrimmed Handwritten Gestures with Spatio-Temporal 3D CNN

Mocaër

Anquetil

Kulpa³

2022

2022 26th International Conference on Pattern Recognition (ICPR)

View full text Add to dashboard Cite

show abstract

“…Chen et al [4] addressed the task by using a combination of length-dependent classifiers and a system of reject based on the confidence scores of the classifiers and repetition of prediction. Recently, Yamagata et al [20] proposed an approach to do handwriting prediction which learns the bifurcations of gestures based on an LSTM network.…”

Section: Related Workmentioning

confidence: 99%

Online Spatio-temporal 3D Convolutional Neural Network for Early Recognition of Handwritten Gestures

Mocaër

Anquetil

Kulpa

2021

Document Analysis and Recognition – ICDAR 2021

View full text Add to dashboard Cite

Inspired by recent spatio-temporal Convolutional Neural Networks in computer vision field, we propose OLT-C3D (Online Long-Term Convolutional 3D), a new architecture based on a 3D Convolutional Neural Network (3D CNN) to address the complex task of early recognition of 2D handwritten gestures in real time. The input signal of the gesture is translated into an image sequence along time with the trajectory history. The image sequence is passed into our 3D CNN OLT-C3D which gives a prediction at each new frame. OLT-C3D is coupled with an integrated temporal reject system to postpone the decision in time if more information is needed. Moreover our system is end-to-end trainable, OLT-C3D and the temporal reject system are jointly trained to optimize the earliness of the decision. Our approach achieves superior performances on two complementary and freely available datasets: ILGDB and MTGSetB.

show abstract

Handwriting Prediction Considering Inter-Class Bifurcation Structures

Cited by 2 publications

References 13 publications

Early Recognition of Untrimmed Handwritten Gestures with Spatio-Temporal 3D CNN

Early Recognition of Untrimmed Handwritten Gestures with Spatio-Temporal 3D CNN

Online Spatio-temporal 3D Convolutional Neural Network for Early Recognition of Handwritten Gestures

Contact Info

Product

Resources

About