Aim:
Scientific, technical, and educational research domains all heavily rely on
handwritten mathematical expressions. The extensive use of online handwritten mathematical
expression recognition is a consequence of the availability of strong computational touchscreen
appliances, such as the recent development of deep neural networks as superior sequence
recognition models.
Background:
Further investigation and enhancement of these technologies are vital to tackle
the contemporary obstacles presented by the widespread adoption of remote learning and work
arrangements as a result of the global health crisis.
Objective:
Handwritten document processing has gained more attention in the last ten years
due to notable developments in deep neural network-based computer vision models and sequence
recognition, as well as the widespread proliferation of touch and pen-enabled
smartphones and tablets. It comes naturally to people to write by hand in daily interactions.
Method:
In this patent article, authors implemented Hand written expressions using RNNbased
encoder for the CROHME dataset. Later, the proposed model was validated using CNNbased
encoder and End-to-end encoder decoder techniques. The proposed model is also validated
on other datasets.
Results:
The RNN-based encoder model yields 82.78%, while the CNN-based encoder model
and end-to-end encoder-decoder technique yield 81.38% and 80.73%, respectively.
Conclusion:
1.6% accuracy improvement was attained over CNN-based encoder while 2.4%
accuracy improvement over end-to-end encoder-decoder. CROHME dataset 2019 version results
in better accuracy than other datasets.