Scene Text Recognition: An Overview

Liang, Shiqi; Bi, Ning; Tan, Jun

doi:10.1007/978-3-031-09037-0_27

Cited by 1 publication

(1 citation statement)

References 46 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Liang et al. [20] proposed a scene text recognition method based on whole word recognition, which used CNN for feature extraction, and used a softmax classifier for whole word recognition of each image. This method does not need to segment characters and can handle text of arbitrary shape and orientation, but it needs to design effective feature extraction and sequence modelling strategies.…”

Section: Related Workmentioning

confidence: 99%

Cross‐modal knowledge learning with scene text for fine‐grained image classification

Xiong,

Mao,

Wang

et al. 2024

IET Image Processing

View full text Add to dashboard Cite

Scene text in natural images carries additional semantic information to aid in image classification. Existing methods lack full consideration of the deep understanding of the text and the visual text relationship, which results in the difficult to judge the semantic accuracy and the relevance of the visual text. This paper proposes image classification based on Cross modal Knowledge Learning of Scene Text (CKLST) method. CKLST consists of three stages: cross‐modal scene text recognition, text semantic enhancement, and visual‐text feature alignment. In the first stage, multi‐attention is used to extract features layer by layer, and a self‐mask‐based iterative correction strategy is utilized to improve the scene text recognition accuracy. In the second stage, knowledge features are extracted using external knowledge and are fused with text features to enhance text semantic information. In the third stage, CKLST realizes visual‐text feature alignment across attention mechanisms with a similarity matrix, thus the correlation between images and text can be captured to improve the accuracy of the image classification tasks. On Con‐Text dataset, Crowd Activity dataset, Drink Bottle dataset, and Synth Text dataset, CKLST can perform significantly better than other baselines on fine‐grained image classification, with improvements of 3.54%, 5.37%, 3.28%, and 2.81% over the best baseline in mAP, respectively.

show abstract

Section: Related Workmentioning

confidence: 99%