Semi-automatic Text and Graphics Extraction of Manga Using Eye Tracking Information

Abstract

International audienceThe popularity of storing, distributing and reading comic books electronically has made the task of comics analysis an interesting research problem. Different work have been carried out aiming at understanding their layout structure and the graphic content. However the results are still far from universally applicable, largely due to the huge variety in expression styles and page arrangement, especially in manga (Japanese comics). In this paper, we propose a comic image analysis approach using eye-tracking data recorded during manga reading sessions. As humans are extremely capable of interpreting the structured drawing content, and show different reading behaviors based on the nature of the content, their eye movements follow distinguishable patterns over text or graphic regions. Therefore, eye gaze data can add rich information to the understanding of the manga content. Experimental results show that the fixations and saccades indeed form consistent patterns among readers, and can be used for manga textual and graphical analysis

A Survey of Comics Research in Computer Science

“…Carroll et al [11] showed that the readers tend to look at the artworks before reading the text. Rigaud et al found that, in France, the readers spend most of the time at reading the text and looking at the face of the characters [60]. The same experiment repeated in Japan lead to the same conclusion, as illustrated in Fig.…”

Contextualização dos recursos didáticos do projeto escolhas informadas em saúde no Brasil: tradução e avaliação da experiência dos usuários em estudo piloto na escola

“…O conhecimento sobre o comportamento dos olhos na leitura de histórias em quadrinhos é de extrema significância por se tratar de um formato que abrange a comunicação escrita e gráfica. Fixações e sacadas são usadas para análise textual e gráfica de mangás, (34) e até mesmo o nível de compreensão na leitura de histórias em quadrinhos pode ser avaliada por meio do tempo de fixação. (35,36) Por conseguinte, essa tecnologia pode ser usada para avaliar os recursos didáticos do projeto IHC.…”