Concurrent Speech Synthesis to Improve Document First Glance for the Blind

Maurel, Fabrice; Dias, Gaël; Ferrari, Stéphane; Andrew, Judith Jeyafreeda; Giguet, Emmanuel

doi:10.1109/icdarw.2019.20046

Cited by 3 publications

(2 citation statements)

References 27 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…First, we will propose to study the association of visual and thermal parameters. Second, work is in progress to evaluate the possibility of combining tactile stimuli with audio stimuli [29]. Third, increasing the number of concurrent stimuli (up to 320) by associating a vibrotactile actuator to several fingers may enable new sensory experiences as the touch screen might be accessed by a multi-sensory device.…”

Section: Discussionmentioning

confidence: 99%

Layout Transposition for Non-Visual Navigation of Web Pages by Tactile Feedback on Mobile Devices

et al. 2020

Self Cite

View full text Add to dashboard Cite

In this paper, we present the results of an empirical study that aims to evaluate the performance of sighted and blind people to discriminate web page structures using vibrotactile feedback. The proposed visuo-tactile substitution system is based on a portable and economical solution that can be used in noisy and public environments. It converts the visual structures of web pages into tactile landscapes that can be explored on any mobile touchscreen device. The light contrasts overflown by the fingers are dynamically captured, sent to a micro-controller, translated into vibrating patterns that vary in intensity, frequency and temperature, and then reproduced by our actuators on the skin at the location defined by the user. The performance of the proposed system is measured in terms of perception of frequency and intensity thresholds and qualitative understanding of the shapes displayed.

show abstract

Section: Discussionmentioning

confidence: 99%

Layout Transposition for Non-Visual Navigation of Web Pages by Tactile Feedback on Mobile Devices

et al. 2020

Self Cite

View full text Add to dashboard Cite

show abstract

“…In the TAGTHUNDER project 1 , we introduce the concept of tag thunder as a means to produce an interactive and innovative stimulus promoting the emergence of selfadapted strategies for non visual reading [11]. The approach consists in constructing oral counterparts to visual concepts (typography, layout, ...) that support the implementation of quick reading strategies such as skimming and scanning.…”

Section: Introductionmentioning

confidence: 99%

Model-Driven Web Page Segmentation for Non Visual Access

Andrew

Ferrari

Maurel

et al. 2020

Communications in Computer and Information Science

Self Cite

View full text Add to dashboard Cite

Web page segmentation aims to break a large page into smaller blocks, in which contents with coherent semantics are kept together. Within this context, a great deal of approaches have been proposed without any specific end task in mind. In this paper, we study different segmentation strategies for the task of non visual skimming. For that purpose, we propose to segment web pages into visually coherent zones so that each zone can be represented by a set of relevant keywords that can be further synthesized into concurrent speech. As a consequence, we consider web page segmentation as a clustering problem of visual elements, where (1) a fixed number of clusters must be discovered, (2) the elements of a cluster should be visually connected and (3) all visual elements must be clustered. Therefore, we study variations of three existing algorithms, that comply to these constraints: K-means, F-K-means, and Guided Expansion. In particular, we evaluate different reading strategies for the positioning of the initial K seeds as well as a pre-clustering methodology for the Guided Expansion algorithm, which goal is to (1) fasten the clustering process and (2) reduce unbalance between clusters. The performed evaluation shows that the Guided Expansion algorithm evidences statistically increased results over the two other algorithms with the variations of the reading strategies. Nevertheless, improvements still need to be proposed to increase separateness.

show abstract

Multimodal Web Page Segmentation Using Self-organized Multi-objective Clustering

Ramesh

Dias

Andrew

et al. 2022

ACM Trans. Inf. Syst.

View full text Add to dashboard Cite

Web page segmentation (WPS) aims to break a web page into different segments with coherent intra- and inter-semantics. By evidencing the morpho-dispositional semantics of a web page, WPS has traditionally been used to demarcate informative from non-informative content, but it has also evidenced its key role within the context of non-linear access to web information for visually impaired people. For that purpose, a great deal of ad hoc solutions have been proposed that rely on visual, logical, and/or text cues. However, such methodologies highly depend on manually tuned heuristics and are parameter-dependent. To overcome these drawbacks, principled frameworks have been proposed that provide the theoretical bases to achieve optimal solutions. However, existing methodologies only combine few discriminant features and do not define strategies to automatically select the optimal number of segments. In this article, we present a multi-objective clustering technique called MCS that relies on \( K \) -means, in which (1) visual, logical, and text cues are all combined in a early fusion manner and (2) an evolutionary process automatically discovers the optimal number of clusters (segments) as well as the correct positioning of seeds. As such, our proposal is parameter-free, combines many different modalities, does not depend on manually tuned heuristics, and can be run on any web page without any constraint. An exhaustive evaluation over two different tasks, where (1) the number of segments must be discovered or (2) the number of clusters is fixed with respect to the task at hand, shows that MCS drastically improves over most competitive and up-to-date algorithms for a wide variety of external and internal validation indices. In particular, results clearly evidence the impact of the visual and logical modalities towards segmentation performance.

show abstract

Concurrent Speech Synthesis to Improve Document First Glance for the Blind

Cited by 3 publications

References 27 publications

Layout Transposition for Non-Visual Navigation of Web Pages by Tactile Feedback on Mobile Devices

Layout Transposition for Non-Visual Navigation of Web Pages by Tactile Feedback on Mobile Devices

Model-Driven Web Page Segmentation for Non Visual Access

Multimodal Web Page Segmentation Using Self-organized Multi-objective Clustering

Contact Info

Product

Resources

About