Widget Classification with Applications to Web Accessibility

Melnyk, Valentyn; Ashok, Vikas; Puzis, Yury; Soviak, Andrii; Borodin, Yevgen; Ramakrishnan, I. V.

doi:10.1007/978-3-319-08245-5_20

Cited by 23 publications

(9 citation statements)

References 14 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In this paper, we reuse the approach proposed in our earlier work [12] to automatically identify and classify widgets. It utilizes the change detection approach described in [3] and then employs machine learning to classify widgets into types automatically regardless of their associated library.…”

Section: Widget Recognition and Classificationmentioning

confidence: 98%

“…It has been shown that the best approach is to monitor the changes in the DOM tree [10]. Several techniques leveraging this idea have been proposed to detect the appearance of widgets [1,2,6,12].…”

Section: Widget Recognition and Classificationmentioning

confidence: 99%

“…A widget could be made accessible by screen readers in three major steps: (i) detect the widget in the web page when the widget dynamically appears [3]; (ii) identify (classify) the widget type (e.g., web chat, a calendar, etc.) [12]; and (iii) provide an accessible generic user interface for real-time interaction with the widget of a particular type.…”

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Look Ma, no ARIA

Melnyk

Ashok

Puzis

et al. 2015

Proceedings of the 12th International Web for All Conference

Self Cite

View full text Add to dashboard Cite

Once simple and static, many web pages have now evolved into complex web applications. Hundreds of web development libraries provide ready-to-use custom widgets, which can be further customized to fit the needs of individual web applications. Web developers are supposed to use ARIA specifications to make widgets accessible to screen readers; however, ARIA markup is often used incorrectly and inconsistently, and sometimes even missing in webpages altogether. Given a wide selection of widgets and a lack of proper ARIA support, accessing content of custom widgets in web pages with screen readers has been a challenge for blind users. As a result, blind users cannot benefit from the convenience of using these widgets or, even worse, get stuck on inaccessible content. In our previous work, we showed that custom dynamic widgets could be automatically detected and classified as soon as they appear in web pages. In this paper, we propose to make such widgets accessible by providing generic interfaces for widgets of a particular class. We show how this can be accomplished on the example of Web Chat widget. To demonstrate the usability of the resulting chat interface, we report on the results of a user study with 18 blind screen-reader users.

show abstract

Section: Widget Recognition and Classificationmentioning

confidence: 98%

Section: Widget Recognition and Classificationmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Look Ma, no ARIA

Melnyk

Ashok

Puzis

et al. 2015

Proceedings of the 12th International Web for All Conference

Self Cite

View full text Add to dashboard Cite

show abstract

“…Prior studies investigated the use of Supervised Machine learning techniques for identifying dynamic widgets [1,11,15]. These studies modelled classification algorithms for the problem of identifying widgets in web applications.…”

Section: Related Workmentioning

confidence: 99%

“…WAI-ARIA specifications 4 defines a set of semantic attributes that might be included in the HTML elements that compose widgets [18]. The purpose of these attributes is to allow developers to improve the accessibility of dynamic web content [11]. Thus, Assistive Technologies can inform users about updates and changes to the web page triggered by the interaction with a dynamic element.…”

Section: Extracting Info and Characteristics From Ria Componentsmentioning

confidence: 99%

A Mechanism for Identifying Dynamic Components in Rich Internet Applications

Sensiate

Antonelli

Watanabe

et al. 2020

Proceedings of the 38th ACM International Conference on Design of Communication

View full text Add to dashboard Cite

The web has provided users with interactivity through Rich Internet Applications (RIAs). However, due to the dynamic nature of RIAs, most applications still do not implement accessible solutions in their components for a variety of reasons, such as the lack of specialized knowledge by developers. Besides, there is a lack of tools capable of performing an automatic evaluation for accessibility in RIAs. To automatically evaluate accessibility in RIAs, tools mainly require the identification of the dynamic components. In this paper, we propose a solution that aims to automatically identify widgets in RIAs, by simulating interactions of a real user with a web application, through all the possible events their elements can receive. The developed mechanism extracts the properties of the dynamic elements to compose a database to guide the classification of specific widgets. We evaluated the potential of the mechanism, by applying it with different implementations of a particular widget, the Calendar. Also, the mechanism was tested in a controlled environment to verify more accurately the changes that occur on a web page, which could precisely identify the widgets as Calendars.

show abstract