TangibleGrid: Tangible Web Layout Design for Blind Users

Li, Jiasheng; Yan, Zeyu; Jarjue, Ebrima; Shetty, Ashrith; Peng, Huaishu

doi:10.1145/3526113.3545627

Cited by 17 publications

(3 citation statements)

References 43 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Given that users interact with software through a UI, and past work has illustrated accessibility issues present in UIs [26,47,75,80], there is a body of work dedicated to automatically comprehending and augmenting UIs to identify and circumvent accessibility and UI issues [31,40,53,54,62,64,67,84,91].…”

Section: Accessibility-based Ui Comprehensionmentioning

confidence: 99%

MotorEase: Automated Detection of Motor Impairment Accessibility Issues in Mobile App UIs

Krishna Vajjala,

Mansur,

Jose

et al. 2024

Proceedings of the IEEE/ACM 46th International Conference on Software Engineering

View full text Add to dashboard Cite

Recent research has begun to examine the potential of automatically finding and fixing accessibility issues that manifest in software. However, while recent work makes important progress, it has generally been skewed toward identifying issues that affect users with certain disabilities, such as those with visual or hearing impairments. However there are other groups of users with different types of disabilities that also need software tooling support to improve their experience. As such, this paper aims to automatically identify accessibility issues that affect users with motor-impairments.To move toward this goal, this paper introduces a novel approach, called MotorEase, capable of identifying accessibility issues in mobile app UIs that impact motor-impaired users. Motor-impaired users often have limited ability to interact with touch-based devices, and instead may make use of a switch or other assistive mechanismhence UIs must be designed to support both limited touch gestures and the use of assistive devices. MotorEase adapts computer vision and text processing techniques to enable a semantic understanding of app UI screens, enabling the detection of violations related to four popular, previously unexplored UI design guidelines that support motor-impaired users, including: (i) visual touch target size, (ii) expanding sections, (iii) persisting elements, and (iv) adjacent icon visual distance. We evaluate MotorEase on a newly derived benchmark, called MotorCheck, that contains 555 manually annotated examples of violations to the above accessibility guidelines, across 1599 screens collected from 70 applications via a mobile app testing tool. Our experiments illustrate that MotorEase is able to identify violations with an average accuracy of ≈90%, and a false positive rate of less than 9%, outperforming baseline techniques. CCS CONCEPTS• Software and its engineering → Software testing and debugging; Software design engineering.

show abstract

Section: Accessibility-based Ui Comprehensionmentioning

confidence: 99%

MotorEase: Automated Detection of Motor Impairment Accessibility Issues in Mobile App UIs

Krishna Vajjala,

Mansur,

Jose

et al. 2024

Proceedings of the IEEE/ACM 46th International Conference on Software Engineering

View full text Add to dashboard Cite

show abstract

“…While not widely used yet [36,37], personal assistive devices [50,54] have the potential to improve real-world accessibility for blind users in a variety of contexts, from providing travel and navigation aids [11,15,50,53] to promoting individual creativity [12,26,32]. Personal assistive devices have also been utilized to support situations such as shopping in order to promote independence.…”

Section: Personal Assistive Devicesmentioning

confidence: 99%

Toucha11y: Making Inaccessible Public Touchscreens Accessible

Yan

Shah

et al. 2023

Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems

Self Cite

View full text Add to dashboard Cite

Despite their growing popularity, many public kiosks with touchscreens are inaccessible to blind people. Toucha11y is a working prototype that allows blind users to use existing inaccessible touchscreen kiosks independently and with little effort. Toucha11y consists of a mechanical bot that can be instrumented to an arbitrary touchscreen kiosk by a blind user and a companion app on their smartphone. The bot, once attached to a touchscreen, will recognize its content, retrieve the corresponding information from a database, and render it on the user's smartphone. As a result, a blind person can use the smartphone's built-in accessibility features to access content and make selections. The mechanical bot will detect and activate the corresponding touchscreen interface. We present the system design of Toucha11y along with a series of technical evaluations. Through a user study, we found out that Toucha11y could help blind users operate inaccessible touchscreen devices. CCS CONCEPTS• Human-centered computing → Accessibility systems and tools.

show abstract

“…Similarly, Ashrith Shetty et al [25] created a touchable web page that allowed visually impaired individuals to experience the layout of web pages with their hands. Jiasheng Li et al [16] proposed a device that provided real-time tangible feedback to allow visually impaired users to understand the layout of web pages.…”

Section: Tangible Websitesmentioning

confidence: 99%