The last meter

Manduchi, Roberto; Coughlan, James M.

doi:10.1145/2556288.2557328

Cited by 31 publications

(8 citation statements)

References 12 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Previous work explored helping BLV people locate surrounding objects [7], improve object recognition [22,31], and navigate the last meter to the target object [39]. Many of these approaches depend on computer vision algorithms and are susceptible to object-out-of-frame situations.…”

Section: Making Objects Finding More Accessible To Blv Peoplementioning

confidence: 99%

“…After unlocking the door, users face additional challenges: locating the door despite small openings or occlusions and safely navigating to it without tripping or colliding with the open door [32]. Previous research has investigated helping BLV people reach surrounding targets [7], and recognizing objects [22,31,39]. However, these approaches rely on wearable devices, remote workers, or vision-based algorithms, which have limitations in availability and robustness.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

FetchAid: Making Parcel Lockers More Accessible to Blind and Low Vision People With Deep-learning Enhanced Touchscreen Guidance, Error-Recovery Mechanism, and AR-based Search Support

Guan,

Xiong,

Fan

2024

Proceedings of the CHI Conference on Human Factors in Computing Systems

View full text Add to dashboard Cite

Parcel lockers have become an increasingly prevalent last-mile delivery method. Yet, a recent study revealed its accessibility challenges to blind and low-vision people (BLV). Informed by the study, we designed FetchAid, a standalone intelligent mobile app assisting BLV in using a parcel locker in real-time by integrating computer vision and augmented reality (AR) technologies. FetchAid first uses a deep network to detect the user's fingertip and relevant buttons on the touch screen of the parcel locker to guide the user to reveal and scan the QR code to open the target compartment door and then guide the user to reach the door safely with AR-based context-aware audio feedback. Moreover, FetchAid provides an error-recovery mechanism and real-time feedback to keep the user on track. We show that FetchAid substantially improved task accomplishment and efficiency, and reduced frustration and overall effort in a study with 12 BLV participants, regardless of their vision conditions and previous experience.CCS Concepts: • Human-centered computing → Accessibility technologies.

show abstract

Section: Making Objects Finding More Accessible To Blv Peoplementioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

FetchAid: Making Parcel Lockers More Accessible to Blind and Low Vision People With Deep-learning Enhanced Touchscreen Guidance, Error-Recovery Mechanism, and AR-based Search Support

Guan,

Xiong,

Fan

2024

Proceedings of the CHI Conference on Human Factors in Computing Systems

View full text Add to dashboard Cite

show abstract

“…There is an increasing tendency for approaches where users do not require any hardware besides their own devices, for instance by making use of smartphone sensors [16,21]. In addition, camera-based approaches can use the user's (or a specialized) device to guide them to a particular target [4,18,41] or to detect and avoid obstacles [19,39,49,62,66].…”

Section: Indoor Navigation Assistancementioning

confidence: 99%

Airport Accessibility and Navigation Assistance for People with Visual Impairments

Guerreiro

Ahmetovic

Sato

et al. 2019

Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems

View full text Add to dashboard Cite

People with visual impairments often have to rely on the assistance of sighted guides in airports, which prevents them from having an independent travel experience. In order to learn about their perspectives on current airport accessibility, we conducted two focus groups that discussed their needs and experiences in-depth, as well as the potential role of assistive technologies. We found that independent navigation is a main challenge and severely impacts their overall experience. As a result, we equipped an airport with a Bluetooth Low Energy (BLE) beacon-based navigation system and performed a real-world study where users navigated routes relevant for their travel experience. We found that despite the challenging environment participants were able to complete their itinerary independently, presenting none to few navigation errors and reasonable timings. This study presents the frst systematic evaluation posing BLE technology as a strong approach to increase the independence of visually impaired people in airports. CCS CONCEPTS • Human-centered computing → Empirical studies in accessibility; Accessibility technologies.

show abstract

“…A natural way to capture the information users want in a photograph is to move the camera around until the intended part of the photograph is contained within the frame. Several prior systems have been developed to help blind people take better photographs, since acquiring a high-quality photograph is often a prerequisite for further computer vision processing [9,15,25,26,27].…”

Section: Window Cursor Applicationsmentioning

confidence: 99%

“…We designed four tasks representative of daily activities people engage in using eye sight ( Figure 4). Tasks were designed based on prior work [2,8,11,15,28], and in consultation with blind participants through pilot interviews, where we asked about daily tasks that were difficult to complete without sighted help, information they felt they were missing out on, as well as situations that made them feel curious about the environment. The scenarios were also confirmed by participants in study stage 1.…”

Section: Tasksmentioning

confidence: 99%

Investigating Cursor-based Interactions to Support Non-Visual Exploration in the Real World

Guo

McVea

Wang

et al. 2018

Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility

View full text Add to dashboard Cite

Figure 1. We define and compare cursor-based interactions that support non-visual attention to items within a complex visual scene: (a) window cursor, in which the user moves the device itself to scan the scene and receives information about what is in the center of the image; (b) vertical window cursor, a variation of window cursor that sacrifices the granularity on the vertical axis, but potentially facilitates locating the direction of a specific object; (c) finger cursor, in which the user moves their finger on the real world object they want to access and receives information about details near (or under) their fingertip; and (d) touch cursor, in which the visual scene is brought onto the device screen and the user moves their finger on the touchscreen to receive information about what they touch on the live camera image. ABSTRACTThe human visual system processes complex scenes to focus attention on relevant items. However, blind people cannot visually skim for an area of interest. Instead, they use a com bination of contextual information, knowledge of the spatial layout of their environment, and interactive scanning to find and attend to specific items. In this paper, we define and com pare three cursor-based interactions to help blind people attend to items in a complex visual scene: window cursor (move their phone to scan), finger cursor (point their finger to read), and touch cursor (drag their finger on the touchscreen to explore). We conducted a user study with 12 participants to evaluate the three techniques on four tasks, and found that: window cur sor worked well for locating objects on large surfaces, finger cursor worked well for accessing control panels, and touch cursor worked well for helping users understand spatial lay outs. A combination of multiple techniques will likely be best for supporting a variety of everyday tasks for blind users.

show abstract

The last meter

Cited by 31 publications

References 12 publications

FetchAid: Making Parcel Lockers More Accessible to Blind and Low Vision People With Deep-learning Enhanced Touchscreen Guidance, Error-Recovery Mechanism, and AR-based Search Support

FetchAid: Making Parcel Lockers More Accessible to Blind and Low Vision People With Deep-learning Enhanced Touchscreen Guidance, Error-Recovery Mechanism, and AR-based Search Support

Airport Accessibility and Navigation Assistance for People with Visual Impairments

Investigating Cursor-based Interactions to Support Non-Visual Exploration in the Real World

Contact Info

Product

Resources

About