Learning to use electronic travel aids for visually impaired in virtual reality

Ricci, Fabiana Sofia; Boldini, Alain; Rizzo, John Ross; Porfiri, Maurizio

doi:10.1117/12.2612097

Cited by 6 publications

(3 citation statements)

References 21 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…We have already tested an electronic travel aid for blind and low vision individuals that incorporates our tactors, within a virtual reality scenario with simulated visual impairments where vibrotactile stimulation relays information regarding the position of surrounding obstacles. 20,21 Further tests are necessary to understand the effectiveness of the tactors in conveying complex information about the environment.…”

Section: Discussionmentioning

confidence: 99%

Characterizing the response of piezoelectric-polymer composite haptic actuators and their interaction with skin

Boldini,

Rizzo,

Porfiri

2024

Electroactive Polymer Actuators and Devices (EAPAD) XXVI

View full text Add to dashboard Cite

From our cell phones to game controllers, haptics -the use of skin stimulation, often in the form of vibrations, to relay information -has expanded its pervasiveness over the last few decades. Most applications leverage lowcost solutions, such as linear resonant and eccentric rotating mass actuators, which are limited in either their bandwidth or response time. However, some time-sensitive applications that require complex representation of the environment, such as obstacle avoidance and emergency response, pose restrictive requirements for haptic technologies. To this end, our team has recently developed a new type of high-performance haptic actuators, based on composites of piezoelectric materials called macro fiber composites (MFCs). The MFCs are glued on an aluminum back, enclosed by a custom-made case, and put in contact with a hollow cylinder, filled with a dense material. The mass in the cylinder allows the tuning of the frequency response of the actuator, toward increasing the amplitude of the response in the frequency range in which skin is most sensitive (10-250 Hz). In this paper, we put forward a detailed characterization of this new type of haptic actuators. First, we experimentally detail their mechanical and piezoelectric response. We then assess their frequency response while varying the mass in the cylinder. Finally, we study how actuators would interact mechanically with the skin. To this end, we conduct experiments with an actuator in contact with a pre-stretched membrane, whose mechanical properties are within the range of variability of human skin. We measure the frequency response of the actuator while varying the pre-stretch level of the membrane, simulating different skin indentations. Our results demonstrate that this new type of actuators can maintain an amplitude over the skin discrimination threshold over a large bandwidth, while offering low latency due to the fast piezoelectric response times.

show abstract

Section: Discussionmentioning

confidence: 99%

Characterizing the response of piezoelectric-polymer composite haptic actuators and their interaction with skin

Boldini,

Rizzo,

Porfiri

2024

Electroactive Polymer Actuators and Devices (EAPAD) XXVI

View full text Add to dashboard Cite

show abstract

“…Several researchers have designed virtual/augmented reality (VR/AR) systems for training persons with VI in the navigation of unknown environment [17][18][19][20] and in the proper use of ETAs. [21][22][23][24][25] By creating customized visual and auditory cues, VR/AR offers the unique possibility to train and assist users with a specific task in virtual environments, which are safe, controllable, realistic, and engaging. In fact, VR/AR improve the training process by offering virtual settings in which real stimuli are perceived through multi-sensory feedback modalities.…”

Section: Introductionmentioning

confidence: 99%

A multiplayer virtual reality platform to evaluate electronic travel aid performance for persons with blindness and low vision

Ricci¹,

Boldini²,

Rizzo

et al. 2023

Nano-, Bio-, Info-Tech Sensors, and Wearable Systems 2023

View full text Add to dashboard Cite

The prevalence of blindness and low vision is skyrocketing as the population ages. Independent, efficient, and safe navigation for persons with blindess and low vision requires hard work, practice, and development of strong orientation and mobility skills. In this vein, orientation and mobility training provides tools to familiarize oneself with new environments and maintain an independent lifestyle. In recent years, orientation and mobility training has adopted electronic travel aids, smart devices developed to assist those with blindness and low vision during navigation. However, learning how to use an electronic travel aid in orientation and mobility training sessions may prove dangerous for, as an end user. Early in use, the end user may misinterpret the information provided by the electronic travel aid. In fact, there may be a shallow learning curve during initial implementation. To this end, we built a multiplayer virtual reality platform to simulate an orientation and mobility training, involving trainer and trainee, for practicing with an electronic travel aid in a controlled, safe but realistic environment. We interfaced the virtual reality platform with a custom electronic travel aid created by our team. The electronic travel aid consists of a specially designed camera on a backpack and a haptic belt, along with software that can relays information about the location of near obstacles in the virtual environment through spatiotopic vibrotactile stimulation of the abdomen. In the virtual environment, the trainer can instruct the trainee in the use of the electronic travel aid while navigating complex urban environments. The efficacy of the communication between trainer and trainee towards teaching the correct use of the electronic travel aid and its performance in assisting navigation will be evaluated through series of systematic experiments.

show abstract

“…ETAs are often complex and even counter-intuitive, such that their use requires a significant amount of training [18]. To address these problems, there is an immediate need for a platform that can: i) support the development, testing, and refinement out of the prototype stage of ETAs, targeted to end-users; and ii) train persons with VIs to use ETAs within realistic scenarios, while limiting their risk of injury in the process [22][23][24].…”

Section: Introductionmentioning

confidence: 99%

Virtual reality as a means to explore assistive technologies for the visually impaired

Ricci

Boldini

et al. 2023

PLOS Digit Health

Self Cite

View full text Add to dashboard Cite

Visual impairment represents a significant health and economic burden affecting 596 million globally. The incidence of visual impairment is expected to double by 2050 as our population ages. Independent navigation is challenging for persons with visual impairment, as they often rely on non-visual sensory signals to find the optimal route. In this context, electronic travel aids are promising solutions that can be used for obstacle detection and/or route guidance. However, electronic travel aids have limitations such as low uptake and limited training that restrict their widespread use. Here, we present a virtual reality platform for testing, refining, and training with electronic travel aids. We demonstrate the viability on an electronic travel aid developed in-house, consist of a wearable haptic feedback device. We designed an experiment in which participants donned the electronic travel aid and performed a virtual task while experiencing a simulation of three different visual impairments: age-related macular degeneration, diabetic retinopathy, and glaucoma. Our experiments indicate that our electronic travel aid significantly improves the completion time for all the three visual impairments and reduces the number of collisions for diabetic retinopathy and glaucoma. Overall, the combination of virtual reality and electronic travel aid may have a beneficial role on mobility rehabilitation of persons with visual impairment, by allowing early-phase testing of electronic travel aid prototypes in safe, realistic, and controllable settings.

show abstract

Learning to use electronic travel aids for visually impaired in virtual reality

Cited by 6 publications

References 21 publications

Characterizing the response of piezoelectric-polymer composite haptic actuators and their interaction with skin

Characterizing the response of piezoelectric-polymer composite haptic actuators and their interaction with skin

A multiplayer virtual reality platform to evaluate electronic travel aid performance for persons with blindness and low vision

Virtual reality as a means to explore assistive technologies for the visually impaired

Contact Info

Product

Resources

About