Virtual Environments for Assessing and Rehabilitating Cognitive/Functional Performance A Review of Projects at the USC Integrated Media Systems Center

Abstract

Virtual reality (VR) technology offers new options for the creation of sophisticated tools that could be applied in the areas of assessment and rehabilitation of cognitive and functional processes. VR systems allow for the precise presentation and control of dynamic, multisensory, three-dimensional (3-D) stimulus environments, as well as the recording of all behavioral responses that occur within them. Assessment and rehabilitation scenarios that would be difficult if not impossible to deliver using conventional neuropsychological methods are now being developed that take advantage of these VR assets. If empirical studies demonstrate effectiveness, virtual environments (VEs) could be of considerable value for better understanding, measuring, and treating persons with impairments due to traumatic brain injury, neurological disorders, and learning disabilities. This article describes the progress of a VR research program at the USC Integrated Media Systems Center and Information Sciences Institute that has developed and investigated the use of a series of VEs designed to target (i) molecular visuospatial skills using a 3-D, projection-based ImmersaDesk system, and (ii) attention (and soon memory and executive functioning) processes within ecologically valid functional scenarios utilizing a head-mounted display (HMD). Results from completed research, rationales and methodology of works in progress, and our plan for future work is presented. Our primary vision has been to develop VR systems that target cognitive processes and functional skills that are of relevance to a wide range of patient populations with central nervous system (CNS) dysfunction, as well as for the assessment of unimpaired performance. We have also sought to select cognitive/functional targets that intuitively appear well matched to the specific assets available with currently available VR technology.

Manual training of mental rotation

“…It was assumed that manual training would improve the mental rotation ability and it was examined whether this effect would be limited to previously learned stimuli. Furthermore, we assumed that participants with poor mental rotation ability would profit from manual training to a greater extent than good mental rotators (see Rizzo et al, 2001;Saccuzzo, Craig, Johnson, & Larson, 1996).…”

“…A first attempt to improve mental rotation ability by manual training was made by Rizzo and colleagues (Larson et al, 1999;Parsons et al, 2004;Rizzo et al, 2001). In their manual training of spatial rotation in a virtual reality, participants had to rotate a block figure into the orientation of the target figure and superimpose it on the target figure.…”

Computerized and Virtual Reality Cognitive Training for Individuals at High Risk of Cognitive Decline: Systematic Review of the Literature

“…One major benefit of VRCT is that it addresses previous criticisms about CCT by providing individuals with an intervention which is immersive, naturalistic and mimic real-time and real-life, increasing ecological validity (33). VRCT mimics real-world activities and therefore offers greater potential for transfer to ADL (32).…”

“…The application of virtual reality (VR) with individuals with impaired cognition for CT is a novel innovation and uses computer software to combine visual, auditory and tactile feedback to simulate real-life environments (32). VRCT is highly flexible and a program can be designed to suit to needs of the target population (33). Feasibility studies demonstrated that healthy older populations (34,35) and individuals living with dementia (36) can be spatially competent and effectively use VR technology.…”

Manual training of mental rotation in children

“…This could apply especially to children with impairments of spatial thinking. A study by Rizzo et al (2001) indicated that participants with initially poor spatial skills in particular can benefit from computer-based rotation training. Therefore, the manual rotation training should be employed to improve the mental rotation ability of children with visual-spatial deficits, such as children with spina bifida.…”