Cognitive transfer of spatial awareness states from immersive virtual environments to reality

Abstract

Accuracy of memory performance per se is an imperfect reflection of the cognitive activity (awareness states) that underlies performance in memory tasks. The aim of this research is to investigate the effect of varied visual fidelity on the transfer of training to the real-world after exposure to immersive simulations representing a real-world scene. A between groups experiment was therefore carried out to explore the effect of rendering quality on measurements of location-based recognition memory for objects and measurements of any associated states of awareness. The immersive simulation consisted of one room that was either rendered flat-shaded or using radiosity rendering. The simulation was displayed on a stereo head-tracked Head Mounted Display. After the immersive simulation, participants completed a recognition memory task in a real-world scene by physically arranging objects (in their physical form) in a real world room In addition to the recognition memory task, participants also reported one of four states of awareness following object recognition. Participants were given several options of awareness states that reflected the level of visual mental imagery involved during retrieval, the familiarity of the recollection and also included guesses. The scene also incorporated objects that 'fitted' into the specific context of the real-world scene (an academic's office), referred to as consistent objects, and objects which were not related to the specific context of the real-world scene,referred to as inconsistent objects. A follow-up study was also conducted a week after the initial test. Interestingly, results revealed a higher proportion of correct object recognition that was associated with an awareness state based on mental imagery when the immersive simulation was flat-rendered rather than radiosity rendered This supports similar results from previous studies and extends them to the transfer of training. Memory psychology indicates that awareness states based on visual imagery require stronger attentional processing in the first instance than those based on familiarity. A tentative claim would therefore be that those immersive environments that are distinctive because of their variation from 'real', such as flat-shaded environments, recruit stronger attentional resources. This additional attentional processing may bring about a change in participants' subjective experiences of 'remembering' when they later transfer the training from that environment into a real-world situation.

Subjective measurement of presence in Image based Virtual Reality based on memory test factors

“…In addition, the level of confidence for each answer from the participants were also tested in this paper because the memory score in 'confidence in brand preference' needs the high level of confidence for correct answers [7]. Result showed that if the participants liked the picture given to him, the participants will remember the objects in the panoramic view [9]. Besides that, if the participants gave the correct answer, the level of confidence on participant also will be high.…”

“…Marks will be given based on correct answers only. Recognition Memory is a memory test involving a person's ability to identify the weaknesses in the picture [7] [9]. Participants will be given a picture that there are some errors.…”

“…So players have to identify that the apple is placed in the wrong place. [9] used Recognition Memory to test the sense of presence among participants. Brand preference is related on products that are deemed appropriate for an issue (7).…”

The Effects of Visual Realism on Search Tasks in Mixed Reality Simulation

“…In VR, Mania et al [9] and Stinson et al [16] recently looked at the effects of visual realism on training transfer. Mania investigated the effect of different shading techniques (flat-shading or radiosity) on a memory task.…”

Exploring Behavioural Fidelity of Synthetic Stimuli While Immersed in fMRI Displays

“…Subject-oriented experiments currently planned at the Technical University of Crete aim to measure how lighting manipulations and varied rendering quality affect the normal population's spatial awareness while navigating a 3D scene comprising of a lounge and an external yard (Fig. 2) as well as feelings of presence, subjective responses to lighting and performance when performing formal spatial cognition and spatial memory tasks [3], [4].…”