The spatial world is three dimensional (3D) and humans and other animals move both horizontally and vertically within it. Extant neuroscientific studies have typically investigated spatial navigation on a horizontal 2D plane, leaving much unknown about how 3D spatial information is represented in the brain. Specifically, horizontal and vertical information may be encoded in the same or different neural structures with equal or unequal sensitivity. Here, we investigated these possibilities using fMRI while participants were passively moved within a 3D lattice structure as if riding a rollercoaster. Multivoxel pattern analysis was used to test for the existence of information relating to where and in which direction participants were heading in this virtual environment. Behaviorally, participants had similarly accurate memory for vertical and horizontal locations and the right anterior hippocampus (HC) expressed place information that was sensitive to changes along both horizontal and vertical axes. This is suggestive of isotropic 3D place encoding. In contrast, participants indicated their heading direction faster and more accurately when they were heading in a tilted-up or tilted-down direction. This direction information was expressed in the right retrosplenial cortex and posterior HC and was only sensitive to vertical pitch, which could reflect the importance of the vertical (gravity) axis as a reference frame. Overall, our findings extend previous knowledge of how we represent the spatial world and navigate within it by taking into account the important third dimension.SIGNIFICANCE STATEMENT The spatial world is 3D. We can move horizontally across surfaces, but also vertically, going up slopes or stairs. Little is known about how the brain supports representations of 3D space. A key question is whether horizontal and vertical information is equally well represented. Here, we measured fMRI response patterns while participants moved within a virtual 3D environment and found that the anterior hippocampus (HC) expressed location information that was sensitive to the vertical and horizontal axes. In contrast, information about heading direction, found in retrosplenial cortex and posterior HC, favored the vertical axis, perhaps due to gravity effects. These findings provide new insights into how we represent our spatial 3D world and navigate within it.

It is widely agreed that patients with bilateral hippocampal damage are impaired at binding pairs of words together. Consequently, the verbal paired associates (VPA) task has become emblematic of hippocampal function. This VPA deficit is not well understood and is particularly difficult for hippocampal theories with a visuospatial bias to explain (e.g., cognitive map and scene construction theories). Resolving the tension among hippocampal theories concerning the VPA could be important for leveraging a fuller understanding of hippocampal function. Notably, VPA tasks typically use high imagery concrete words and so conflate imagery and binding. To determine why VPA engages the hippocampus, we devised an fMRI encoding task involving closely matched pairs of scene words, pairs of object words, and pairs of very low imagery abstract words. We found that the anterior hippocampus was engaged during processing of both scene and object word pairs in comparison to abstract word pairs, despite binding occurring in all conditions. This was also the case when just subsequently remembered stimuli were considered. Moreover, for object word pairs, fMRI activity patterns in anterior hippocampus were more similar to those for scene imagery than object imagery. This was especially evident in participants who were high imagery users and not in mid and low imagery users. Overall, our results show that hippocampal engagement during VPA, even when object word pairs are involved, seems to be evoked by scene imagery rather than binding. This may help to resolve the issue that visuospatial hippocampal theories have in accounting for verbal memory.

Humans commonly operate within 3D environments such as multifloor buildings and yet there is a surprising dearth of studies that have examined how these spaces are represented in the brain. Here, we had participants learn the locations of paintings within a virtual multilevel gallery building and then used behavioral tests and fMRI repetition suppression analyses to investigate how this 3D multicompartment space was represented, and whether there was a bias in encoding vertical and horizontal information. We found faster response times for within-room egocentric spatial judgments and behavioral priming effects of visiting the same room, providing evidence for a compartmentalized representation of space. At the neural level, we observed a hierarchical encoding of 3D spatial information, with left anterior hippocampus representing local information within a room, while retrosplenial cortex, parahippocampal cortex, and posterior hippocampus represented room information within the wider building. Of note, both our behavioral and neural findings showed that vertical and horizontal location information was similarly encoded, suggesting an isotropic representation of 3D space even in the context of a multicompartment environment. These findings provide much-needed information about how the human brain supports spatial memory and navigation in buildings with numerous levels and rooms.