Hippocampal spatio-predictive cognitive maps adaptively guide reward generalization

Garvert, Mona M.; Saanum, Tankred; Schulz, Eric; Doeller, Christian F

doi:10.1038/s41593-023-01283-x

Cited by 34 publications

(19 citation statements)

References 84 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…When different stimulus dimensions become relevant at different times, the parallel coding of multiple knowledge structures allows for flexible selection of relevant information. Such cognitive computations enable the hippocampus to adaptively generalize based on task demands ( Garvert et al. 2023 ) and to guide goal-directed behavior in novel situations ( Whittington et al.…”

Section: Discussionmentioning

confidence: 99%

Parallel cognitive maps for multiple knowledge structures in the hippocampal formation

Zheng,

Hebart,

Grill

et al. 2024

Cerebral Cortex

View full text Add to dashboard Cite

The hippocampal-entorhinal system uses cognitive maps to represent spatial knowledge and other types of relational information. However, objects can often be characterized by different types of relations simultaneously. How does the hippocampal formation handle the embedding of stimuli in multiple relational structures that differ vastly in their mode and timescale of acquisition? Does the hippocampal formation integrate different stimulus dimensions into one conjunctive map or is each dimension represented in a parallel map? Here, we reanalyzed human functional magnetic resonance imaging data from Garvert et al. (2017) that had previously revealed a map in the hippocampal formation coding for a newly learnt transition structure. Using functional magnetic resonance imaging adaptation analysis, we found that the degree of representational similarity in the bilateral hippocampus also decreased as a function of the semantic distance between presented objects. Importantly, while both map-like structures localized to the hippocampal formation, the semantic map was located in more posterior regions of the hippocampal formation than the transition structure and thus anatomically distinct. This finding supports the idea that the hippocampal-entorhinal system forms parallel cognitive maps that reflect the embedding of objects in diverse relational structures.

show abstract

Section: Discussionmentioning

confidence: 99%

Parallel cognitive maps for multiple knowledge structures in the hippocampal formation

Zheng,

Hebart,

Grill

et al. 2024

Cerebral Cortex

View full text Add to dashboard Cite

show abstract

“…Other studies showed relatively quick learning of regularities [130][131][132] and generalization based on such regularities 120 in a single lab session. The hippocampus, known to be involved in rapid learning 67,128,133,134 and in event segmentation 113,[135][136][137] , also mediates learning the structure of the environment 131,[138][139][140][141][142][143][144][145][146][147][148][149] . Thus, converging behavioral and neural evidence suggest that rapid initial learning largely shapes our schemas.…”

Section: Box 1: Rapid Learning In the Hippocampus Shapes New Schemasmentioning

confidence: 99%

Schemas, reinforcement learning, and the medial prefrontal cortex

Bein,

Niv

2023

Preprint

View full text Add to dashboard Cite

Schemas are rich and complex knowledge structures about the typical unfolding of events in a context. For example, a schema of a lovely dinner at a restaurant. Schemas are central in psychology and neuroscience. Here, we suggest that reinforcement learning (RL), a computational theory of learning the structure of the world and relevant goal-oriented behavior, underlies schema learning. We synthesize literature about schemas and RL to offer that three RL principles might govern the learning of schemas: learning via prediction errors, constructing hierarchical knowledge using hierarchical RL, and dimensionality reduction through learning a simplified and abstract representation of the world. We then offer that the orbito-medial prefrontal cortex is involved in both schemas and RL due to its involvement in dimensionality reduction and in guiding memory reactivation through interactions with posterior brain regions. Finally, we hypothesize that the amount of dimensionality reduction might underlie gradients of involvement along the ventral-dorsal and posterior-anterior axes of the orbito-medial prefrontal cortex. More specific and detailed representations might engage the ventral and posterior parts, while abstraction might shift representations toward the dorsal and anterior parts of the medial prefrontal cortex.

show abstract

“…Though a full understanding of this effect would require future work aimed at studying the relationship in detail, we speculate that reward drives stronger contextual encoding as a means of incorporating any potentially informative features into the representation. Indeed, prior studies show that reward states drive contextual coding (Wolosin et al, 2013) and modulate map-like representations (Garvert et al, 2023).…”

Section: Limitations and Future Directionsmentioning

confidence: 99%

The construction and use of cognitive maps in model-based control.

Karagoz,

Reagh,

Kool

2024

Journal of Experimental Psychology: General

View full text Add to dashboard Cite

When making decisions, we sometimes rely on habit and at other times plan toward goals. Planning requires the construction and use of an internal representation of the environment, a cognitive map. How are these maps constructed, and how do they guide goal-directed decisions? We coupled a sequential decision-making task with a behavioral representational similarity analysis approach to examine how relationships between choice options change when people build a cognitive map of the task structure. We found that participants who encoded stronger higher-order relationships among choice options showed increased planning and better performance. These higher-order relationships were more strongly encoded among objects encountered in high-reward contexts, indicating a role for motivation during cognitive map construction. In contrast, lower-order relationships such as simple visual co-occurrence of objects did not predict goal-directed planning. These results show that the construction of cognitive maps is an active process, with motivation dictating the degree to which higher-order relationships are encoded and used for planning. Public Significance StatementThis study combines behavioral measures and computational modeling to show that people build internal representations of a task-cognitive maps-and that the quality of their maps predicts how much they plan toward reward. We found that these maps were abstract, encoding relationships beyond those derived from immediate experience, and that they were more accurate when more reward was at stake. Our findings show that people's ability and motivation to plan toward goals relate to their construction and use of cognitive maps.

show abstract

Hippocampal spatio-predictive cognitive maps adaptively guide reward generalization

Cited by 34 publications

References 84 publications

Parallel cognitive maps for multiple knowledge structures in the hippocampal formation

Parallel cognitive maps for multiple knowledge structures in the hippocampal formation

Schemas, reinforcement learning, and the medial prefrontal cortex

The construction and use of cognitive maps in model-based control.

Contact Info

Product

Resources

About