SCIENTIFIC HUB

Follow the evidence.

SCIENTIFIC LITERATURE · MED

Modeling the contributions of Basal ganglia and Hippocampus to spatial navigation using reinforcement learning.

PLoS One · 2012-10-26

DOI: 10.1371/journal.pone.0047467PMID: 23110073

Open accessResearch Support, Non-U.S. Gov't; research-article; Journal ArticleOriginal source ↗

Research overview

The text below is the source article’s original abstract under a verified reuse license. cc by

A computational neural model that describes the competing roles of Basal Ganglia and Hippocampus in spatial navigation is presented. Model performance is evaluated on a simulated Morris water maze explored by a model rat. Cue-based and place-based navigational strategies, thought to be subserved by the Basal ganglia and Hippocampus respectively, are described. In cue-based navigation, the model rat learns to directly head towards a visible target, while in place-based navigation the target position is represented in terms of spatial context provided by an array of poles placed around the pool. Learning is formulated within the framework of Reinforcement Learning, with the nigrostriatal dopamine signal playing the role of Temporal Difference Error. Navigation inherently involves two apparently contradictory movements: goal oriented movements vs. random, wandering movements. The model hypothesizes that while the goal-directedness is determined by the gradient in Value function, randomness is driven by the complex activity of the SubThalamic Nucleus (STN)-Globus Pallidus externa (GPe) system. Each navigational system is associated with a Critic, prescribing actions that maximize value gradients for the corresponding system. In the integrated system, that incorporates both cue-based and place-based forms of navigation, navigation at a given position is determined by the system whose value function is greater at that position. The proposed model describes the experimental results of [1], a lesion-study that investigates the competition between cue-based and place-based navigational systems. The present study also examines impaired navigational performance under Parkinsonian-like conditions. The integrated navigational system, operated under dopamine-deficient conditions, exhibits increased escape latency as was observed in experimental literature describing MPTP model rats navigating a water maze.

Scientific assessment

01

Research question

Assess the question within the original study’s scope.

02

Methods & sample

Check the source article for study design and sample details.

03

Key findings

An editorially approved findings summary is not yet published for this record.

04

Limitations

Generalizability, bias and clinical meaning require separate assessment.

Methods, samples and clinical conclusions are not inferred from bibliographic metadata.