Functional architecture of Cortical - Basal ganglia circuits

Vertebrates are remarkable for their ability to select and execute purposive actions: motor and cognitive skills executed at the right time and in the right manner to thrive in dynamic, often competitive, environments. A purposive action requires one to extract information from experience and act upon that information by executing the requisite movements to obtain a desired outcome. Subcortical basal ganglia circuits are a key link from the telencephalon to the mesencephalon; putative neural substrates of inference and action, respectively. Basal ganglia are a critical nexus thought to be especially important for modifying future action according to prior experience - reinforcement learning. Recent work from our group has led to the articulation of a mechanistic model of basal ganglia computation with substantial explanatory power. Briefly, we propose that basal ganglia can enact a history-dependent gain on descending neocortical activity. This gain can manifest as the regulation of movement vigor or the timing of actions depending upon what aspects of behavior are being reinforced. Ongoing work in the lab seeks to test key predictions that can be formulated from this perspective.

Basal ganglia circuits for action specification

Annual Reviews in Neuroscience 43: 485-507

A circuit computation in basal ganglia

Movement Disorders 33(5):704-16

Learning from action

Neuron 104(1): 63-77

action specification in flexible motor skills

Although we often focus on the ability of a skilled movement to be executed rapidly and with precisely replicated kinematics; motor skill is also characterized by the flexibility with which an action can be executed while reliably achieving a goal. For example, the ability to flexibly act with a range of vigor (e.g. amplitude, speed) is an essential aspect of skill. Several lines of evidence suggest that basal ganglia play a critical role in the purposive control of movement vigor in mammals. To study the circuit mechanisms underlying the control of movement vigor we developed behavioral paradigms to study precise movement kinematics in mice performing voluntary movements of a joystick. In a genetic model of Parkinson's disease we found that parkinsonian mice also exhibit a profound enervation of joystick movements. Subsequent work provided a mechanistic account of these deficits in the absence of dopamine: closed-loop optogenetic stimulation we showed that dopamine-dependent plasticity allows specific cell types in basal ganglia to exert a bidirectional, opponent control over movement vigor. Ongoing work in the lab seeks to understand the principles that govern how basal ganglia control movement vigor. For exmaple, how are competing demands for specificity and generalization balanced?

molecular tools, hardware & software

The work in our lab combines large-scale extracellular electrophysiology, optical recording, and intracellular electrophysiology with techniques to identify and perturb the activity of specific cell types and circuits in the mouse brain. This constellation of technical approaches requires significant development of hardware and software for data acquisition and analysis. We are also actively involved in developing and refining molecular tools that allow us to identify, target, and manipulate specific cell-types in concert with physiology. In our recent work we have helped to develop and validate the cell-type specific pharmacology in vivo using DARTs and developed a new class of optogenetic inhibitor exemplified by FLInChR.

We draw heavily upon the expertise of many staff scientists and engineers in the jET, Virus Services, Transgenic Mouse Facility, and Scientific Computing. Some of the fruits of our labor can be found on the resources section of the website where there are details about how to recreate the hardware developed for our experiments and software available for download.

circuit implementation of reinforcement learning

Systems neuroscience has had influential successes in the observation of neural activity that correlates with (represents) key elements (quantities, dynamics, etc.) computations that could implement such algorithms. In recent years it has become increasingly possible to manipulate activity in increasingly precise ways in attempts to demonstrate that these computations are causally related to the observed behavior. Mechanistic models of circuit computations ultimately require detailed understanding of how the biophysics of individual neurons and properties of connectivity implement observed computations. Drawing upon our background in cellular biophysics and synaptic plasticity, we also seek to articulate how biophysical properties of neurons, synaptic plasticity rules, and patterns of anatomical connectivity give rise to circuit computations. In recent work we have described how the reward prediction error correlate results from temporal integration of two dissociable pathways and how recurrent connectivity in substantia nigra implements feedback gain control.

projects for summer interns

The cellular logic of descending motor control pathways.
We use simultaneous, large scale neural recordings from multiple forebrain areas that are critical for descending control of novel motor skills. Optogenetic techniques for identifying and perturbing distinct cell types allows us to detail the logic of how distinct cell types implement distinct aspects of descending control. Ongoing work in the lab continues to refine optogenetic techniques and reagents as well as developing computational models.
Tracking changes in neural activity throughout learning.
In our recent work we have begun to examine how the activity of midbrain dopamine neurons evolve as a naive animal first learns about a reward predictive cue. Combining these new data with computational models provided the unique insight that dopamine neurons implement an adaptive learning rate that can improve learning. Ongoing work in the lab seeks to extend these insights to other forms of novel motor skill learning and there are a number of projects for students to explore related questions.
Developing novel tasks to study flexible strategies and motor skills.
Over the past several summers undergraduates in the lab have piloted diverse tasks for studying how goal-directed motor skills are executed and how flexible actions adapted to changing demands. Often such projects involve developing new hardware or modifications of existing software in collaboration with Janelia Experimental Technolgy.