Dr. Jonathan W. Pillow

 
 

Title

Inferring the dynamics of learning from sensory decision-making behavior

Abstract

The dynamics of learning in natural and artificial environments is a problem of great interest to both neuroscientists and artificial intelligence experts. However, standard analyses of animal training data either treat behavior as fixed, or track only coarse performance statistics (e.g., accuracy and bias), providing limited insight into the dynamic evolution of behavioral strategies over the course of learning. To overcome these limitations, we propose a dynamic psychophysical model that efficiently tracks trial-to-trial changes in behavior over the course of training.  In this talk, I will describe recent work based on a dynamic logistic regression model that captures the time-varying  dependencies of behavior on stimuli and other task covariates. We applied our method to psychophysical data from both human subjects and rats learning a sensory discrimination task. We successfully tracked the dynamics of psychophysical weights during training, capturing day-to-day and trial-to-trial fluctuations in behavioral strategy.  We leverage the model’s flexibility model to investigate why rats frequently make mistakes on easy trials, demonstrating that so-called “lapses” often arise from sub-optimal weighting of task covariates.  Finally, I will describe recent work on adaptive optimal training, which combines ideas from reinforcement learning and adaptive experimental design to formulate methods for inferring animal learning rules from behavior, and using these rules to speed up animal training.

Brief Bio

Jonathan completed his undergraduate education at the University of Arizona in Tucson, where he studied mathematics and philosophy. He received a Ph.D. in neuroscience from New York University in 2005, and was postdoctoral fellow at the Gatsby Computational Neuroscience Unit at University College London. In 2009, Jonathan became an assistant professor at the University of Texas at Austin, and in 2014 Jonathan moved to Princeton University to join the Princeton Neuroscience Institute, Psychology department, and Center for Statistics & Machine Learning. Jonathan’s current research sits at the border between neuroscience and statistical machine learning, and focuses on computational and statistical methods for understanding how large populations of neurons transmit and process information.