Perceptual decisions in a multisensory world
The sensory milieu is complex and dynamic, furnishing multiple streams of behaviorally relevant information, yet also characterized by ambiguity and uncertainty. How do we make sense of this deluge of information and use it to guide our actions?
We study this question in the context of self-motion perception and spatial orientation. As we navigate and reposition ourselves within an environment, the relative motion of world-fixed objects and surfaces provides a rich source of visual information about these movements. At the same time, signals from the vestibular system and body proprioceptors offer complementary information about inertial motion and orientation relative to gravity. We think the brain has evolved specialized circuits and computational strategies for combining these signals, but still know relatively little about where and how this occurs.
We use a 6-degree-of-freedom motion platform and 3D visual display to deliver visual and nonvisual self-motion cues while recording and manipulating neural activity in multisensory and decision-related brain areas. The goal is to advance toward a quantitative, mechanistic understanding of how the brain solves the general problem of combining signals from multiple concurrent sources.
Decision confidence and metacognition
Decisions carry with them a sense of certainty, or confidence — the degree of belief that a pending decision will turn out to be correct. Confidence is crucial for guiding behavior in complex environments, yet only recently has it become amenable to neuroscientific investigation. We use behavioral assays to ask monkeys how confident they are in decisions based on visual and/or vestibular cues, then relate population neural activity to these 'metacognitive' judgments with the aid of computational models. Ultimately we want to understand not only how confidence is generated but how it is subsequently used by downstream brain structures to adjust decision policy and strategy.
Interactions between sensory uncertainty and reward uncertainty
Real-world decisions often involve figuring out first what’s out there in the world (a perceptual decision from uncertain sensory evidence), then what is the best course of action (a value-based decision governed by reward history). We are designing new behavioral tasks and recording experiments to better understand how the brain makes decisions that involve both a perceptual component and probabilistic reward contingencies — stay tuned.