Searched for: in-biosketch:yes
person:kl837
Dynamic divisive normalization predicts time-varying value coding in decision-related circuits
Louie, Kenway; LoFaro, Thomas; Webb, Ryan; Glimcher, Paul W
Normalization is a widespread neural computation, mediating divisive gain control in sensory processing and implementing a context-dependent value code in decision-related frontal and parietal cortices. Although decision-making is a dynamic process with complex temporal characteristics, most models of normalization are time-independent and little is known about the dynamic interaction of normalization and choice. Here, we show that a simple differential equation model of normalization explains the characteristic phasic-sustained pattern of cortical decision activity and predicts specific normalization dynamics: value coding during initial transients, time-varying value modulation, and delayed onset of contextual information. Empirically, we observe these predicted dynamics in saccade-related neurons in monkey lateral intraparietal cortex. Furthermore, such models naturally incorporate a time-weighted average of past activity, implementing an intrinsic reference-dependence in value coding. These results suggest that a single network mechanism can explain both transient and sustained decision activity, emphasizing the importance of a dynamic view of normalization in neural coding.
PMCID:4244470
PMID: 25429145
ISSN: 0270-6474
CID: 1418892
The Temporal Dynamics of Cortical Normalization Models of Decision-making
LoFaro, Thomas; Louie, Kenway; Webb, Ryan; Glimcher, Paul W
Normalization is a widespread neural computation in both early sensory coding and higher-order processes such as attention and multisensory integration. It has been shown that during decision-making, normalization implements a context-dependent value code in parietal cortex. In this paper we develop a simple differential equations model based on presumed neural circuitry that implements normalization at equilibrium and predicts specific time-varying properties of value coding. Moreover, we show that when parameters representing value are changed, the solution curves change in a manner consistent with normalization theory and experiment. We show that these dynamic normalization models naturally implement a time-discounted normalization over past activity, implying an intrinsic reference-dependence in value coding of a kind seen experimentally. These results suggest that a single network mechanism can explain transient and sustained decision activity, reference dependence through time discounting, and hence emphasizes the importance of a dynamic rather than static view of divisive normalization in neural coding
ORIGINAL:0013346
ISSN: 2373-7867
CID: 3702922
Exploiting exploration: past outcomes and future actions [Comment]
Louie, Kenway
Applying past knowledge to future actions is crucial for adaptive choice behavior. Here, in this issue of Neuron, Donahue et al. (2013) show that reward enhances neural coding reliability for actions in a network of frontal and parietal brain areas.
PMID: 24094098
ISSN: 1097-4199
CID: 3702882
Integrating salience and value in decision making [Comment]
Louie, Kenway
PMID: 24052529
ISSN: 1091-6490
CID: 3702872
Thirst-dependent risk preferences in monkeys identify a primitive form of wealth
Yamada, Hiroshi; Tymula, Agnieszka; Louie, Kenway; Glimcher, Paul W
Experimental economic techniques have been widely used to evaluate human risk attitudes, but how these measured attitudes relate to overall individual wealth levels is unclear. Previous noneconomic work has addressed this uncertainty in animals by asking the following: (i) Do our close evolutionary relatives share both our risk attitudes and our degree of economic rationality? And (ii) how does the amount of food or water one holds (a nonpecuniary form of "wealth") alter risk attitudes in these choosers? Unfortunately, existing noneconomic studies have provided conflicting insights from an economic point of view. We therefore used standard techniques from human experimental economics to measure monkey risk attitudes for water rewards as a function of blood osmolality (an objective measure of how much water the subjects possess). Early in training, monkeys behaved randomly, consistently violating first-order stochastic dominance and monotonicity. After training, they behaved like human choosers-technically consistent in their choices and weakly risk averse (i.e., risk averse or risk neutral on average)-suggesting that well-trained monkeys can serve as a model for human choice behavior. As with attitudes about money in humans, these risk attitudes were strongly wealth dependent; as the animals became "poorer," risk aversion increased, a finding incompatible with some models of wealth and risk in human decision making.
PMCID:3785724
PMID: 24019461
ISSN: 0027-8424
CID: 576092
Normalization is a general neural mechanism for context-dependent decision making
Louie, Kenway; Khaw, Mel W; Glimcher, Paul W
Understanding the neural code is critical to linking brain and behavior. In sensory systems, divisive normalization seems to be a canonical neural computation, observed in areas ranging from retina to cortex and mediating processes including contrast adaptation, surround suppression, visual attention, and multisensory integration. Recent electrophysiological studies have extended these insights beyond the sensory domain, demonstrating an analogous algorithm for the value signals that guide decision making, but the effects of normalization on choice behavior are unknown. Here, we show that choice models using normalization generate significant (and classically irrational) choice phenomena driven by either the value or number of alternative options. In value-guided choice experiments, both monkey and human choosers show novel context-dependent behavior consistent with normalization. These findings suggest that the neural mechanism of value coding critically influences stochastic choice behavior and provide a generalizable quantitative framework for examining context effects in decision making.
PMCID:3625302
PMID: 23530203
ISSN: 0027-8424
CID: 367562
The neurobiology of context-dependent valuation and choice
Chapter by: Louie, Kenway; de Martino, B
in: Neuroeconomics: Decision Making and the Brain by
[S.l. : s.n.], 2013
pp. ?-?
ISBN: 9780124160088
CID: 3702932
Set-Size Effects and the Neural Representation of Value
Chapter by: Louie, Kenway; Glimcher, Paul W.
in: Neuroscience of Preference and Choice by
[S.l.] : Elsevier Inc., 2012
pp. 143-173
ISBN: 9780123814319
CID: 2817352
Reward and punishment illuminated [Comment]
Paton, Joseph J; Louie, Kenway
PMID: 22627791
ISSN: 1546-1726
CID: 3702862
Efficient coding and the neural representation of value
Louie, Kenway; Glimcher, Paul W
To survive in a dynamic environment, an organism must be able to effectively learn, store, and recall the expected benefits and costs of potential actions. The nature of the valuation and decision processes is thus of fundamental interest to researchers at the intersection of psychology, neuroscience, and economics. Although normative theories of choice have outlined the theoretical structure of these valuations, recent experiments have begun to reveal how value is instantiated in the activity of neurons and neural circuits. Here, we review the various forms of value coding that have been observed in different brain systems and examine the implications of these value representations for both neural circuits and behavior. In particular, we focus on emerging evidence that value coding in a number of brain areas is context dependent, varying as a function of both the current choice set and previously experienced values. Similar contextual modulation occurs widely in the sensory system, and efficient coding principles derived in the sensory domain suggest a new framework for understanding the neural coding of value.
PMID: 22694213
ISSN: 0077-8923
CID: 198942