Searched for: in-biosketch:yes
person:pg3
Choice-theoretic foundations of the divisive normalization model
Steverson, Kai; Brandenburger, Adam; Glimcher, Paul
Recent advances in neuroscience suggest that a utility-like calculation is involved in how the brain makes choices, and that this calculation may use a computation known as divisive normalization. While this tells us how the brain makes choices, it is not immediately evident why the brain uses this computation or exactly what behavior is consistent with it. In this paper, we address both of these questions by proving a three-way equivalence theorem between the normalization model, an information-processing model, and an axiomatic characterization. The information-processing model views behavior as optimally balancing the expected value of the chosen object against the entropic cost of reducing stochasticity in choice. This provides an optimality rationale for why the brain may have evolved to use normalization-type models. The axiomatic characterization gives a set of testable behavioral statements equivalent to the normalization model. This answers what behavior arises from normalization. Our equivalence result unifies these three models into a single theory that answers the "how", "why", and "what" of choice behavior.
PMCID:7029780
PMID: 32076358
ISSN: 0167-2681
CID: 4313252
Sensitivity of reaction time to the magnitude of rewards reveals the cost-structure of time
Steverson, Kai; Chung, Hui-Kuan; Zimmermann, Jan; Louie, Kenway; Glimcher, Paul
The Drift-Diffusion Model (DDM) is the prevalent computational model of the speed-accuracy trade-off in decision making. The DDM provides an explanation of behavior by optimally balancing reaction times and error rates. However, when applied to value-based decision making, the DDM makes the stark prediction that reaction times depend only on the relative utility difference between the options and not on absolute utility magnitudes. This prediction runs counter to evidence that reaction times decrease with higher utility magnitude. Here, we ask if and how it could be optimal for reaction times to show this observed pattern. We study an algorithmic framework that balances the cost of delaying rewards against the utility of obtained rewards. We find that the functional form of the cost of delay plays a key role, with the empirically observed pattern becoming optimal under multiplicative discounting. We add to the empirical literature by testing whether utility magnitude affects reaction times using a novel methodology that does not rely on functional form assumptions for the subjects' utilities. Our results advance the understanding of how and why reaction times are sensitive to the magnitude of rewards.
PMCID:6934862
PMID: 31882745
ISSN: 2045-2322
CID: 4250982
The Functional Roles of the Amygdala and Prefrontal Cortex in Processing Uncertainty
FeldmanHall, Oriel; Glimcher, Paul; Baker, Augustus L; Phelps, Elizabeth A
Decisions under uncertainty distinguish between those made under risk (known probabilities) and those made under ambiguity (unknown probabilities). Despite widespread interest in decisions under uncertainty and the successful documentation that these distinct psychological constructs profoundly-and differentially-impact behavior, research has not been able to systematically converge on which brain regions are functionally involved in processing risk and ambiguity. We merge a lesion approach with computational modeling and simultaneous measurement of the arousal response to investigate the impact the medial prefrontal cortex (mPFC), lateral prefrontal cortex (lPFC), and amygdala have on decisions under uncertainty. Results reveal that the lPFC acts as a unitary system for processing uncertainty: Lesions to this region disrupted the relationship between arousal and choice, broadly increasing both risk and ambiguity seeking. In contrast, the mPFC and amygdala appeared to play no role in processing risk, and the mPFC only had a tenuous relationship with ambiguous uncertainty. Together, these findings reveal that only the lPFC plays a global role in processing the highly aversive nature of uncertainty.
PMID: 31298634
ISSN: 1530-8898
CID: 4040772
An Experimental Comparison of Risky and Riskless Choice-Limitations of Prospect Theory and Expected Utility Theory
Chung, Hui-Kuan; Glimcher, Paul; Tymula, Agnieszka
ISI:000477800400002
ISSN: 1945-7669
CID: 4037952
Neural Mechanisms Guiding Choices for Cannabis and Alternative Rewards in Cannabis Smokers [Meeting Abstract]
Bedi, Gillinder; Hao, Xuejun; Konova, Anna; Van Dam, Nicholas; Glimcher, Paul; Haney, Margaret
ISI:000472661000718
ISSN: 0006-3223
CID: 3974032
Computational psychiatry of impulsivity and risk: how risk and time preferences interact in health and disease
Lopez-Guzman, Silvia; Konova, Anna B; Glimcher, Paul W
Choice impulsivity is an important subcomponent of the broader construct of impulsivity and is a key feature of many psychiatric disorders. Choice impulsivity is typically quantified as temporal discounting, a well-documented phenomenon in which a reward's subjective value diminishes as the delay to its delivery is increased. However, an individual's proclivity to-or more commonly aversion to- risk can influence nearly all of the standard experimental tools available for measuring temporal discounting. Despite this interaction, risk preference is a behaviourally and neurobiologically distinct construct that relates to the economic notion of utility or subjective value. In this opinion piece, we discuss the mathematical relationship between risk preferences and time preferences, their neural implementation, and propose ways that research in psychiatry could, and perhaps should, aim to account for this relationship experimentally to better understand choice impulsivity and its clinical implications. This article is part of the theme issue 'Risk taking and impulsive behaviour: fundamental discoveries, theoretical perspectives and clinical implications'.
PMCID:6335456
PMID: 30966919
ISSN: 1471-2970
CID: 3891702
Neural Random Utility: Relating Cardinal Neural Observables to Stochastic Choice Behavior
Webb, Ryan; Levy, Ifat; Lazzaro, Stephanie C.; Rutledge, Robb B.; Glimcher, Paul W.
We assess whether a cardinal model can he used to relate neural observables to stochastic choice behavior. We develop a general empirical framework for relating any neural observable to choice prediction and propose a means of benchmarking their predictive power. In a previous study, measurements of neural activity were made while subjects considered consumer goods. Here, we find that neural activity predicts choice behavior with the degree of stochasticity in choice related to the cardinality of the measurement. However, we also find that current methods have a significant degree of measurement error which severely limits their inferential and predictive performance. ISI:000460115000004
ISSN: 1937-321x
CID: 3733882
Advancing environmental exposure assessment science to benefit society
Caplin, Andrew; Ghandehari, Masoud; Lim, Chris; Glimcher, Paul; Thurston, George
Awareness of the human health impacts of exposure to air pollution is growing rapidly. For example, it has become evident that the adverse health effects of air pollution are more pronounced in disadvantaged populations. Policymakers in many jurisdictions have responded to this evidence by enacting initiatives that lead to lower concentrations of air pollutants, such as urban traffic restrictions. In this review, we focus on the interplay between advances in environmental exposure assessment and developments in policy. We highlight recent progress in the granular measurement of air pollutants and individual-level exposures, and how this has enabled focused local policy actions. Finally, we detail an illustrative study designed to link individual-level health-relevant exposures with economic, behavioral, biological, familial, and environmental variables.
PMID: 30874557
ISSN: 2041-1723
CID: 3733512
The emerging standard neurobiological model of decision making: Strengths, weaknesses, and future directions
Chapter by: Wu, Shih Wei; Glimcher, Paul W.
in: The Oxford Handbook of Computational Economics and Finance by
[S.l. : s.n.], 2018
pp. 688-713
ISBN: 9780199844371
CID: 3830442
Multiple timescales of normalized value coding underlie adaptive choice behavior
Zimmermann, Jan; Glimcher, Paul W; Louie, Kenway
Adaptation is a fundamental process crucial for the efficient coding of sensory information. Recent evidence suggests that similar coding principles operate in decision-related brain areas, where neural value coding adapts to recent reward history. However, the circuit mechanism for value adaptation is unknown, and the link between changes in adaptive value coding and choice behavior is unclear. Here we show that choice behavior in nonhuman primates varies with the statistics of recent rewards. Consistent with efficient coding theory, decision-making shows increased choice sensitivity in lower variance reward environments. Both the average adaptation effect and across-session variability are explained by a novel multiple timescale dynamical model of value representation implementing divisive normalization. The model predicts empirical variance-driven changes in behavior despite having no explicit knowledge of environmental statistics, suggesting that distributional characteristics can be captured by dynamic model architectures. These findings highlight the importance of treating decision-making as a dynamic process and the role of normalization as a unifying computation for contextual phenomena in choice.
PMCID:6086888
PMID: 30097577
ISSN: 2041-1723
CID: 3236552