Search Results - "Daw, Nathaniel D."
-
1
Prioritized memory access explains planning and hippocampal replay
Published in Nature neuroscience (01-11-2018)“…To make decisions, animals must evaluate candidate choices by accessing memories of relevant experiences. Yet little is known about which experiences are…”
Get full text
Journal Article -
2
Reinforcement Learning and Episodic Memory in Humans and Animals: An Integrative Framework
Published in Annual review of psychology (03-01-2017)“…We review the psychology and neuroscience of reinforcement learning (RL), which has experienced significant progress in the past two decades, enabled by the…”
Get full text
Journal Article -
3
Self-Evaluation of Decision-Making: A General Bayesian Framework for Metacognitive Computation
Published in Psychological review (01-01-2017)“…People are often aware of their mistakes, and report levels of confidence in their choices that correlate with objective performance. These metacognitive…”
Get full text
Journal Article -
4
Linear reinforcement learning in planning, grid fields, and cognitive control
Published in Nature communications (16-08-2021)“…It is thought that the brain’s judicious reuse of previous computation underlies our ability to plan flexibly, but also that inappropriate reuse gives rise to…”
Get full text
Journal Article -
5
A model for learning based on the joint estimation of stochasticity and volatility
Published in Nature communications (15-11-2021)“…Previous research has stressed the importance of uncertainty for controlling the speed of learning, and how such control depends on the learner inferring the…”
Get full text
Journal Article -
6
Model-Based Influences on Humans' Choices and Striatal Prediction Errors
Published in Neuron (Cambridge, Mass.) (24-03-2011)“…The mesostriatal dopamine system is prominently implicated in model-free reinforcement learning, with fMRI BOLD signals in ventral striatum notably covarying…”
Get full text
Journal Article -
7
The algorithmic anatomy of model-based evaluation
Published in Philosophical transactions of the Royal Society of London. Series B. Biological sciences (05-11-2014)“…Despite many debates in the first half of the twentieth century, it is now largely a truism that humans and other animals build models of their environments…”
Get full text
Journal Article -
8
Predictive representations can link model-based reinforcement learning to model-free mechanisms
Published in PLoS computational biology (01-09-2017)“…Humans and animals are capable of evaluating actions by considering their long-run future rewards through a process described using model-based reinforcement…”
Get full text
Journal Article -
9
Computational processes of simultaneous learning of stochasticity and volatility in humans
Published in Nature communications (21-10-2024)“…Making adaptive decisions requires predicting outcomes, and this in turn requires adapting to uncertain environments. This study explores computational…”
Get full text
Journal Article -
10
Serotonin and Dopamine: Unifying Affective, Activational, and Decision Functions
Published in Neuropsychopharmacology (New York, N.Y.) (01-01-2011)“…Serotonin, like dopamine (DA), has long been implicated in adaptive behavior, including decision making and reinforcement learning. However, although the two…”
Get full text
Journal Article -
11
Biased belief updating and suboptimal choice in foraging decisions
Published in Nature communications (09-07-2020)“…Deciding which options to engage, and which to forego, requires developing accurate beliefs about the overall distribution of prospects. Here we adapt a…”
Get full text
Journal Article -
12
Learning the opportunity cost of time in a patch-foraging task
Published in Cognitive, affective, & behavioral neuroscience (01-12-2015)“…Although most decision research concerns choice between simultaneously presented options, in many situations options are encountered serially, and the decision…”
Get full text
Journal Article -
13
Specialized coding of sensory, motor and cognitive variables in VTA dopamine neurons
Published in Nature (London) (01-06-2019)“…There is increased appreciation that dopamine neurons in the midbrain respond not only to reward 1 and reward-predicting cues 1 , 2 , but also to other…”
Get full text
Journal Article -
14
A simple model for learning in volatile environments
Published in PLoS computational biology (01-07-2020)“…Sound principles of statistical inference dictate that uncertainty shapes learning. In this work, we revisit the question of learning in volatile environments,…”
Get full text
Journal Article -
15
The ubiquity of model-based reinforcement learning
Published in Current opinion in neurobiology (01-12-2012)“…Highlights ► Model-free RL is a successful theory of cortico-striatal DA function. ► Flexible model-based RL methods offer to enrich understanding of brain and…”
Get full text
Journal Article -
16
Reminders of past choices bias decisions for reward in humans
Published in Nature communications (27-06-2017)“…We provide evidence that decisions are made by consulting memories for individual past experiences, and that this process can be biased in favour of past…”
Get full text
Journal Article -
17
Taking Psychiatry Research Online
Published in Neuron (Cambridge, Mass.) (06-07-2016)“…Psychiatry is in need of a major overhaul. In order to improve the precision with which we can treat, classify, and research mental health problems, we need…”
Get full text
Journal Article -
18
Working-memory capacity protects model-based learning from stress
Published in Proceedings of the National Academy of Sciences - PNAS (24-12-2013)“…Accounts of decision-making have long posited the operation of separate, competing valuation systems in the control of choice behavior. Recent theoretical and…”
Get full text
Journal Article -
19
The importance of mixed selectivity in complex cognitive tasks
Published in Nature (London) (30-05-2013)“…Single-neuron activity in the prefrontal cortex (PFC) is tuned to mixtures of multiple task-related aspects. Such mixed selectivity is highly heterogeneous,…”
Get full text
Journal Article -
20
Characterizing a psychiatric symptom dimension related to deficits in goal-directed control
Published in eLife (01-03-2016)“…Prominent theories suggest that compulsive behaviors, characteristic of obsessive-compulsive disorder and addiction, are driven by shared deficits in…”
Get full text
Journal Article