Information-Seeking Decision Strategies Mitigate Risk in Dynamic, Uncertain Environments

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Barendregt, Nicholas W., Gold, Joshua I., Josić, Krešimir, Kilpatrick, Zachary P.
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866916661866528768
author Barendregt, Nicholas W.
Gold, Joshua I.
Josić, Krešimir
Kilpatrick, Zachary P.
author_facet Barendregt, Nicholas W.
Gold, Joshua I.
Josić, Krešimir
Kilpatrick, Zachary P.
contents To survive in dynamic and uncertain environments, individuals must develop effective decision strategies that balance information gathering and decision commitment. Models of such strategies often prioritize either optimizing tangible payoffs, like reward rate, or gathering information to support a diversity of (possibly unknown) objectives. However, our understanding of the relative merits of these two approaches remains incomplete, in part because direct comparisons have been limited to idealized, static environments that lack the dynamic complexity of the real world. Here we compared the performance of normative reward- and information-seeking strategies in a dynamic foraging task. Both strategies show similar transitions between exploratory and exploitative behaviors as environmental uncertainty changes. However, we find subtle disparities in the actions they take, resulting in meaningful performance differences: whereas reward-seeking strategies generate slightly more reward on average, information-seeking strategies provide more consistent and predictable outcomes. Our findings support the adaptive value of information-seeking behaviors that can mitigate risk with minimal reward loss.
format Preprint
id arxiv_https___arxiv_org_abs_2503_19107
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Information-Seeking Decision Strategies Mitigate Risk in Dynamic, Uncertain Environments
Barendregt, Nicholas W.
Gold, Joshua I.
Josić, Krešimir
Kilpatrick, Zachary P.
Artificial Intelligence
Probability
Neurons and Cognition
To survive in dynamic and uncertain environments, individuals must develop effective decision strategies that balance information gathering and decision commitment. Models of such strategies often prioritize either optimizing tangible payoffs, like reward rate, or gathering information to support a diversity of (possibly unknown) objectives. However, our understanding of the relative merits of these two approaches remains incomplete, in part because direct comparisons have been limited to idealized, static environments that lack the dynamic complexity of the real world. Here we compared the performance of normative reward- and information-seeking strategies in a dynamic foraging task. Both strategies show similar transitions between exploratory and exploitative behaviors as environmental uncertainty changes. However, we find subtle disparities in the actions they take, resulting in meaningful performance differences: whereas reward-seeking strategies generate slightly more reward on average, information-seeking strategies provide more consistent and predictable outcomes. Our findings support the adaptive value of information-seeking behaviors that can mitigate risk with minimal reward loss.
title Information-Seeking Decision Strategies Mitigate Risk in Dynamic, Uncertain Environments
topic Artificial Intelligence
Probability
Neurons and Cognition
url https://arxiv.org/abs/2503.19107