Saved in:
Bibliographic Details
Main Authors: Becherer, Dirk, Reisinger, Christoph, Tam, Jonathan
Format: Preprint
Published: 2023
Subjects:
Online Access:https://arxiv.org/abs/2309.07877
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913868945555456
author Becherer, Dirk
Reisinger, Christoph
Tam, Jonathan
author_facet Becherer, Dirk
Reisinger, Christoph
Tam, Jonathan
contents We investigate mean-field games (MFG) in which agents can actively control their speed of access to information. Specifically, the agents can dynamically decide to obtain observations with reduced delay by accepting higher observation costs. Agents seek to exploit their active information acquisition by making further decisions to influence their state dynamics so as to maximise rewards. In a mean-field equilibrium, each generic agent solves individually a partially observed Markov decision problem in which the way partial observations are obtained is itself subject to dynamic control actions, while no agent can improve unilaterally given the actions of all others. We formulate the mean-field game with controlled costly information access as an equivalent standard mean-field game on an augmented space, by utilizing a parameterisation of the belief state by a finite number of variables. With sufficient entropy regularisation, a fixed point iteration converges to the unique MFG equilibrium. Moreover, we derive an approximate $\varepsilon$-Nash equilibrium for a large but finite population size and small regularisation parameter. We illustrate our (extended) MFG of information access and of controls by an example from epidemiology, where medical testing results can be procured at different speeds and costs.
format Preprint
id arxiv_https___arxiv_org_abs_2309_07877
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Mean-field games of speedy information access with observation costs
Becherer, Dirk
Reisinger, Christoph
Tam, Jonathan
Optimization and Control
93C43, 93C41, 91A16
We investigate mean-field games (MFG) in which agents can actively control their speed of access to information. Specifically, the agents can dynamically decide to obtain observations with reduced delay by accepting higher observation costs. Agents seek to exploit their active information acquisition by making further decisions to influence their state dynamics so as to maximise rewards. In a mean-field equilibrium, each generic agent solves individually a partially observed Markov decision problem in which the way partial observations are obtained is itself subject to dynamic control actions, while no agent can improve unilaterally given the actions of all others. We formulate the mean-field game with controlled costly information access as an equivalent standard mean-field game on an augmented space, by utilizing a parameterisation of the belief state by a finite number of variables. With sufficient entropy regularisation, a fixed point iteration converges to the unique MFG equilibrium. Moreover, we derive an approximate $\varepsilon$-Nash equilibrium for a large but finite population size and small regularisation parameter. We illustrate our (extended) MFG of information access and of controls by an example from epidemiology, where medical testing results can be procured at different speeds and costs.
title Mean-field games of speedy information access with observation costs
topic Optimization and Control
93C43, 93C41, 91A16
url https://arxiv.org/abs/2309.07877