Generalized Information Gathering Under Dynamics Uncertainty

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Palafox, Fernando, Li, Jingqi, Milzman, Jesse, Fridovich-Keil, David
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910004959772672
author Palafox, Fernando
Li, Jingqi
Milzman, Jesse
Fridovich-Keil, David
author_facet Palafox, Fernando
Li, Jingqi
Milzman, Jesse
Fridovich-Keil, David
contents An agent operating in an unknown dynamical system must learn its dynamics from observations. Active information gathering accelerates this learning, but existing methods derive bespoke costs for specific modeling choices: dynamics models, belief update procedures, observation models, and planners. We present a unifying framework that decouples these choices from the information-gathering cost by explicitly exposing the causal dependencies between parameters, beliefs, and controls. Using this framework, we derive a general information-gathering cost based on Massey's directed information that assumes only Markov dynamics with additive noise and is otherwise agnostic to modeling choices. We prove that the mutual information cost used in existing literature is a special case of our cost. Then, we leverage our framework to establish an explicit connection between the mutual information cost and information gain in linearized Bayesian estimation, thereby providing theoretical justification for mutual information-based active learning approaches. Finally, we illustrate the practical utility of our framework through experiments spanning linear, nonlinear, and multi-agent systems.
format Preprint
id arxiv_https___arxiv_org_abs_2601_21988
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Generalized Information Gathering Under Dynamics Uncertainty
Palafox, Fernando
Li, Jingqi
Milzman, Jesse
Fridovich-Keil, David
Machine Learning
Artificial Intelligence
Multiagent Systems
Robotics
Systems and Control
An agent operating in an unknown dynamical system must learn its dynamics from observations. Active information gathering accelerates this learning, but existing methods derive bespoke costs for specific modeling choices: dynamics models, belief update procedures, observation models, and planners. We present a unifying framework that decouples these choices from the information-gathering cost by explicitly exposing the causal dependencies between parameters, beliefs, and controls. Using this framework, we derive a general information-gathering cost based on Massey's directed information that assumes only Markov dynamics with additive noise and is otherwise agnostic to modeling choices. We prove that the mutual information cost used in existing literature is a special case of our cost. Then, we leverage our framework to establish an explicit connection between the mutual information cost and information gain in linearized Bayesian estimation, thereby providing theoretical justification for mutual information-based active learning approaches. Finally, we illustrate the practical utility of our framework through experiments spanning linear, nonlinear, and multi-agent systems.
title Generalized Information Gathering Under Dynamics Uncertainty
topic Machine Learning
Artificial Intelligence
Multiagent Systems
Robotics
Systems and Control
url https://arxiv.org/abs/2601.21988