Pragmatic Curiosity: A Unified Framework for Hybrid Learning and Optimization via Active Inference

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Li, Yingke, Parashar, Anjali, Zhou, Enlu, Fan, Chuchu
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911676603826176
author Li, Yingke
Parashar, Anjali
Zhou, Enlu
Fan, Chuchu
author_facet Li, Yingke
Parashar, Anjali
Zhou, Enlu
Fan, Chuchu
contents Many engineering and scientific workflows rely on expensive black-box evaluations, requiring sequential decisions that must both improve task performance and reduce uncertainty. Bayesian optimization (BO) and Bayesian experimental design (BED) provide powerful but largely separate treatments of goal-directed optimization and information-seeking experimentation, leaving limited guidance for hybrid settings in which learning and optimization are intrinsically coupled. We propose Pragmatic Curiosity (PraC), a unified framework for hybrid learning and optimization via active inference. PraC evaluates candidate queries by trading information gain about a task-relevant latent symbol against an expected regret-based potential over outcomes. This formulation exposes three operational design choices: which latent quantity should be clarified, how task value is encoded as regret, and how strongly information gain should be exchanged against pragmatic value. We instantiate PraC across three regimes of increasing complexity: decision-oriented plume monitoring with fixed global symbols and known downstream losses, targeted active search with induced local symbols and evolving coverage goals, and composite Bayesian optimization with hierarchical regret learning under unknown preferences. Across these regimes, PraC reduces downstream decision risk, improves coverage of critical outcome regions, and jointly learns predictive and preference structures without relying on task-specific staging rules.
format Preprint
id arxiv_https___arxiv_org_abs_2602_06104
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Pragmatic Curiosity: A Unified Framework for Hybrid Learning and Optimization via Active Inference
Li, Yingke
Parashar, Anjali
Zhou, Enlu
Fan, Chuchu
Machine Learning
Many engineering and scientific workflows rely on expensive black-box evaluations, requiring sequential decisions that must both improve task performance and reduce uncertainty. Bayesian optimization (BO) and Bayesian experimental design (BED) provide powerful but largely separate treatments of goal-directed optimization and information-seeking experimentation, leaving limited guidance for hybrid settings in which learning and optimization are intrinsically coupled. We propose Pragmatic Curiosity (PraC), a unified framework for hybrid learning and optimization via active inference. PraC evaluates candidate queries by trading information gain about a task-relevant latent symbol against an expected regret-based potential over outcomes. This formulation exposes three operational design choices: which latent quantity should be clarified, how task value is encoded as regret, and how strongly information gain should be exchanged against pragmatic value. We instantiate PraC across three regimes of increasing complexity: decision-oriented plume monitoring with fixed global symbols and known downstream losses, targeted active search with induced local symbols and evolving coverage goals, and composite Bayesian optimization with hierarchical regret learning under unknown preferences. Across these regimes, PraC reduces downstream decision risk, improves coverage of critical outcome regions, and jointly learns predictive and preference structures without relying on task-specific staging rules.
title Pragmatic Curiosity: A Unified Framework for Hybrid Learning and Optimization via Active Inference
topic Machine Learning
url https://arxiv.org/abs/2602.06104