Saved in:
Bibliographic Details
Main Authors: Xiang, Haotian, Lu, Qin, Bar-Shalom, Yaakov
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2604.03404
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866918427568898048
author Xiang, Haotian
Lu, Qin
Bar-Shalom, Yaakov
author_facet Xiang, Haotian
Lu, Qin
Bar-Shalom, Yaakov
contents Active multi-target tracking requires a mobile robot to balance exploration for undetected targets with exploitation of uncertain tracked ones. Diffusion policies have emerged as a powerful approach for capturing diverse behavioral strategies by learning action sequences from expert demonstrations. However, existing methods implicitly select among strategies through the denoising process, without uncertainty quantification over which strategy to execute. We formulate expert selection for diffusion policies as an offline contextual bandit problem and propose a Bayesian framework for pessimistic, uncertainty-aware strategy selection. A multi-head Variational Bayesian Last Layer (VBLL) model predicts the expected tracking performance of each expert strategy given the current belief state, providing both a point estimate and predictive uncertainty. Following the pessimism principle for offline decision-making, a Lower Confidence Bound (LCB) criterion then selects the expert whose worst-case predicted performance is best, avoiding overcommitment to experts with unreliable predictions. The selected expert conditions a diffusion policy to generate corresponding action sequences. Experiments on simulated indoor tracking scenarios demonstrate that our approach outperforms both the base diffusion policy and standard gating methods, including Mixture-of-Experts selection and deterministic regression baselines.
format Preprint
id arxiv_https___arxiv_org_abs_2604_03404
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Diffusion Policy with Bayesian Expert Selection for Active Multi-Target Tracking
Xiang, Haotian
Lu, Qin
Bar-Shalom, Yaakov
Robotics
Machine Learning
Active multi-target tracking requires a mobile robot to balance exploration for undetected targets with exploitation of uncertain tracked ones. Diffusion policies have emerged as a powerful approach for capturing diverse behavioral strategies by learning action sequences from expert demonstrations. However, existing methods implicitly select among strategies through the denoising process, without uncertainty quantification over which strategy to execute. We formulate expert selection for diffusion policies as an offline contextual bandit problem and propose a Bayesian framework for pessimistic, uncertainty-aware strategy selection. A multi-head Variational Bayesian Last Layer (VBLL) model predicts the expected tracking performance of each expert strategy given the current belief state, providing both a point estimate and predictive uncertainty. Following the pessimism principle for offline decision-making, a Lower Confidence Bound (LCB) criterion then selects the expert whose worst-case predicted performance is best, avoiding overcommitment to experts with unreliable predictions. The selected expert conditions a diffusion policy to generate corresponding action sequences. Experiments on simulated indoor tracking scenarios demonstrate that our approach outperforms both the base diffusion policy and standard gating methods, including Mixture-of-Experts selection and deterministic regression baselines.
title Diffusion Policy with Bayesian Expert Selection for Active Multi-Target Tracking
topic Robotics
Machine Learning
url https://arxiv.org/abs/2604.03404