AdaTracker: Learning Adaptive In-Context Policy for Cross-Embodiment Active Visual Tracking

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Wu, Kui, Chen, Hao, Han, Jinzhu, Liu, Haijun, Wang, Churan, Wang, Yizhou, Li, Zhoujun, Liu, Si, Zhong, Fangwei
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911614143299584
author Wu, Kui
Chen, Hao
Han, Jinzhu
Liu, Haijun
Wang, Churan
Wang, Yizhou
Li, Zhoujun
Liu, Si
Zhong, Fangwei
author_facet Wu, Kui
Chen, Hao
Han, Jinzhu
Liu, Haijun
Wang, Churan
Wang, Yizhou
Li, Zhoujun
Liu, Si
Zhong, Fangwei
contents Realizing active visual tracking with a single unified model across diverse robots is challenging, as the physical constraints and motion dynamics vary drastically from one platform to another. Existing approaches typically train separate models for each embodiment, leading to poor scalability and limited generalization. To address this, we propose AdaTracker, an adaptive in-context policy learning framework that robustly tracks targets on diverse robot morphologies. Our key insight is to explicitly model embodiment-specific constraints through an Embodiment Context Encoder, which infers embodiment-specific constraints from history. This contextual representation dynamically modulates a Context-Aware Policy, enabling it to infer optimal control actions for unseen embodiments in a zero-shot manner. To enhance robustness, we introduce two auxiliary objectives to ensure accurate context identification and temporal consistency. Experiments in both simulation and the real world demonstrate that AdaTracker significantly outperforms state-of-the-art methods in cross-embodiment generalization, sample efficiency, and zero-shot adaptation.
format Preprint
id arxiv_https___arxiv_org_abs_2604_20305
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle AdaTracker: Learning Adaptive In-Context Policy for Cross-Embodiment Active Visual Tracking
Wu, Kui
Chen, Hao
Han, Jinzhu
Liu, Haijun
Wang, Churan
Wang, Yizhou
Li, Zhoujun
Liu, Si
Zhong, Fangwei
Robotics
Realizing active visual tracking with a single unified model across diverse robots is challenging, as the physical constraints and motion dynamics vary drastically from one platform to another. Existing approaches typically train separate models for each embodiment, leading to poor scalability and limited generalization. To address this, we propose AdaTracker, an adaptive in-context policy learning framework that robustly tracks targets on diverse robot morphologies. Our key insight is to explicitly model embodiment-specific constraints through an Embodiment Context Encoder, which infers embodiment-specific constraints from history. This contextual representation dynamically modulates a Context-Aware Policy, enabling it to infer optimal control actions for unseen embodiments in a zero-shot manner. To enhance robustness, we introduce two auxiliary objectives to ensure accurate context identification and temporal consistency. Experiments in both simulation and the real world demonstrate that AdaTracker significantly outperforms state-of-the-art methods in cross-embodiment generalization, sample efficiency, and zero-shot adaptation.
title AdaTracker: Learning Adaptive In-Context Policy for Cross-Embodiment Active Visual Tracking
topic Robotics
url https://arxiv.org/abs/2604.20305