Breaking Lock-In: Preserving Steerability under Low-Data VLA Post-Training

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Huang, Suning, Shao, Jiaqi, Wang, Ke, Chen, Qianzhong, Sun, Jiankai, Guo, Yanjiang, Schwager, Mac, Bohg, Jeannette
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866911622567559168
author Huang, Suning
Shao, Jiaqi
Wang, Ke
Chen, Qianzhong
Sun, Jiankai
Guo, Yanjiang
Schwager, Mac
Bohg, Jeannette
author_facet Huang, Suning
Shao, Jiaqi
Wang, Ke
Chen, Qianzhong
Sun, Jiankai
Guo, Yanjiang
Schwager, Mac
Bohg, Jeannette
contents Have you ever post-trained a generalist vision-language-action (VLA) policy on a small demonstration dataset, only to find that it stops responding to new instructions and is limited to behaviors observed during post-training? We identify this phenomenon as lock-in: after low-data, supervised fine-tuning (SFT), the policy becomes overly specialized to the post-training data and fails to generalize to novel instructions, manifesting as concept lock-in (fixation on training objects/attributes) and spatial lock-in (fixation on training spatial targets). Many existing remedies introduce additional supervision signals, such as those derived from foundation models or auxiliary objectives, or rely on augmented datasets to recover generalization. In this paper, we show that the policy's internal pre-trained knowledge is sufficient: DeLock mitigates lock-in by preserving visual grounding during post-training and applying test-time contrastive prompt guidance to steer the policy's denoising dynamics according to novel instructions. Across eight simulation and real-world evaluations, DeLock consistently outperforms strong baselines and matches or exceeds the performance of a state-of-the-art generalist policy post-trained with substantially more curated demonstrations.
format Preprint
id arxiv_https___arxiv_org_abs_2604_23121
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Breaking Lock-In: Preserving Steerability under Low-Data VLA Post-Training
Huang, Suning
Shao, Jiaqi
Wang, Ke
Chen, Qianzhong
Sun, Jiankai
Guo, Yanjiang
Schwager, Mac
Bohg, Jeannette
Robotics
Computer Vision and Pattern Recognition
Have you ever post-trained a generalist vision-language-action (VLA) policy on a small demonstration dataset, only to find that it stops responding to new instructions and is limited to behaviors observed during post-training? We identify this phenomenon as lock-in: after low-data, supervised fine-tuning (SFT), the policy becomes overly specialized to the post-training data and fails to generalize to novel instructions, manifesting as concept lock-in (fixation on training objects/attributes) and spatial lock-in (fixation on training spatial targets). Many existing remedies introduce additional supervision signals, such as those derived from foundation models or auxiliary objectives, or rely on augmented datasets to recover generalization. In this paper, we show that the policy's internal pre-trained knowledge is sufficient: DeLock mitigates lock-in by preserving visual grounding during post-training and applying test-time contrastive prompt guidance to steer the policy's denoising dynamics according to novel instructions. Across eight simulation and real-world evaluations, DeLock consistently outperforms strong baselines and matches or exceeds the performance of a state-of-the-art generalist policy post-trained with substantially more curated demonstrations.
title Breaking Lock-In: Preserving Steerability under Low-Data VLA Post-Training
topic Robotics
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2604.23121