You've Got a Golden Ticket: Improving Generative Robot Policies With A Single Noise Vector

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Patil, Omkar, Biza, Ondrej, Weng, Thomas, Schmeckpeper, Karl, Thomason, Wil, Zhang, Xiaohan, Walters, Robin, Gopalan, Nakul, Castro, Sebastian, Rosen, Eric
Format: Preprint
Veröffentlicht: 2026
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866911582119788544
author Patil, Omkar
Biza, Ondrej
Weng, Thomas
Schmeckpeper, Karl
Thomason, Wil
Zhang, Xiaohan
Walters, Robin
Gopalan, Nakul
Castro, Sebastian
Rosen, Eric
author_facet Patil, Omkar
Biza, Ondrej
Weng, Thomas
Schmeckpeper, Karl
Thomason, Wil
Zhang, Xiaohan
Walters, Robin
Gopalan, Nakul
Castro, Sebastian
Rosen, Eric
contents What happens when a pretrained generative robot policy is provided a constant initial noise as input, rather than repeatedly sampling it from a Gaussian? We demonstrate that the performance of a pretrained, frozen diffusion or flow matching policy can be improved with respect to a downstream reward by swapping the sampling of initial noise from the prior distribution (typically isotropic Gaussian) with a well-chosen, constant initial noise input -- a golden ticket. We propose a search method to find golden tickets using Monte-Carlo policy evaluation that keeps the pretrained policy frozen, does not train any new networks, and is applicable to all diffusion/flow matching policies (and therefore many VLAs). Our approach to policy improvement makes no assumptions beyond being able to inject initial noise into the policy and calculate (sparse) task rewards of episode rollouts, making it deployable with no additional infrastructure or models. Our method improves the performance of policies in 38 out of 43 tasks across simulated and real-world robot manipulation benchmarks, with relative improvements in success rate by up to 58% for some simulated tasks, and 60% within 50 search episodes for real-world tasks. We also show unique benefits of golden tickets for multi-task settings: the diversity of behaviors from different tickets naturally defines a Pareto frontier for balancing different objectives (e.g., speed, success rates); in VLAs, we find that a golden ticket optimized for one task can also boost performance in other related tasks. We release a codebase with pretrained policies and golden tickets for simulation benchmarks using VLAs, diffusion policies, and flow matching policies.
format Preprint
id arxiv_https___arxiv_org_abs_2603_15757
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle You've Got a Golden Ticket: Improving Generative Robot Policies With A Single Noise Vector
Patil, Omkar
Biza, Ondrej
Weng, Thomas
Schmeckpeper, Karl
Thomason, Wil
Zhang, Xiaohan
Walters, Robin
Gopalan, Nakul
Castro, Sebastian
Rosen, Eric
Robotics
Artificial Intelligence
What happens when a pretrained generative robot policy is provided a constant initial noise as input, rather than repeatedly sampling it from a Gaussian? We demonstrate that the performance of a pretrained, frozen diffusion or flow matching policy can be improved with respect to a downstream reward by swapping the sampling of initial noise from the prior distribution (typically isotropic Gaussian) with a well-chosen, constant initial noise input -- a golden ticket. We propose a search method to find golden tickets using Monte-Carlo policy evaluation that keeps the pretrained policy frozen, does not train any new networks, and is applicable to all diffusion/flow matching policies (and therefore many VLAs). Our approach to policy improvement makes no assumptions beyond being able to inject initial noise into the policy and calculate (sparse) task rewards of episode rollouts, making it deployable with no additional infrastructure or models. Our method improves the performance of policies in 38 out of 43 tasks across simulated and real-world robot manipulation benchmarks, with relative improvements in success rate by up to 58% for some simulated tasks, and 60% within 50 search episodes for real-world tasks. We also show unique benefits of golden tickets for multi-task settings: the diversity of behaviors from different tickets naturally defines a Pareto frontier for balancing different objectives (e.g., speed, success rates); in VLAs, we find that a golden ticket optimized for one task can also boost performance in other related tasks. We release a codebase with pretrained policies and golden tickets for simulation benchmarks using VLAs, diffusion policies, and flow matching policies.
title You've Got a Golden Ticket: Improving Generative Robot Policies With A Single Noise Vector
topic Robotics
Artificial Intelligence
url https://arxiv.org/abs/2603.15757