SCIZOR: A Self-Supervised Approach to Data Curation for Large-Scale Imitation Learning

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Zhang, Yu, Xie, Yuqi, Liu, Huihan, Shah, Rutav, Wan, Michael, Fan, Linxi, Zhu, Yuke
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866908526248460288
author Zhang, Yu
Xie, Yuqi
Liu, Huihan
Shah, Rutav
Wan, Michael
Fan, Linxi
Zhu, Yuke
author_facet Zhang, Yu
Xie, Yuqi
Liu, Huihan
Shah, Rutav
Wan, Michael
Fan, Linxi
Zhu, Yuke
contents Imitation learning advances robot capabilities by enabling the acquisition of diverse behaviors from human demonstrations. However, large-scale datasets used for policy training often introduce substantial variability in quality, which can negatively impact performance. As a result, automatically curating datasets by filtering low-quality samples to improve quality becomes essential. Existing robotic curation approaches rely on costly manual annotations and perform curation at a coarse granularity, such as the dataset or trajectory level, failing to account for the quality of individual state-action pairs. To address this, we introduce SCIZOR, a self-supervised data curation framework that filters out low-quality state-action pairs to improve the performance of imitation learning policies. SCIZOR targets two complementary sources of low-quality data: suboptimal data, which hinders learning with undesirable actions, and redundant data, which dilutes training with repetitive patterns. SCIZOR leverages a self-supervised task progress predictor for suboptimal data to remove samples lacking task progression, and a deduplication module operating on joint state-action representation for samples with redundant patterns. Empirically, we show that SCIZOR enables imitation learning policies to achieve higher performance with less data, yielding an average improvement of 15.4% across multiple benchmarks. More information is available at: https://ut-austin-rpl.github.io/SCIZOR/
format Preprint
id arxiv_https___arxiv_org_abs_2505_22626
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle SCIZOR: A Self-Supervised Approach to Data Curation for Large-Scale Imitation Learning
Zhang, Yu
Xie, Yuqi
Liu, Huihan
Shah, Rutav
Wan, Michael
Fan, Linxi
Zhu, Yuke
Robotics
Artificial Intelligence
Machine Learning
Imitation learning advances robot capabilities by enabling the acquisition of diverse behaviors from human demonstrations. However, large-scale datasets used for policy training often introduce substantial variability in quality, which can negatively impact performance. As a result, automatically curating datasets by filtering low-quality samples to improve quality becomes essential. Existing robotic curation approaches rely on costly manual annotations and perform curation at a coarse granularity, such as the dataset or trajectory level, failing to account for the quality of individual state-action pairs. To address this, we introduce SCIZOR, a self-supervised data curation framework that filters out low-quality state-action pairs to improve the performance of imitation learning policies. SCIZOR targets two complementary sources of low-quality data: suboptimal data, which hinders learning with undesirable actions, and redundant data, which dilutes training with repetitive patterns. SCIZOR leverages a self-supervised task progress predictor for suboptimal data to remove samples lacking task progression, and a deduplication module operating on joint state-action representation for samples with redundant patterns. Empirically, we show that SCIZOR enables imitation learning policies to achieve higher performance with less data, yielding an average improvement of 15.4% across multiple benchmarks. More information is available at: https://ut-austin-rpl.github.io/SCIZOR/
title SCIZOR: A Self-Supervised Approach to Data Curation for Large-Scale Imitation Learning
topic Robotics
Artificial Intelligence
Machine Learning
url https://arxiv.org/abs/2505.22626