Cover Image

DELT: A Simple Diversity-driven EarlyLate Training for Dataset Distillation

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Shen, Zhiqiang, Sherif, Ammar, Yin, Zeyuan, Shao, Shitong
Format:	Preprint
Published:	2024
Subjects:	Computer Vision and Pattern Recognition Artificial Intelligence Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Dataset Distillation via Curriculum Data Synthesis in Large Data Era
by: Yin, Zeyuan, et al.
Published: (2023)

Self-supervised Dataset Distillation: A Good Compression Is All You Need
by: Zhou, Muxin, et al.
Published: (2024)

Elucidating the Design Space of Dataset Condensation
by: Shao, Shitong, et al.
Published: (2024)

Squeeze, Recover and Relabel: Dataset Condensation at ImageNet Scale From A New Perspective
by: Yin, Zeyuan, et al.
Published: (2023)

Generalized Large-Scale Data Condensation via Various Backbone and Statistical Matching
by: Shao, Shitong, et al.
Published: (2023)

On the Diversity and Realism of Distilled Dataset: An Efficient Dataset Distillation Paradigm
by: Sun, Peng, et al.
Published: (2023)

Dataset Distillation for Pre-Trained Self-Supervised Vision Models
by: Cazenavette, George, et al.
Published: (2025)

FerKD: Surgical Label Adaptation for Efficient Distillation
by: Shen, Zhiqiang
Published: (2023)

Diversity-Driven Generative Dataset Distillation Based on Diffusion Model with Self-Adaptive Memory
by: Li, Mingzhuo, et al.
Published: (2025)

Multi-Level Feature Distillation of Joint Teachers Trained on Distinct Image Datasets
by: Iordache, Adrian, et al.
Published: (2024)

Hyperbolic Dataset Distillation
by: Li, Wenyuan, et al.
Published: (2025)

DeiT-LT Distillation Strikes Back for Vision Transformer Training on Long-Tailed Datasets
by: Rangwani, Harsh, et al.
Published: (2024)

Generative Dataset Distillation Based on Self-knowledge Distillation
by: Li, Longzhen, et al.
Published: (2025)

Mitigating Bias in Dataset Distillation
by: Cui, Justin, et al.
Published: (2024)

Distilling Dataset into Neural Field
by: Shin, Donghyeok, et al.
Published: (2025)

Quantization Variation: A New Perspective on Training Transformers with Low-Bit Precision
by: Huang, Xijie, et al.
Published: (2023)

Unlocking Dataset Distillation with Diffusion Models
by: Moser, Brian B., et al.
Published: (2024)

Dataset Distillation via the Wasserstein Metric
by: Liu, Haoyang, et al.
Published: (2023)

Importance-Aware Adaptive Dataset Distillation
by: Li, Guang, et al.
Published: (2024)

Catch-Up Distillation: You Only Need to Train Once for Accelerating Sampling
by: Shao, Shitong, et al.
Published: (2023)

A Frustratingly Simple Yet Highly Effective Attack Baseline: Over 90% Success Rate Against the Strong Black-box Models of GPT-4.5/4o/o1
by: Li, Zhaoyi, et al.
Published: (2025)

DDIL: Diversity Enhancing Diffusion Distillation With Imitation Learning
by: Garrepalli, Risheek, et al.
Published: (2024)

Taming Diffusion for Dataset Distillation with High Representativeness
by: Zhao, Lin, et al.
Published: (2025)

Generative Dataset Distillation Based on Diffusion Model
by: Su, Duo, et al.
Published: (2024)

i-MAE: Are Latent Representations in Masked Autoencoders Linearly Separable?
by: Zhang, Kevin, et al.
Published: (2022)

Distill the Best, Ignore the Rest: Improving Dataset Distillation with Loss-Value-Based Pruning
by: Moser, Brian B., et al.
Published: (2024)

A Study in Dataset Distillation for Image Super-Resolution
by: Dietz, Tobias, et al.
Published: (2025)

SAS: Semantic-aware Sampling for Generative Dataset Distillation
by: Li, Mingzhuo, et al.
Published: (2026)

PRISM: Diversifying Dataset Distillation by Decoupling Architectural Priors
by: Moser, Brian B., et al.
Published: (2025)

Group Distributionally Robust Dataset Distillation with Risk Minimization
by: Vahidian, Saeed, et al.
Published: (2024)

EPSD: Early Pruning with Self-Distillation for Efficient Model Compression
by: Chen, Dong, et al.
Published: (2024)

Distill Gold from Massive Ores: Bi-level Data Pruning towards Efficient Dataset Distillation
by: Xu, Yue, et al.
Published: (2023)

Training-Only Heterogeneous Image-Patch-Text Graph Supervision for Advancing Few-Shot Learning Adapters
by: Mohammad, Mohammed Rahman Sherif Khan, et al.
Published: (2026)

Task-Specific Generative Dataset Distillation with Difficulty-Guided Sampling
by: Li, Mingzhuo, et al.
Published: (2025)

Soft Label Pruning and Quantization for Large-Scale Dataset Distillation
by: Lingao, Xiao, et al.
Published: (2026)

Dataset Distillation with Neural Characteristic Function: A Minmax Perspective
by: Wang, Shaobo, et al.
Published: (2025)

Generative Dataset Distillation: Balancing Global Structure and Local Details
by: Li, Longzhen, et al.
Published: (2024)

SAFE-KD: Risk-Controlled Early-Exit Distillation for Vision Backbones
by: Khazem, Salim
Published: (2026)

Deep Learning for Micro-Scale Crack Detection on Imbalanced Datasets Using Key Point Localization
by: Moreh, Fatahlla, et al.
Published: (2024)

Accelerating Large-Scale Dataset Distillation via Exploration-Exploitation Optimization
by: Alahmadi, Muhammad J., et al.
Published: (2026)