Cover Image

Dataset Distillation for Pre-Trained Self-Supervised Vision Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Cazenavette, George, Torralba, Antonio, Sitzmann, Vincent
Format:	Preprint
Published:	2025
Subjects:	Computer Vision and Pattern Recognition Artificial Intelligence Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

True Self-Supervised Novel View Synthesis is Transferable
by: Mitchel, Thomas W., et al.
Published: (2025)

FakeInversion: Learning to Detect Images from Unseen Text-to-Image Models by Inverting Stable Diffusion
by: Cazenavette, George, et al.
Published: (2024)

Masked Self-Supervised Pre-Training for Text Recognition Transformers on Large-Scale Datasets
by: Kišš, Martin, et al.
Published: (2025)

Closed-Form Linear-Probe Dataset Distillation for Pre-trained Vision Models
by: Peng, Bincheng, et al.
Published: (2026)

Understanding Multi-View Transformers
by: Stary, Michal, et al.
Published: (2025)

Bridging Diversity and Uncertainty in Active learning with Self-Supervised Pre-Training
by: Doucet, Paul, et al.
Published: (2024)

DiNO-Diffusion. Scaling Medical Diffusion via Self-Supervised Pre-Training
by: Jimenez-Perez, Guillermo, et al.
Published: (2024)

Neural Isometries: Taming Transformations for Equivariant ML
by: Mitchel, Thomas W., et al.
Published: (2024)

DeiT-LT Distillation Strikes Back for Vision Transformer Training on Long-Tailed Datasets
by: Rangwani, Harsh, et al.
Published: (2024)

Generative Dataset Distillation Based on Self-knowledge Distillation
by: Li, Longzhen, et al.
Published: (2025)

COSMOS: Cross-Modality Self-Distillation for Vision Language Pre-training
by: Kim, Sanghwan, et al.
Published: (2024)

Self-Supervised Quantization-Aware Knowledge Distillation
by: Zhao, Kaiqi, et al.
Published: (2024)

Pre-training Vision Transformers with Formula-driven Supervised Learning
by: Kataoka, Hirokatsu, et al.
Published: (2022)

Diversity-Driven Generative Dataset Distillation Based on Diffusion Model with Self-Adaptive Memory
by: Li, Mingzhuo, et al.
Published: (2025)

Unlocking Dataset Distillation with Diffusion Models
by: Moser, Brian B., et al.
Published: (2024)

On the Diversity and Realism of Distilled Dataset: An Efficient Dataset Distillation Paradigm
by: Sun, Peng, et al.
Published: (2023)

Multi-Level Knowledge Distillation and Dynamic Self-Supervised Learning for Continual Learning
by: Kim, Taeheon, et al.
Published: (2025)

An Empirical Study into Clustering of Unseen Datasets with Self-Supervised Encoders
by: Lowe, Scott C., et al.
Published: (2024)

DELT: A Simple Diversity-driven EarlyLate Training for Dataset Distillation
by: Shen, Zhiqiang, et al.
Published: (2024)

Multi-Level Feature Distillation of Joint Teachers Trained on Distinct Image Datasets
by: Iordache, Adrian, et al.
Published: (2024)

Generative Dataset Distillation Based on Diffusion Model
by: Su, Duo, et al.
Published: (2024)

A Survey of the Self Supervised Learning Mechanisms for Vision Transformers
by: Khan, Asifullah, et al.
Published: (2024)

Investigating Pre-Training Objectives for Generalization in Vision-Based Reinforcement Learning
by: Kim, Donghu, et al.
Published: (2024)

Turning Video Models into Generalist Robot Policies
by: Li, Sizhe Lester, et al.
Published: (2026)

Hyperbolic Dataset Distillation
by: Li, Wenyuan, et al.
Published: (2025)

DiffEM: Learning from Corrupted Data with Diffusion Models via Expectation Maximization
by: Hosseintabar, Danial, et al.
Published: (2025)

Open-Vocabulary Panoptic Segmentation Using BERT Pre-Training of Vision-Language Multiway Transformer Model
by: Chen, Yi-Chia, et al.
Published: (2024)

SafeR-CLIP: Mitigating NSFW Content in Vision-Language Models While Preserving Pre-Trained Knowledge
by: Yousaf, Adeel, et al.
Published: (2025)

Self-Supervised Disentanglement by Leveraging Structure in Data Augmentations
by: Eastwood, Cian, et al.
Published: (2023)

Distilling Dataset into Neural Field
by: Shin, Donghyeok, et al.
Published: (2025)

Mitigating Bias in Dataset Distillation
by: Cui, Justin, et al.
Published: (2024)

When Does Supervised Training Pay Off? The Hidden Economics of Object Detection in the Era of Vision-Language Models
by: Al-Hamadani, Samer
Published: (2025)

Dataset Ownership Verification in Contrastive Pre-trained Models
by: Xie, Yuechen, et al.
Published: (2025)

Orchestrate Latent Expertise: Advancing Online Continual Learning with Multi-Level Supervision and Reverse Self-Distillation
by: Yan, HongWei, et al.
Published: (2024)

EUDA: An Efficient Unsupervised Domain Adaptation via Self-Supervised Vision Transformer
by: Abedi, Ali, et al.
Published: (2024)

Practical Continual Forgetting for Pre-trained Vision Models
by: Zhao, Hongbo, et al.
Published: (2025)

Dataset Distillation via the Wasserstein Metric
by: Liu, Haoyang, et al.
Published: (2023)

Importance-Aware Adaptive Dataset Distillation
by: Li, Guang, et al.
Published: (2024)

Rethinking the Role of Spatial Mixing
by: Cazenavette, George, et al.
Published: (2025)

Towards Long-window Anchoring in Vision-Language Model Distillation
by: Zhou, Haoyi, et al.
Published: (2025)