Cover Image

Distilling the Knowledge in Data Pruning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Ben-Baruch, Emanuel, Botach, Adam, Kviatkovsky, Igor, Aggarwal, Manoj, Medioni, Gérard
Format:	Preprint
Published:	2024
Subjects:	Computer Vision and Pattern Recognition Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

LV-MAE: Learning Long Video Representations through Masked-Embedding Autoencoders
by: Naiman, Ilan, et al.
Published: (2025)

Group-Aware Reinforcement Learning for Output Diversity in Large Language Models
by: Anschel, Oron, et al.
Published: (2025)

Scene-VLM: Multimodal Video Scene Segmentation via Vision-Language Models
by: Berman, Nimrod, et al.
Published: (2025)

Data Pruning via Separability, Integrity, and Model Uncertainty-Aware Importance Sampling
by: Grosz, Steven, et al.
Published: (2024)

Data-Augmented Quantization-Aware Knowledge Distillation
by: Kur, Justin, et al.
Published: (2025)

Conditional Pseudo-Supervised Contrast for Data-Free Knowledge Distillation
by: Shao, Renrong, et al.
Published: (2025)

Diverse Image Priors for Black-box Data-free Knowledge Distillation
by: Vo, Tri-Nhan, et al.
Published: (2026)

Distill Gold from Massive Ores: Bi-level Data Pruning towards Efficient Dataset Distillation
by: Xu, Yue, et al.
Published: (2023)

CRISP: Hybrid Structured Sparsity for Class-aware Model Pruning
by: Aggarwal, Shivam, et al.
Published: (2023)

MASSV: Multimodal Adaptation and Self-Data Distillation for Speculative Decoding of Vision-Language Models
by: Ganesan, Mugilan, et al.
Published: (2025)

PruneFuse: Efficient Data Selection via Weight Pruning and Network Fusion
by: Kousar, Humaira, et al.
Published: (2026)

Data Pruning in Generative Diffusion Models
by: Briq, Rania, et al.
Published: (2024)

Continual Distillation Learning: Knowledge Distillation in Prompt-based Continual Learning
by: Zhang, Qifan, et al.
Published: (2024)

Small Scale Data-Free Knowledge Distillation
by: Liu, He, et al.
Published: (2024)

DRoP: Distributionally Robust Data Pruning
by: Vysogorets, Artem, et al.
Published: (2024)

Batch Loss Score for Dynamic Data Pruning
by: Zhou, Qing, et al.
Published: (2026)

Densely Distilling Cumulative Knowledge for Continual Learning
by: Shi, Zenglin, et al.
Published: (2024)

Forward-Backward Knowledge Distillation for Continual Clustering
by: Sadeghi, Mohammadreza, et al.
Published: (2024)

Adaptive Teaching with Shared Classifier for Knowledge Distillation
by: Jang, Jaeyeon, et al.
Published: (2024)

Knowledge Distillation Based on Transformed Teacher Matching
by: Zheng, Kaixiang, et al.
Published: (2024)

Improving Neural ODEs via Knowledge Distillation
by: Chu, Haoyu, et al.
Published: (2022)

Pixel Distillation: A New Knowledge Distillation Scheme for Low-Resolution Image Recognition
by: Guo, Guangyu, et al.
Published: (2021)

Distill the Best, Ignore the Rest: Improving Dataset Distillation with Loss-Value-Based Pruning
by: Moser, Brian B., et al.
Published: (2024)

Preview-based Category Contrastive Learning for Knowledge Distillation
by: Ding, Muhe, et al.
Published: (2024)

Enriching Knowledge Distillation with Intra-Class Contrastive Learning
by: Yuan, Hua, et al.
Published: (2025)

Distilling Knowledge from Heterogeneous Architectures for Semantic Segmentation
by: Huang, Yanglin, et al.
Published: (2025)

Adaptive Temperature Based on Logits Correlation in Knowledge Distillation
by: Matsuyama, Kazuhiro, et al.
Published: (2025)

Diffusion-based Data Augmentation and Knowledge Distillation with Generated Soft Labels Solving Data Scarcity Problems of SAR Oil Spill Segmentation
by: Moon, Jaeho, et al.
Published: (2024)

EPSD: Early Pruning with Self-Distillation for Efficient Model Compression
by: Chen, Dong, et al.
Published: (2024)

Soft Label Pruning and Quantization for Large-Scale Dataset Distillation
by: Lingao, Xiao, et al.
Published: (2026)

Data-independent Module-aware Pruning for Hierarchical Vision Transformers
by: He, Yang, et al.
Published: (2024)

On Distilling the Displacement Knowledge for Few-Shot Class-Incremental Learning
by: Fang, Pengfei, et al.
Published: (2024)

ReffAKD: Resource-efficient Autoencoder-based Knowledge Distillation
by: Doshi, Divyang, et al.
Published: (2024)

Rethinking Decoupled Knowledge Distillation: A Predictive Distribution Perspective
by: Zheng, Bowen, et al.
Published: (2025)

Topology-Guided Knowledge Distillation for Efficient Point Cloud Processing
by: Hai, Luu Tung, et al.
Published: (2025)

The Role of Masking for Efficient Supervised Knowledge Distillation of Vision Transformers
by: Son, Seungwoo, et al.
Published: (2023)

A Unified Revisit of Temperature in Classification-Based Knowledge Distillation
by: Frank, Logan, et al.
Published: (2026)

Highlight Every Step: Knowledge Distillation via Collaborative Teaching
by: Zhao, Haoran, et al.
Published: (2019)

Improving Diversity in Black-box Few-shot Knowledge Distillation
by: Vo, Tri-Nhan, et al.
Published: (2026)

Domain Generalization for Crop Segmentation with Standardized Ensemble Knowledge Distillation
by: Angarano, Simone, et al.
Published: (2023)