Cover Image

Distill the Best, Ignore the Rest: Improving Dataset Distillation with Loss-Value-Based Pruning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Moser, Brian B., Raue, Federico, Nauen, Tobias C., Frolov, Stanislav, Dengel, Andreas
Format:	Preprint
Published:	2024
Subjects:	Computer Vision and Pattern Recognition Artificial Intelligence Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

A Study in Dataset Distillation for Image Super-Resolution
by: Dietz, Tobias, et al.
Published: (2025)

Unlocking Dataset Distillation with Diffusion Models
by: Moser, Brian B., et al.
Published: (2024)

Just Leaf It: Accelerating Diffusion Classifiers with Hierarchical Class Pruning
by: Shanbhag, Arundhati S., et al.
Published: (2024)

PRISM: Diversifying Dataset Distillation by Decoupling Architectural Priors
by: Moser, Brian B., et al.
Published: (2025)

Zoomed In, Diffused Out: Towards Local Degradation-Aware Multi-Diffusion for Extreme Image Super-Resolution
by: Moser, Brian B., et al.
Published: (2024)

ForAug: Recombining Foregrounds and Backgrounds to Improve Vision Transformer Training with Bias Mitigation
by: Nauen, Tobias Christian, et al.
Published: (2025)

When Pretty Isn't Useful: Investigating Why Modern Text-to-Image Models Fail as Reliable Training Data Generators
by: Adamkiewicz, Krzysztof, et al.
Published: (2026)

A Study in Dataset Pruning for Image Super-Resolution
by: Moser, Brian B., et al.
Published: (2024)

A Low-Resolution Image is Worth 1x1 Words: Enabling Fine Image Super-Resolution with Transformers and TaylorShift
by: Nagaraju, Sanath Budakegowdanadoddi, et al.
Published: (2024)

Dynamic Attention-Guided Diffusion for Image Super-Resolution
by: Moser, Brian B., et al.
Published: (2023)

TextTeacher: What Can Language Teach About Images?
by: Nauen, Tobias Christian, et al.
Published: (2026)

Waving Goodbye to Low-Res: A Diffusion-Wavelet Approach for Image Super-Resolution
by: Moser, Brian, et al.
Published: (2023)

DWA: Differential Wavelet Amplifier for Image Super-Resolution
by: Moser, Brian B., et al.
Published: (2023)

A Coreset Selection of Coreset Selection Literature: Introduction and Recent Advances
by: Moser, Brian B., et al.
Published: (2025)

SpotDiffusion: A Fast Approach For Seamless Panorama Generation Over Time
by: Frolov, Stanislav, et al.
Published: (2024)

Federated Learning for Blind Image Super-Resolution
by: Moser, Brian B., et al.
Published: (2024)

ObjBlur: A Curriculum Learning Approach With Progressive Object-Level Blurring for Improved Layout-to-Image Generation
by: Frolov, Stanislav, et al.
Published: (2024)

Hitchhiker's Guide to Super-Resolution: Introduction and Recent Advances
by: Moser, Brian, et al.
Published: (2022)

Diffusion Models, Image Super-Resolution And Everything: A Survey
by: Moser, Brian B., et al.
Published: (2024)

Spherical Dense Text-to-Image Synthesis
by: Winter, Timon, et al.
Published: (2025)

Multi-Label Scene Classification in Remote Sensing Benefits from Image Super-Resolution
by: Mudraje, Ashitha, et al.
Published: (2025)

Which Transformer to Favor: A Comparative Analysis of Efficiency in Vision Transformers
by: Nauen, Tobias Christian, et al.
Published: (2023)

LGTM: Training-Free Light-Guided Text-to-Image Diffusion Model via Initial Noise Manipulation
by: Morita, Ryugo, et al.
Published: (2026)

LimeCross: Context-Conditioned Layered Image Editing with Structural Consistency
by: Morita, Ryugo, et al.
Published: (2026)

TKG-DM: Training-free Chroma Key Content Generation Diffusion Model
by: Morita, Ryugo, et al.
Published: (2024)

Hyperspherical Forward-Forward with Prototypical Representations
by: Sarode, Shalini, et al.
Published: (2026)

HyperCore: Coreset Selection under Noise via Hypersphere Models
by: Moser, Brian B., et al.
Published: (2025)

SubZeroCore: A Submodular Approach with Zero Training for Coreset Selection
by: Moser, Brian B., et al.
Published: (2025)

Webcam-based Pupil Diameter Prediction Benefits from Upscaling
by: Shah, Vijul, et al.
Published: (2024)

Temperature-Driven Robust Disease Detection in Brain and Gastrointestinal Disorders via Context-Aware Adaptive Knowledge Distillation
by: Khan, Saif Ur Rehman, et al.
Published: (2025)

Distilling the Knowledge in Data Pruning
by: Ben-Baruch, Emanuel, et al.
Published: (2024)

Comb, Prune, Distill: Towards Unified Pruning for Vision Model Compression
by: Schmitt, Jonas, et al.
Published: (2024)

PupilSense: A Novel Application for Webcam-Based Pupil Diameter Estimation
by: Shah, Vijul, et al.
Published: (2024)

Towards Facilitated Fairness Assessment of AI-based Skin Lesion Classifiers Through GenAI-based Image Synthesis
by: Watanabe, Ko, et al.
Published: (2025)

Curriculum Dataset Distillation
by: Ma, Zhiheng, et al.
Published: (2024)

Improve Cross-Architecture Generalization on Dataset Distillation
by: Zhou, Binglin, et al.
Published: (2024)

Soft Label Pruning and Quantization for Large-Scale Dataset Distillation
by: Lingao, Xiao, et al.
Published: (2026)

Distill Gold from Massive Ores: Bi-level Data Pruning towards Efficient Dataset Distillation
by: Xu, Yue, et al.
Published: (2023)

On-Policy Distillation with Best-of-N Teacher Rollout Selection
by: Zhang, Ke, et al.
Published: (2026)

Pluggable Pruning with Contiguous Layer Distillation for Diffusion Transformers
by: Ma, Jian, et al.
Published: (2025)