Image de couverture de livre

A Survey on Pre-Trained Diffusion Model Distillations

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Fan, Xuhui, Wu, Zhangkai, Wu, Hongyu
Format:	Preprint
Publié:	2025
Sujets:	Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

SCoT: Unifying Consistency Models and Rectified Flows via Straight-Consistent Trajectories
par: Wu, Zhangkai, et autres
Publié: (2025)

FigBO: A Generalized Acquisition Function Framework with Look-Ahead Capability for Bayesian Optimization
par: Chen, Hui, et autres
Publié: (2025)

FedSI: Federated Subnetwork Inference for Efficient Uncertainty Quantification
par: Chen, Hui, et autres
Publié: (2024)

ParamReL: Learning Parameter Space Representation via Progressively Encoding Bayesian Flow Networks
par: Wu, Zhangkai, et autres
Publié: (2024)

Nested AutoRegressive Models
par: Wu, Hongyu, et autres
Publié: (2025)

A Temporally Disentangled Contrastive Diffusion Model for Spatiotemporal Imputation
par: Chen, Yakun, et autres
Publié: (2024)

Practical Insights into Knowledge Distillation for Pre-Trained Models
par: Alballa, Norah, et autres
Publié: (2024)

eVAE: Evolutionary Variational Autoencoder
par: Wu, Zhangkai, et autres
Publié: (2023)

A Survey on Time-Series Pre-Trained Models
par: Ma, Qianli, et autres
Publié: (2023)

Diffusion Models as Dataset Distillation Priors
par: Su, Duo, et autres
Publié: (2025)

On the Surprising Efficacy of Distillation as an Alternative to Pre-Training Small Models
par: Farhat, Sean, et autres
Publié: (2024)

Continual Learning with Pre-Trained Models: A Survey
par: Zhou, Da-Wei, et autres
Publié: (2024)

Weakly Augmented Variational Autoencoder in Time Series Anomaly Detection
par: Wu, Zhangkai, et autres
Publié: (2024)

Dataset Distillation via Knowledge Distillation: Towards Efficient Self-Supervised Pre-Training of Deep Networks
par: Joshi, Siddharth, et autres
Publié: (2024)

Knowledge Distillation in Federated Edge Learning: A Survey
par: Wu, Zhiyuan, et autres
Publié: (2023)

TimeSiam: A Pre-Training Framework for Siamese Time-Series Modeling
par: Dong, Jiaxiang, et autres
Publié: (2024)

Dataset Distillation for Pre-Trained Self-Supervised Vision Models
par: Cazenavette, George, et autres
Publié: (2025)

Distributional Statistics Restore Training Data Auditability in One-step Distilled Diffusion Models
par: Li, Muxing, et autres
Publié: (2025)

MoTE: Mixture of Task-specific Experts for Pre-Trained ModelBased Class-incremental Learning
par: Li, Linjie, et autres
Publié: (2025)

DRDT3: Diffusion-Refined Decision Test-Time Training Model
par: Huang, Xingshuai, et autres
Publié: (2025)

Lightning OPD: Efficient Post-Training for Large Reasoning Models with Offline On-Policy Distillation
par: Wu, Yecheng, et autres
Publié: (2026)

EM Distillation for One-step Diffusion Models
par: Xie, Sirui, et autres
Publié: (2024)

Pre-Training Graph Contrastive Masked Autoencoders are Strong Distillers for EEG
par: Wei, Xinxu, et autres
Publié: (2024)

Hyper-modal Imputation Diffusion Embedding with Dual-Distillation for Federated Multimodal Knowledge Graph Completion
par: Zhang, Ying, et autres
Publié: (2025)

Stochastic Forward-Backward Deconvolution: Training Diffusion Models with Finite Noisy Datasets
par: Lu, Haoye, et autres
Publié: (2025)

SGMD: Score Gradient Matching Distillation for Few-Step Video Diffusion Distillation
par: Wu, Zhuguanyu, et autres
Publié: (2026)

Federated Distillation: A Survey
par: Li, Lin, et autres
Publié: (2024)

DiffusionOPD: A Unified Perspective of On-Policy Distillation in Diffusion Models
par: Li, Quanhao, et autres
Publié: (2026)

Text-to-Model: Text-Conditioned Neural Network Diffusion for Train-Once-for-All Personalization
par: Li, Zexi, et autres
Publié: (2024)

Embedding Hidden Adversarial Capabilities in Pre-Trained Diffusion Models
par: Beerens, Lucas, et autres
Publié: (2025)

PTMs-TSCIL Pre-Trained Models Based Class-Incremental Learning
par: Wu, Yuanlong, et autres
Publié: (2025)

A Comprehensive Survey on Joint Resource Allocation Strategies in Federated Edge Learning
par: Zhang, Jingbo, et autres
Publié: (2024)

Annealing Self-Distillation Rectification Improves Adversarial Training
par: Wu, Yu-Yu, et autres
Publié: (2023)

Shortcutting Pre-trained Flow Matching Diffusion Models is Almost Free Lunch
par: Cai, Xu, et autres
Publié: (2025)

Mixture-of-Channels: Exploiting Sparse FFNs for Efficient LLMs Pre-Training and Inference
par: Wu, Tong, et autres
Publié: (2025)

A Two-Stage Data Selection Framework for Data-Efficient Model Training on Edge Devices
par: Gong, Chen, et autres
Publié: (2025)

Unlocking Data Value in Finance: A Study on Distillation and Difficulty-Aware Training
par: Cao, Chuxue, et autres
Publié: (2026)

Path-Guided Flow Matching for Dataset Distillation
par: Li, Xuhui, et autres
Publié: (2026)

Designing Large Foundation Models for Efficient Training and Inference: A Survey
par: Liu, Dong, et autres
Publié: (2024)

TiCT: A Synthetically Pre-Trained Foundation Model for Time Series Classification
par: Yeh, Chin-Chia Michael, et autres
Publié: (2025)