Cover Image

One-shot Federated Learning via Synthetic Distiller-Distillate Communication

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zhang, Junyuan, Liu, Songhua, Wang, Xinchao
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Computer Vision and Pattern Recognition
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Understanding Dataset Distillation via Spectral Filtering
by: Bo, Deyu, et al.
Published: (2025)

Distilled Datamodel with Reverse Gradient Matching
by: Ye, Jingwen, et al.
Published: (2024)

CoDA: From Text-to-Image Diffusion Models to Training-Free Dataset Distillation
by: Zhou, Letian, et al.
Published: (2025)

Teddy: Efficient Large-Scale Dataset Distillation via Taylor-Approximated Matching
by: Yu, Ruonan, et al.
Published: (2024)

LinFusion: 1 GPU, 1 Minute, 16K Image
by: Liu, Songhua, et al.
Published: (2024)

Rethinking Large-scale Dataset Compression: Shifting Focus From Labels to Images
by: Xiao, Lingao, et al.
Published: (2025)

StyDeSty: Min-Max Stylization and Destylization for Single Domain Generalization
by: Liu, Songhua, et al.
Published: (2024)

Heavy Labels Out! Dataset Distillation with Label Space Lightening
by: Yu, Ruonan, et al.
Published: (2024)

Continual Distillation Learning: Knowledge Distillation in Prompt-based Continual Learning
by: Zhang, Qifan, et al.
Published: (2024)

Federated Learning with Label-Masking Distillation
by: Lu, Jianghu, et al.
Published: (2024)

One-Step Diffusion Distillation via Deep Equilibrium Models
by: Geng, Zhengyang, et al.
Published: (2023)

Improving Diversity in Black-box Few-shot Knowledge Distillation
by: Vo, Tri-Nhan, et al.
Published: (2026)

Improving Zero-shot Generalization of Learned Prompts via Unsupervised Knowledge Distillation
by: Mistretta, Marco, et al.
Published: (2024)

Personalized Federated Learning via Backbone Self-Distillation
by: Wang, Pengju, et al.
Published: (2024)

FedHPL: Efficient Heterogeneous Federated Learning with Prompt Tuning and Logit Distillation
by: Ma, Yuting, et al.
Published: (2024)

OminiControl: Minimal and Universal Control for Diffusion Transformer
by: Tan, Zhenxiong, et al.
Published: (2024)

Towards Personalized Federated Learning via Comprehensive Knowledge Distillation
by: Wang, Pengju, et al.
Published: (2024)

Densely Distilling Cumulative Knowledge for Continual Learning
by: Shi, Zenglin, et al.
Published: (2024)

Privacy-Preserving Model Transcription with Differentially Private Synthetic Distillation
by: Liu, Bochao, et al.
Published: (2026)

FedAFD: Multimodal Federated Learning via Adversarial Fusion and Distillation
by: Tan, Min, et al.
Published: (2026)

Adversarial Score identity Distillation: Rapidly Surpassing the Teacher in One Step
by: Zhou, Mingyuan, et al.
Published: (2024)

Distilled Decoding 1: One-step Sampling of Image Auto-regressive Models with Flow Matching
by: Liu, Enshu, et al.
Published: (2024)

Understanding Generalization in Diffusion Distillation via Probability Flow Distance
by: Zhang, Huijie, et al.
Published: (2025)

Pixel Distillation: A New Knowledge Distillation Scheme for Low-Resolution Image Recognition
by: Guo, Guangyu, et al.
Published: (2021)

LAKD-Activation Mapping Distillation Based on Local Learning
by: Zhang, Yaoze, et al.
Published: (2024)

Score identity Distillation: Exponentially Fast Distillation of Pretrained Diffusion Models for One-Step Generation
by: Zhou, Mingyuan, et al.
Published: (2024)

FedDistill: Global Model Distillation for Local Model De-Biasing in Non-IID Federated Learning
by: Song, Changlin, et al.
Published: (2024)

One Category One Prompt: Dataset Distillation using Diffusion Models
by: Abbasi, Ali, et al.
Published: (2024)

Few-Step Diffusion via Score identity Distillation
by: Zhou, Mingyuan, et al.
Published: (2025)

Large Scale Diffusion Distillation via Score-Regularized Continuous-Time Consistency
by: Zheng, Kaiwen, et al.
Published: (2025)

Learning Differentially Private Diffusion Models via Stochastic Adversarial Distillation
by: Liu, Bochao, et al.
Published: (2024)

SGMD: Score Gradient Matching Distillation for Few-Step Video Diffusion Distillation
by: Wu, Zhuguanyu, et al.
Published: (2026)

ZeroFlow: Scalable Scene Flow via Distillation
by: Vedder, Kyle, et al.
Published: (2023)

Generative Distribution Distillation
by: Cui, Jiequan, et al.
Published: (2025)

Data-to-Model Distillation: Data-Efficient Learning Framework
by: Sajedi, Ahmad, et al.
Published: (2024)

Temporal Saliency-Guided Distillation: A Scalable Framework for Distilling Video Datasets
by: Gu, Xulin, et al.
Published: (2025)

Beyond One Shot, Beyond One Perspective: Cross-View and Long-Horizon Distillation for Better LiDAR Representations
by: Xu, Xiang, et al.
Published: (2025)

Dataset Distillation via the Wasserstein Metric
by: Liu, Haoyang, et al.
Published: (2023)

Regularized Distribution Matching Distillation for One-step Unpaired Image-to-Image Translation
by: Rakitin, Denis, et al.
Published: (2024)

Decoupling Dark Knowledge via Block-wise Logit Distillation for Feature-level Alignment
by: Yu, Chengting, et al.
Published: (2024)