Copertina

Robust and Resource-Efficient Data-Free Knowledge Distillation by Generative Pseudo Replay

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Binici, Kuluhan, Aggarwal, Shivam, Pham, Nam Trung, Leman, Karianto, Mitra, Tulika
Natura:	Preprint
Pubblicazione:	2022
Soggetti:	Machine Learning Artificial Intelligence
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Condensed Data Expansion Using Model Inversion for Knowledge Distillation
di: Binici, Kuluhan, et al.
Pubblicazione: (2024)

Generalizing Teacher Networks for Effective Knowledge Distillation Across Student Architectures
di: Binici, Kuluhan, et al.
Pubblicazione: (2024)

CRISP: Hybrid Structured Sparsity for Class-aware Model Pruning
di: Aggarwal, Shivam, et al.
Pubblicazione: (2023)

DAOP: Data-Aware Offloading and Predictive Pre-Calculation for Efficient MoE Inference
di: Zhang, Yujie, et al.
Pubblicazione: (2024)

Efficient Knowledge Distillation via Curriculum Extraction
di: Gupta, Shivam, et al.
Pubblicazione: (2025)

LLMs are not Zero-Shot Reasoners for Biomedical Information Extraction
di: Nagar, Aishik, et al.
Pubblicazione: (2024)

HALO: Hardware-aware quantization with low critical-path-delay weights for LLM acceleration
di: Juneja, Rohan, et al.
Pubblicazione: (2025)

Data-Free Generative Replay for Class-Incremental Learning on Imbalanced Data
di: Younis, Sohaib, et al.
Pubblicazione: (2024)

Task-Aware Adaptive Modulation: A Replay-Free and Resource-Efficient Approach For Continual Graph Learning
di: Liu, Jingtao, et al.
Pubblicazione: (2025)

Shedding the Bits: Pushing the Boundaries of Quantization with Minifloats on FPGAs
di: Aggarwal, Shivam, et al.
Pubblicazione: (2023)

C2G-KD: PCA-Constrained Generator for Data-Free Knowledge Distillation
di: Bengtsson, Magnus, et al.
Pubblicazione: (2025)

Leveraging Knowledge Distillation for Efficient Deep Reinforcement Learning in Resource-Constrained Environments
di: Meng, Guanlin
Pubblicazione: (2023)

How to Backdoor the Knowledge Distillation
di: Wu, Chen, et al.
Pubblicazione: (2025)

FedKDX: Federated Learning with Negative Knowledge Distillation for Enhanced Healthcare AI Systems
di: Pham, Quang-Tu, et al.
Pubblicazione: (2026)

Post-Pruning Accuracy Recovery via Data-Free Knowledge Distillation
di: Tripurwar, Chinmay, et al.
Pubblicazione: (2025)

Defense without Forgetting: Continual Adversarial Defense with Anisotropic & Isotropic Pseudo Replay
di: Zhou, Yuhang, et al.
Pubblicazione: (2024)

Dual-LoRA and Quality-Enhanced Pseudo Replay for Multimodal Continual Food Learning
di: Wu, Xinlan, et al.
Pubblicazione: (2025)

Small Scale Data-Free Knowledge Distillation
di: Liu, He, et al.
Pubblicazione: (2024)

Efficient and Robust Knowledge Distillation from A Stronger Teacher Based on Correlation Matching
di: Niu, Wenqi, et al.
Pubblicazione: (2024)

Prioritized Trajectory Replay: A Replay Memory for Data-driven Reinforcement Learning
di: Liu, Jinyi, et al.
Pubblicazione: (2023)

Toward Privileged Foundation Models:LUPI for Accelerated and Improved Learning
di: Ding, Xueying, et al.
Pubblicazione: (2026)

Investigating the Interplay of Prioritized Replay and Generalization
di: Panahi, Parham Mohammad, et al.
Pubblicazione: (2024)

Sample-Efficient Constrained Reinforcement Learning with General Parameterization
di: Mondal, Washim Uddin, et al.
Pubblicazione: (2024)

Fair4Free: Generating High-fidelity Fair Synthetic Samples using Data Free Distillation
di: Sikder, Md Fahim, et al.
Pubblicazione: (2024)

Efficient $Q$-Learning and Actor-Critic Methods for Robust Average Reward Reinforcement Learning
di: Xu, Yang, et al.
Pubblicazione: (2025)

Sustained Gradient Alignment Mediates Subliminal Learning in a Multi-Step Setting: Evidence from MNIST Auxiliary Logit Distillation Experiment
di: Kitkana, Chayanon, et al.
Pubblicazione: (2026)

Better Generative Replay for Continual Federated Learning
di: Qi, Daiqing, et al.
Pubblicazione: (2023)

MEDSAGE: Enhancing Robustness of Medical Dialogue Summarization to ASR Errors with LLM-generated Synthetic Dialogues
di: Binici, Kuluhan, et al.
Pubblicazione: (2024)

DKDM: Data-Free Knowledge Distillation for Diffusion Models with Any Architecture
di: Xiang, Qianlong, et al.
Pubblicazione: (2024)

TFGN: Task-Free, Replay-Free Continual Pre-Training Without Catastrophic Forgetting at LLM Scale
di: Ganguli, Anurup
Pubblicazione: (2026)

Efficient Diversity-based Experience Replay for Deep Reinforcement Learning
di: Zhao, Kaiyan, et al.
Pubblicazione: (2024)

An Efficient Replay for Class-Incremental Learning with Pre-trained Models
di: Yin, Weimin, et al.
Pubblicazione: (2024)

FoMo-0D: A Foundation Model for Zero-shot Tabular Outlier Detection
di: Shen, Yuchen, et al.
Pubblicazione: (2024)

Fast Unsupervised Deep Outlier Model Selection with Hypernetworks
di: Ding, Xueying, et al.
Pubblicazione: (2023)

SWAT: Scalable and Efficient Window Attention-based Transformers Acceleration on FPGAs
di: Bai, Zhenyu, et al.
Pubblicazione: (2024)

HFedCKD: Toward Robust Heterogeneous Federated Learning via Data-free Knowledge Distillation and Two-way Contrast
di: Zheng, Yiting, et al.
Pubblicazione: (2025)

Overcoming Uncertain Incompleteness for Robust Multimodal Sequential Diagnosis Prediction via Curriculum Data Erasing Guided Knowledge Distillation
di: Koo, Heejoon
Pubblicazione: (2024)

Parameter Efficient Diverse Paraphrase Generation Using Sequence-Level Knowledge Distillation
di: Jayawardena, Lasal, et al.
Pubblicazione: (2024)

Robust Knowledge Distillation Based on Feature Variance Against Backdoored Teacher Model
di: Chen, Jinyin, et al.
Pubblicazione: (2024)

Improve Knowledge Distillation via Label Revision and Data Selection
di: Lan, Weichao, et al.
Pubblicazione: (2024)