Cover Image

Data-Distill-Net: A Data Distillation Approach Tailored for Reply-based Continual Learning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Liao, Wenyang, Wang, Quanziang, Wu, Yichen, Wang, Renzhen, Meng, Deyu
Format:	Preprint
Published:	2025
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Dual-CBA: Improving Online Continual Learning via Dual Continual Bias Adaptors from a Bi-level Optimization Perspective
by: Wang, Quanziang, et al.
Published: (2024)

Semi-Supervised Regression with Heteroscedastic Pseudo-Labels
by: Sun, Xueqing, et al.
Published: (2025)

Singular Value Fine-tuning for Few-Shot Class-Incremental Learning
by: Wang, Zhiwu, et al.
Published: (2025)

SD-LoRA: Scalable Decoupled Low-Rank Adaptation for Class Incremental Learning
by: Wu, Yichen, et al.
Published: (2025)

Graph Distillation with Eigenbasis Matching
by: Liu, Yang, et al.
Published: (2023)

BitNet Distillation
by: Wu, Xun, et al.
Published: (2025)

Continual Distillation Learning: Knowledge Distillation in Prompt-based Continual Learning
by: Zhang, Qifan, et al.
Published: (2024)

Densely Distilling Cumulative Knowledge for Continual Learning
by: Shi, Zenglin, et al.
Published: (2024)

Understanding Dataset Distillation via Spectral Filtering
by: Bo, Deyu, et al.
Published: (2025)

On Learning Representations for Tabular Data Distillation
by: Kang, Inwon, et al.
Published: (2025)

Data Efficient Any Transformer-to-Mamba Distillation via Attention Bridge
by: Wang, Penghao, et al.
Published: (2025)

Dataset Distillation-based Hybrid Federated Learning on Non-IID Data
by: Shi, Xiufang, et al.
Published: (2024)

Tailored Federated Learning: Leveraging Direction Regulation & Knowledge Distillation
by: Tang, Huidong, et al.
Published: (2024)

Component-based Sketching for Deep ReLU Nets
by: Wang, Di, et al.
Published: (2024)

Self-Distillation Enables Continual Learning
by: Shenfeld, Idan, et al.
Published: (2026)

Feature Distillation is the Better Choice for Model-Heterogeneous Federated Learning
by: Li, Yichen, et al.
Published: (2025)

Score Distillation Beyond Acceleration: Generative Modeling from Corrupted Data
by: Zhang, Yasi, et al.
Published: (2025)

Data-to-Model Distillation: Data-Efficient Learning Framework
by: Sajedi, Ahmad, et al.
Published: (2024)

Rethinking Momentum Knowledge Distillation in Online Continual Learning
by: Michel, Nicolas, et al.
Published: (2023)

In-Context Data Distillation with TabPFN
by: Ma, Junwei, et al.
Published: (2024)

Tailoring Instructions to Student's Learning Levels Boosts Knowledge Distillation
by: Ren, Yuxin, et al.
Published: (2023)

InterpreTabNet: Distilling Predictive Signals from Tabular Data by Salient Feature Interpretation
by: Si, Jacob, et al.
Published: (2024)

DistDD: Distributed Data Distillation Aggregation through Gradient Matching
by: Wang, Peiran, et al.
Published: (2024)

Prompt Candidates, then Distill: A Teacher-Student Framework for LLM-driven Data Annotation
by: Xia, Mingxuan, et al.
Published: (2025)

Low-redundancy Distillation for Continual Learning
by: Liu, RuiQi, et al.
Published: (2023)

Batch Distillation Data for Developing Machine Learning Anomaly Detection Methods
by: Arweiler, Justus, et al.
Published: (2025)

One-Shot Collaborative Data Distillation
by: Holland, William, et al.
Published: (2024)

Distilling the Knowledge in Data Pruning
by: Ben-Baruch, Emanuel, et al.
Published: (2024)

Knowledge Distillation in Federated Edge Learning: A Survey
by: Wu, Zhiyuan, et al.
Published: (2023)

Beyond Scaling Law: A Data-Efficient Distillation Framework for Reasoning
by: Wu, Xiaojun, et al.
Published: (2025)

Federated Learning on Virtual Heterogeneous Data with Local-global Distillation
by: Huang, Chun-Yin, et al.
Published: (2023)

Unlocking Data Value in Finance: A Study on Distillation and Difficulty-Aware Training
by: Cao, Chuxue, et al.
Published: (2026)

Distilled Pretraining: A modern lens of Data, In-Context Learning and Test-Time Scaling
by: Goyal, Sachin, et al.
Published: (2025)

The Quest for Efficient Reasoning: A Data-Centric Benchmark to CoT Distillation
by: Zhang, Ruichen, et al.
Published: (2025)

Tackling Data Heterogeneity in Federated Learning through Knowledge Distillation with Inequitable Aggregation
by: Ma, Xing
Published: (2025)

Reviving Stale Updates: Data-Free Knowledge Distillation for Asynchronous Federated Learning
by: Askin, Baris, et al.
Published: (2025)

Hybrid Memory Replay: Blending Real and Distilled Data for Class Incremental Learning
by: Kong, Jiangtao, et al.
Published: (2024)

Differentially Private Kernel Inducing Points using features from ScatterNets (DP-KIP-ScatterNet) for Privacy Preserving Data Distillation
by: Vinaroz, Margarita, et al.
Published: (2023)

Small Scale Data-Free Knowledge Distillation
by: Liu, He, et al.
Published: (2024)

Continual Policy Distillation from Distributed Reinforcement Learning Teachers
by: Li, Yuxuan, et al.
Published: (2026)