Image de couverture de livre

Distillation-Guided Structural Transfer for Continual Learning Beyond Sparse Distributed Memory

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Xue, Huiyan, Ran, Xuming, Li, Yaxin, Xu, Qi, Li, Enhui, Xu, Yi, Zhang, Qiang
Format:	Preprint
Publié:	2025
Sujets:	Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Representation Finetuning for Continual Learning
par: Luo, Haihua, et autres
Publié: (2026)

Beyond Distribution Estimation: Simplex Anchored Structural Inference Towards Universal Semi-Supervised Learning
par: Hou, Yaxin, et autres
Publié: (2026)

SAE-FD: Sparse Autoencoder Feature Distillation for Continual Learning of Large Language Models
par: Zhang, Mingxu, et autres
Publié: (2026)

Latent Context Compilation: Distilling Long Context into Compact Portable Memory
par: Li, Zeju, et autres
Publié: (2026)

Beyond GRPO and On-Policy Distillation: An Empirical Sparse-to-Dense Reward Principle for Language-Model Post-Training
par: Xu, Yuanda, et autres
Publié: (2026)

Efficient ANN-SNN Conversion with Error Compensation Learning
par: Liu, Chang, et autres
Publié: (2025)

Context Distillation as Latent Memory Management
par: Zheng, Ziyang, et autres
Publié: (2026)

Privacy-Preserving Transfer Learning for Community Detection using Locally Distributed Multiple Networks
par: Guo, Xiao, et autres
Publié: (2025)

Low-redundancy Distillation for Continual Learning
par: Liu, RuiQi, et autres
Publié: (2023)

Continual Policy Distillation from Distributed Reinforcement Learning Teachers
par: Li, Yuxuan, et autres
Publié: (2026)

PDAC: Efficient Coreset Selection for Continual Learning via Probability Density Awareness
par: Gao, Junqi, et autres
Publié: (2025)

Attribution-Guided Distillation of Matryoshka Sparse Autoencoders
par: Martin-Linares, Cristina P., et autres
Publié: (2025)

Beyond Tokens: Enhancing RTL Quality Estimation via Structural Graph Learning
par: Liu, Yi, et autres
Publié: (2025)

HoReN: Normalized Hopfield Retrieval for Large-Scale Sequential Model Editing
par: Fang, Yuan, et autres
Publié: (2026)

Memory-Statistics Tradeoff in Continual Learning with Structural Regularization
par: Li, Haoran, et autres
Publié: (2025)

De-confounding Representation Learning for Counterfactual Inference on Continuous Treatment via Generative Adversarial Network
par: Zhao, Yonghe, et autres
Publié: (2023)

Generative Distribution Distillation
par: Cui, Jiequan, et autres
Publié: (2025)

Continual Contrastive Learning on Tabular Data with Out of Distribution
par: Ginanjar, Achmad, et autres
Publié: (2025)

Distribution-Level Memory Recall for Continual Learning: Preserving Knowledge and Avoiding Confusion
par: Cheng, Shaoxu, et autres
Publié: (2024)

Vector Quantization Prompting for Continual Learning
par: Jiao, Li, et autres
Publié: (2024)

Ultra-Sparse Memory Network
par: Huang, Zihao, et autres
Publié: (2024)

MGSER-SAM: Memory-Guided Soft Experience Replay with Sharpness-Aware Optimization for Enhanced Continual Learning
par: Li, Xingyu, et autres
Publié: (2024)

Global Momentum Compression for Sparse Communication in Distributed Learning
par: Shi, Chang-Wei, et autres
Publié: (2019)

Operator-Guided Invariance Learning for Continuous Reinforcement Learning
par: Zhang, Zuyuan, et autres
Publié: (2026)

Pushing the Limits of Distillation-Based Continual Learning via Classifier-Proximal Lightweight Plugins
par: Xu, Zhiming, et autres
Publié: (2025)

Structure Learning with Continuous Optimization: A Sober Look and Beyond
par: Ng, Ignavier, et autres
Publié: (2023)

Byzantine-Robust Distributed Sparse Learning Revisited
par: Wang, Yuxuan, et autres
Publié: (2026)

Brain-inspired continual pre-trained learner via silent synaptic consolidation
par: Ran, Xuming, et autres
Publié: (2024)

Path-Guided Flow Matching for Dataset Distillation
par: Li, Xuhui, et autres
Publié: (2026)

Energy-Structured Low-Rank Adaptation for Continual Learning
par: Li, Longhua, et autres
Publié: (2026)

Attribution-Guided Continual Learning for Large Language Models
par: Liu, Yazheng, et autres
Publié: (2026)

Group-Sparse Matrix Factorization for Transfer Learning of Word Embeddings
par: Xu, Kan, et autres
Publié: (2021)

Contrastive Continual Learning with Importance Sampling and Prototype-Instance Relation Distillation
par: Li, Jiyong, et autres
Publié: (2024)

Grass: Compute Efficient Low-Memory LLM Training with Structured Sparse Gradients
par: Muhamed, Aashiq, et autres
Publié: (2024)

Exploration by Random Distribution Distillation
par: Fang, Zhirui, et autres
Publié: (2025)

Enhancing Pretrained Model-based Continual Representation Learning via Guided Random Projection
par: Li, Ruilin, et autres
Publié: (2026)

Random Walk Guided Hyperbolic Graph Distillation
par: Long, Yunbo, et autres
Publié: (2025)

Feature Distillation is the Better Choice for Model-Heterogeneous Federated Learning
par: Li, Yichen, et autres
Publié: (2025)

Improving Knowledge Distillation in Transfer Learning with Layer-wise Learning Rates
par: Kokane, Shirley, et autres
Publié: (2024)

Information-Theoretic Dual Memory System for Continual Learning
par: Wu, RunQing, et autres
Publié: (2025)