Imagen de Portada

Distillation-Guided Structural Transfer for Continual Learning Beyond Sparse Distributed Memory

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Xue, Huiyan, Ran, Xuming, Li, Yaxin, Xu, Qi, Li, Enhui, Xu, Yi, Zhang, Qiang
Formato:	Preprint
Publicado:	2025
Materias:	Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Representation Finetuning for Continual Learning
por: Luo, Haihua, et al.
Publicado: (2026)

Beyond Distribution Estimation: Simplex Anchored Structural Inference Towards Universal Semi-Supervised Learning
por: Hou, Yaxin, et al.
Publicado: (2026)

SAE-FD: Sparse Autoencoder Feature Distillation for Continual Learning of Large Language Models
por: Zhang, Mingxu, et al.
Publicado: (2026)

Latent Context Compilation: Distilling Long Context into Compact Portable Memory
por: Li, Zeju, et al.
Publicado: (2026)

Efficient ANN-SNN Conversion with Error Compensation Learning
por: Liu, Chang, et al.
Publicado: (2025)

Beyond GRPO and On-Policy Distillation: An Empirical Sparse-to-Dense Reward Principle for Language-Model Post-Training
por: Xu, Yuanda, et al.
Publicado: (2026)

Context Distillation as Latent Memory Management
por: Zheng, Ziyang, et al.
Publicado: (2026)

Privacy-Preserving Transfer Learning for Community Detection using Locally Distributed Multiple Networks
por: Guo, Xiao, et al.
Publicado: (2025)

Low-redundancy Distillation for Continual Learning
por: Liu, RuiQi, et al.
Publicado: (2023)

Continual Policy Distillation from Distributed Reinforcement Learning Teachers
por: Li, Yuxuan, et al.
Publicado: (2026)

PDAC: Efficient Coreset Selection for Continual Learning via Probability Density Awareness
por: Gao, Junqi, et al.
Publicado: (2025)

Beyond Tokens: Enhancing RTL Quality Estimation via Structural Graph Learning
por: Liu, Yi, et al.
Publicado: (2025)

Attribution-Guided Distillation of Matryoshka Sparse Autoencoders
por: Martin-Linares, Cristina P., et al.
Publicado: (2025)

HoReN: Normalized Hopfield Retrieval for Large-Scale Sequential Model Editing
por: Fang, Yuan, et al.
Publicado: (2026)

De-confounding Representation Learning for Counterfactual Inference on Continuous Treatment via Generative Adversarial Network
por: Zhao, Yonghe, et al.
Publicado: (2023)

Memory-Statistics Tradeoff in Continual Learning with Structural Regularization
por: Li, Haoran, et al.
Publicado: (2025)

Generative Distribution Distillation
por: Cui, Jiequan, et al.
Publicado: (2025)

Distribution-Level Memory Recall for Continual Learning: Preserving Knowledge and Avoiding Confusion
por: Cheng, Shaoxu, et al.
Publicado: (2024)

Continual Contrastive Learning on Tabular Data with Out of Distribution
por: Ginanjar, Achmad, et al.
Publicado: (2025)

Vector Quantization Prompting for Continual Learning
por: Jiao, Li, et al.
Publicado: (2024)

Ultra-Sparse Memory Network
por: Huang, Zihao, et al.
Publicado: (2024)

MGSER-SAM: Memory-Guided Soft Experience Replay with Sharpness-Aware Optimization for Enhanced Continual Learning
por: Li, Xingyu, et al.
Publicado: (2024)

Global Momentum Compression for Sparse Communication in Distributed Learning
por: Shi, Chang-Wei, et al.
Publicado: (2019)

Operator-Guided Invariance Learning for Continuous Reinforcement Learning
por: Zhang, Zuyuan, et al.
Publicado: (2026)

Pushing the Limits of Distillation-Based Continual Learning via Classifier-Proximal Lightweight Plugins
por: Xu, Zhiming, et al.
Publicado: (2025)

Structure Learning with Continuous Optimization: A Sober Look and Beyond
por: Ng, Ignavier, et al.
Publicado: (2023)

Byzantine-Robust Distributed Sparse Learning Revisited
por: Wang, Yuxuan, et al.
Publicado: (2026)

Brain-inspired continual pre-trained learner via silent synaptic consolidation
por: Ran, Xuming, et al.
Publicado: (2024)

Path-Guided Flow Matching for Dataset Distillation
por: Li, Xuhui, et al.
Publicado: (2026)

Energy-Structured Low-Rank Adaptation for Continual Learning
por: Li, Longhua, et al.
Publicado: (2026)

Attribution-Guided Continual Learning for Large Language Models
por: Liu, Yazheng, et al.
Publicado: (2026)

Group-Sparse Matrix Factorization for Transfer Learning of Word Embeddings
por: Xu, Kan, et al.
Publicado: (2021)

Contrastive Continual Learning with Importance Sampling and Prototype-Instance Relation Distillation
por: Li, Jiyong, et al.
Publicado: (2024)

Grass: Compute Efficient Low-Memory LLM Training with Structured Sparse Gradients
por: Muhamed, Aashiq, et al.
Publicado: (2024)

Exploration by Random Distribution Distillation
por: Fang, Zhirui, et al.
Publicado: (2025)

Enhancing Pretrained Model-based Continual Representation Learning via Guided Random Projection
por: Li, Ruilin, et al.
Publicado: (2026)

Random Walk Guided Hyperbolic Graph Distillation
por: Long, Yunbo, et al.
Publicado: (2025)

Feature Distillation is the Better Choice for Model-Heterogeneous Federated Learning
por: Li, Yichen, et al.
Publicado: (2025)

Improving Knowledge Distillation in Transfer Learning with Layer-wise Learning Rates
por: Kokane, Shirley, et al.
Publicado: (2024)

Information-Theoretic Dual Memory System for Continual Learning
por: Wu, RunQing, et al.
Publicado: (2025)