Imagen de Portada

SEE: Continual Fine-tuning with Sequential Ensemble of Experts

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Wang, Zhilin, Li, Yafu, Qu, Xiaoye, Cheng, Yu
Formato:	Preprint
Publicado:	2025
Materias:	Computation and Language Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Efficient Ensemble for Fine-tuning Language Models on Multiple Datasets
por: Li, Dongyue, et al.
Publicado: (2025)

Learning to Reason under Off-Policy Guidance
por: Yan, Jianhao, et al.
Publicado: (2025)

ExGRPO: Learning to Reason from Experience
por: Zhan, Runzhe, et al.
Publicado: (2025)

LatentMem: Customizing Latent Memory for Multi-Agent Systems
por: Fu, Muxin, et al.
Publicado: (2026)

PRMBench: A Fine-grained and Challenging Benchmark for Process-Level Reward Models
por: Song, Mingyang, et al.
Publicado: (2025)

Linear-MoE: Linear Sequence Modeling Meets Mixture-of-Experts
por: Sun, Weigao, et al.
Publicado: (2025)

Characterizing, Evaluating, and Optimizing Complex Reasoning
por: Zhang, Haoran, et al.
Publicado: (2026)

Memento: Fine-tuning LLM Agents without Fine-tuning LLMs
por: Zhou, Huichi, et al.
Publicado: (2025)

CoMoE: Contrastive Representation for Mixture-of-Experts in Parameter-Efficient Fine-tuning
por: Feng, Jinyuan, et al.
Publicado: (2025)

MLP Fusion: Towards Efficient Fine-tuning of Dense and Mixture-of-Experts Language Models
por: Ai, Mengting, et al.
Publicado: (2023)

Advancing Multimodal Reasoning: From Optimized Cold Start to Staged Reinforcement Learning
por: Chen, Shuang, et al.
Publicado: (2025)

S'MoRE: Structural Mixture of Residual Experts for Parameter-Efficient LLM Fine-tuning
por: Zeng, Hanqing, et al.
Publicado: (2025)

Can Perplexity Predict Fine-tuning Performance? An Investigation of Tokenization Effects on Sequential Language Models for Nepali
por: Luitel, Nishant, et al.
Publicado: (2024)

Test-Time Preference Optimization: On-the-Fly Alignment via Iterative Textual Feedback
por: Li, Yafu, et al.
Publicado: (2025)

New Skills or Sharper Primitives? A Probabilistic Perspective on the Emergence of Reasoning in RLVR
por: Wang, Zhilin, et al.
Publicado: (2026)

Two-stage LLM Fine-tuning with Less Specialization and More Generalization
por: Wang, Yihan, et al.
Publicado: (2022)

LASP-2: Rethinking Sequence Parallelism for Linear Attention and Its Hybrid
por: Sun, Weigao, et al.
Publicado: (2025)

Utility-Diversity Aware Online Batch Selection for LLM Supervised Fine-tuning
por: Zou, Heming, et al.
Publicado: (2025)

On the Loss of Context-awareness in General Instruction Fine-tuning
por: Wang, Yihan, et al.
Publicado: (2024)

Advancing Parameter Efficiency in Fine-tuning via Representation Editing
por: Wu, Muling, et al.
Publicado: (2024)

PMSS: Pretrained Matrices Skeleton Selection for LLM Fine-tuning
por: Wang, Qibin, et al.
Publicado: (2024)

Ensembles of Low-Rank Expert Adapters
por: Li, Yinghao, et al.
Publicado: (2025)

Scaling Reasoning, Losing Control: Evaluating Instruction Following in Large Reasoning Models
por: Fu, Tingchen, et al.
Publicado: (2025)

A General Framework to Enhance Fine-tuning-based LLM Unlearning
por: Ren, Jie, et al.
Publicado: (2025)

Twin-Merging: Dynamic Integration of Modular Expertise in Model Merging
por: Lu, Zhenyi, et al.
Publicado: (2024)

FaithRL: Learning to Reason Faithfully through Step-Level Faithfulness Maximization
por: Gui, Runquan, et al.
Publicado: (2026)

Scalable Fine-tuning from Multiple Data Sources: A First-Order Approximation Approach
por: Li, Dongyue, et al.
Publicado: (2024)

Topic Modeling with Fine-tuning LLMs and Bag of Sentences
por: Schneider, Johannes
Publicado: (2024)

Fine-tuning Large Language Models for Domain-specific Machine Translation
por: Zheng, Jiawei, et al.
Publicado: (2024)

Exploring Memorization in Fine-tuned Language Models
por: Zeng, Shenglai, et al.
Publicado: (2023)

Learn Hard Problems During RL with Reference Guided Fine-tuning
por: Wu, Yangzhen, et al.
Publicado: (2026)

Rethinking Entropy Regularization in Large Reasoning Models
por: Jiang, Yuxian, et al.
Publicado: (2025)

Why LLM Safety Guardrails Collapse After Fine-tuning: A Similarity Analysis Between Alignment and Fine-tuning Datasets
por: Hsiung, Lei, et al.
Publicado: (2025)

LLM-AutoDP: Automatic Data Processing via LLM Agents for Model Fine-tuning
por: Huang, Wei, et al.
Publicado: (2026)

SEE: Sememe Entanglement Encoding for Transformer-bases Models Compression
por: Zhang, Jing, et al.
Publicado: (2024)

Whispering in Amharic: Fine-tuning Whisper for Low-resource Language
por: Gete, Dawit Ketema, et al.
Publicado: (2025)

Relational Knowledge Distillation Using Fine-tuned Function Vectors
por: Kang, Andrea, et al.
Publicado: (2026)

LoRA vs Full Fine-tuning: An Illusion of Equivalence
por: Shuttleworth, Reece, et al.
Publicado: (2024)

Benign Samples Matter! Fine-tuning On Outlier Benign Samples Severely Breaks Safety
por: Guan, Zihan, et al.
Publicado: (2025)

Ensembling Language Models with Sequential Monte Carlo
por: Chan, Robin Shing Moon, et al.
Publicado: (2026)