Cover Image

FLAME: Towards Federated Fine-Tuning Large Language Models Through Adaptive SMoE

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Le, Khiem, Tran, Tuan, Hua, Ting, Chawla, Nitesh V.
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

AgentDrug: Utilizing Large Language Models in An Agentic Workflow for Zero-Shot Molecular Editing
by: Le, Khiem, et al.
Published: (2024)

UB-SMoE: Universally Balanced Sparse Mixture-of-Experts for Resource-adaptive Federated Fine-tuning of Foundation Models
by: Tran, Van-Tuan, et al.
Published: (2026)

Merge, Then Compress: Demystify Efficient SMoE with Hints from Its Routing Policy
by: Li, Pingzhi, et al.
Published: (2023)

SMoE: An Algorithm-System Co-Design for Pushing MoE to the Edge via Expert Substitution
by: Zhu, Guoying, et al.
Published: (2025)

TeachingCoach: A Fine-Tuned Scaffolding Chatbot for Instructional Guidance to Instructors
by: Molnar, Isabel, et al.
Published: (2026)

A Survey of Large Language Models for Graphs
by: Ren, Xubin, et al.
Published: (2024)

Automated Benchmark Generation from Domain Guidelines Informed by Bloom's Taxonomy
by: Chen, Si, et al.
Published: (2026)

Rethinking Cross-Modal Fine-Tuning: Optimizing the Interaction Between Feature Alignment and Target Fitting
by: Tran, Trong Khiem, et al.
Published: (2026)

FLAME: Adaptive and Reactive Concept Drift Mitigation for Federated Learning Deployments
by: Mavromatis, Ioannis, et al.
Published: (2024)

CrochetBench: Can Vision-Language Models Move from Describing to Doing in Crochet Domain?
by: Li, Peiyu, et al.
Published: (2025)

Revisiting SMoE Language Models by Evaluating Inefficiencies with Task Specific Expert Pruning
by: Sarkar, Soumajyoti, et al.
Published: (2024)

HetGPT: Harnessing the Power of Prompt Tuning in Pre-Trained Heterogeneous Graph Neural Networks
by: Ma, Yihong, et al.
Published: (2023)

MolX: Enhancing Large Language Models for Molecular Understanding With A Multi-Modal Extension
by: Le, Khiem, et al.
Published: (2024)

Automated Federated Pipeline for Parameter-Efficient Fine-Tuning of Large Language Models
by: Fang, Zihan, et al.
Published: (2024)

Transformation-Augmented GRPO for Enhancing Exploration in Reasoning of Large Language Models
by: Le, Khiem, et al.
Published: (2026)

FedKRSO: Communication and Memory Efficient Federated Fine-Tuning of Large Language Models
by: Yang, Guohao, et al.
Published: (2026)

Graph Neural Prompting with Large Language Models
by: Tian, Yijun, et al.
Published: (2023)

Task-Centric Personalized Federated Fine-Tuning of Language Models
by: Talasso, Gabriel U., et al.
Published: (2026)

Fast Explanations via Policy Gradient-Optimized Explainer
by: Pan, Deng, et al.
Published: (2024)

Geometry of Knowledge Allows Extending Diversity Boundaries of Large Language Models
by: Bystroński, Mateusz, et al.
Published: (2025)

SimSMoE: Solving Representational Collapse via Similarity Measure
by: Do, Giang, et al.
Published: (2024)

Linearization Explains Fine-Tuning in Large Language Models
by: Afzal, Zahra Rahimi, et al.
Published: (2026)

Can Decision Trees Teach Large Language Models? Distilling Verbalized Knowledge for Molecular Property Prediction
by: Le, Khiem, et al.
Published: (2026)

Efficient Federated Fine-Tuning of Large Language Models with Layer Dropout
by: Wang, Shilong, et al.
Published: (2025)

Adaptive Defense against Harmful Fine-Tuning for Large Language Models via Bayesian Data Scheduler
by: Hu, Zixuan, et al.
Published: (2025)

Towards Green AI in Fine-tuning Large Language Models via Adaptive Backpropagation
by: Huang, Kai, et al.
Published: (2023)

Building Scaffolding Dialogue Data with LLM-Simulated Novices
by: Chen, Si, et al.
Published: (2025)

Exploring Gradient Subspaces: Addressing and Overcoming LoRA's Limitations in Federated Fine-Tuning of Large Language Models
by: Mahla, Navyansh, et al.
Published: (2024)

Preserving Diversity in Supervised Fine-Tuning of Large Language Models
by: Li, Ziniu, et al.
Published: (2024)

On the Entropy Dynamics in Reinforcement Fine-Tuning of Large Language Models
by: Wang, Shumin, et al.
Published: (2026)

FedNano: Toward Lightweight Federated Tuning for Pretrained Multimodal Large Language Models
by: Zhang, Yao, et al.
Published: (2025)

PREFINE: Preference-Based Implicit Reward and Cost Fine-Tuning for Safety Alignment
by: Verma, Richa, et al.
Published: (2026)

Towards Graph Foundation Models: Learning Generalities Across Graphs via Task-Trees
by: Wang, Zehong, et al.
Published: (2024)

CoSMo: a Framework to Instantiate Conditioned Process Simulation Models
by: Oyamada, Rafael S., et al.
Published: (2023)

H2Tune: Federated Foundation Model Fine-Tuning with Hybrid Heterogeneity
by: Guo, Wei, et al.
Published: (2025)

Boosting Large Language Models with Mask Fine-Tuning
by: Zhang, Mingyuan, et al.
Published: (2025)

Scaling Sparse Fine-Tuning to Large Language Models
by: Ansell, Alan, et al.
Published: (2024)

Adaptive Rank Allocation for Federated Parameter-Efficient Fine-Tuning of Language Models
by: Wu, Fei, et al.
Published: (2025)

RAFT: Data Refinement and Adaptive Distillation for Domain Fine-Tuning with Alleviated Forgetting
by: Li, Yuduo, et al.
Published: (2026)

Ferret: Federated Full-Parameter Tuning at Scale for Large Language Models
by: Shu, Yao, et al.
Published: (2024)