Cover Image

Three Phases of Expert Routing: How Load Balance Evolves During Mixture-of-Experts Training

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Mouzouni, Charafeddine
Format:	Preprint
Published:	2026
Subjects:	Machine Learning Artificial Intelligence Multiagent Systems 91A13, 91A10, 68T07 I.2.6; G.3
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Emergent Coordination in Multi-Agent Systems via Pressure Fields and Temporal Decay
by: Rodriguez, Roland
Published: (2026)

On the Fundamental Limitations of Decentralized Learnable Reward Shaping in Cooperative Multi-Agent Reinforcement Learning
by: Akella, Aditya
Published: (2025)

Coopetition-Gym v1: A Formally Grounded Platform for Mixed-Motive Multi-Agent Reinforcement Learning under Strategic Coopetition
by: Pant, Vik, et al.
Published: (2026)

Mean-Field Reinforcement Learning without Synchrony
by: Yang, Shan
Published: (2026)

Co-Evolving Complexity: An Adversarial Framework for Automatic MARL Curricula
by: Hill, Brennen
Published: (2025)

The Axiom of Consent: Friction Dynamics in Multi-Agent Coordination
by: Farzulla, Murad
Published: (2026)

Evolutionary Multi-agent Reinforcement Learning in Group Social Dilemmas
by: Mintz, Brian, et al.
Published: (2024)

Computing Game Symmetries and Equilibria That Respect Them
by: Tewolde, Emanuel, et al.
Published: (2025)

Games with Payments between Learning Agents
by: Kolumbus, Yoav, et al.
Published: (2024)

Law-Strength Frontiers and a No-Free-Lunch Result for Law-Seeking Reinforcement Learning on Volatility Law Manifolds
by: Zhang, Jian'an
Published: (2025)

Learning to Manipulate under Limited Information
by: Holliday, Wesley H., et al.
Published: (2024)

Congestion Pricing for Efficiency and Equity: Theory and Applications to the San Francisco Bay Area
by: Maheshwari, Chinmay, et al.
Published: (2024)

A Game Theoretic Free Energy Analysis of Higher Order Synergy in Attention Heads of Large Language Models
by: Bouchaffra, Djamel
Published: (2026)

Prices, Bids, Values: One ML-Powered Combinatorial Auction to Rule Them All
by: Soumalias, Ermis, et al.
Published: (2024)

Hierarchy Entropy Degeneration Explains the Rat Utopia Population Collapse: The Role of Full Visibility and Isolation
by: Mantzaris, Alexander V.
Published: (2025)

A four-player potential game for barren-plateau-aware quantum ansatz design
by: Guerrero, Rubén Darío
Published: (2026)

The Coordination Gap: Multi-Agent Alternation Metrics for Temporal Fairness in Repeated Games
by: Papadopoulos, Nikolaos Al., et al.
Published: (2026)

More at Stake: How Payoff and Language Shape LLM Agent Strategies in Cooperation Dilemmas
by: Huynh, Trung-Kiet, et al.
Published: (2026)

Markov $α$-Potential Games
by: Guo, Xin, et al.
Published: (2023)

Independent and Decentralized Learning in Markov Potential Games
by: Maheshwari, Chinmay, et al.
Published: (2022)

AI Mother Tongue: Self-Emergent Communication in MARL via Endogenous Symbol Systems
by: Liu, Hung Ming
Published: (2025)

No-regret learning in harmonic games: Extrapolation in the face of conflicting interests
by: Legacci, Davide, et al.
Published: (2024)

MarketSenseAI 2.0: Enhancing Stock Analysis through LLM Agents
by: Fatouros, George, et al.
Published: (2025)

Risk-Aware Deep Reinforcement Learning for Dynamic Portfolio Optimization
by: Lwele, Emmanuel, et al.
Published: (2025)

Riemannian Manifold Learning for Stackelberg Games with Neural Flow Representations
by: Liu, Larkin, et al.
Published: (2025)

Limit Order Book Dynamics in Matching Markets: Microstructure, Spread, and Execution Slippage
by: Wu, Yao
Published: (2025)

Generating Realistic Safety-Critical Scenarios for Vehicle-Pedestrian Interactions
by: Pu, Qingwen, et al.
Published: (2026)

A Structural Threshold in Decision Capacity Governs Collapse in Self-Play Reinforcement Learning
by: Kujur, Arahan
Published: (2026)

Generative Evolutionary Meta-Solver (GEMS): Scalable Surrogate-Free Multi-Agent Reinforcement Learning
by: Sharma, Alakh, et al.
Published: (2025)

CoopEval: Benchmarking Cooperation-Sustaining Mechanisms and LLM Agents in Social Dilemmas
by: Tewolde, Emanuel, et al.
Published: (2026)

Cooperative and Noncooperative Paradigms for Game-Theoretic Control of Socio-Technical Systems
by: Başar, Tamer, et al.
Published: (2026)

CyGATE: Game-Theoretic Cyber Attack-Defense Engine for Patch Strategy Optimization
by: Jiang, Yuning, et al.
Published: (2025)

What Suppresses Nash Equilibrium Play in Large Language Models? Mechanistic Evidence and Causal Control
by: Lekeas, Paraskevas V., et al.
Published: (2026)

A Simulation of Ageing and Care Accessibility in Italian Inner Areas
by: garrone, Roberto
Published: (2025)

Normalisation and Initialisation Strategies for Graph Neural Networks in Blockchain Anomaly Detection
by: Duy, Dang Sy, et al.
Published: (2026)

Mechanism Design for Locating Facilities with Capacities with Insufficient Resources
by: Auricchio, Gennaro, et al.
Published: (2024)

ABIDES-MARL: A Multi-Agent Reinforcement Learning Environment for Endogenous Price Formation and Execution in a Limit Order Book
by: Cheridito, Patrick, et al.
Published: (2025)

A Theory of Multilevel Interactive Equilibrium in NeuroAI
by: Chen, Zhe Sage, et al.
Published: (2026)

TEE-BFT: Pricing the Security of Data Center Execution Assurance
by: Shamis, Alex, et al.
Published: (2025)

Analyzing Transport Policies in Developing Countries with ABM
by: Salazar-Serna, Kathleen, et al.
Published: (2024)