Cover Image

ERMoE: Eigen-Reparameterized Mixture-of-Experts for Stable Routing and Interpretable Specialization

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Cheng, Anzhe, Duan, Shukai, Li, Shixuan, Yin, Chenzhong, Cheng, Mingxi, Ping, Heng, Chattopadhyay, Tamoghna, Thomopoulos, Sophia I, Nazarian, Shahin, Thompson, Paul, Bogdan, Paul
Format:	Preprint
Published:	2025
Subjects:	Computer Vision and Pattern Recognition
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

EMoE: Eigenbasis-Guided Routing for Mixture-of-Experts
by: Cheng, Anzhe, et al.
Published: (2026)

Eigen Neural Network: Unlocking Generalizable Vision with Eigenbasis
by: Cheng, Anzhe, et al.
Published: (2025)

MaskAttn-UNet: A Mask Attention-Driven Framework for Universal Low-Resolution Image Segmentation
by: Cheng, Anzhe, et al.
Published: (2025)

POET: Power-Oriented Evolutionary Tuning for LLM-Based RTL PPA Optimization
by: Ping, Heng, et al.
Published: (2026)

HDLCoRe: A Training-Free Framework for Mitigating Hallucinations in LLM-Generated HDL
by: Ping, Heng, et al.
Published: (2025)

Exploiting Application-to-Architecture Dependencies for Designing Scalable OS
by: Xiao, Yao, et al.
Published: (2025)

COEVO: Co-Evolutionary Framework for Joint Functional Correctness and PPA Optimization in LLM-Based RTL Generation
by: Ping, Heng, et al.
Published: (2026)

Discovering What You Can Control: Interventional Boundary Discovery for Reinforcement Learning
by: Liu, Jiaxin, et al.
Published: (2026)

Diffusion Bridge Models for 3D Medical Image Translation
by: Zhang, Shaorong, et al.
Published: (2025)

Multi-modal Imputation for Alzheimer's Disease Classification
by: Shaji, Abhijith, et al.
Published: (2026)

VeriMoA: A Mixture-of-Agents Framework for Spec-to-HDL Generation
by: Ping, Heng, et al.
Published: (2025)

MaskAttn-SDXL: Controllable Region-Level Text-To-Image Generation
by: Chang, Yu, et al.
Published: (2025)

Structural Complexity of Brain MRI reveals age-associated patterns
by: Cheng, Anzhe, et al.
Published: (2026)

Generative AI improves MRI‐based Detection of Alzheimer’s Disease by using Latent Diffusion Models and Convolutional Neural Networks
by: Nikhil J Dhinagar, et al.
Published: (2024)

PerfRL: A Small Language Model Framework for Efficient Code Optimization
by: Duan, Shukai, et al.
Published: (2023)

A Structure-Aware Framework for Learning Device Placements on Computation Graphs
by: Duan, Shukai, et al.
Published: (2024)

Stable Routing for Mixture-of-Experts in Class-Incremental Learning
by: Guo, Zirui, et al.
Published: (2026)

Neuro-Inspired Hierarchical Multimodal Learning
by: Xiao, Xiongye, et al.
Published: (2023)

Neuro-Inspired Information-Theoretic Hierarchical Perception for Multimodal Learning
by: Xiao, Xiongye, et al.
Published: (2024)

Understanding Multilingualism in Mixture-of-Experts LLMs: Routing Mechanism, Expert Specialization, and Layerwise Steering
by: Chen, Yuxin, et al.
Published: (2026)

Machine learning‐based identification of general transcriptional predictors for plant disease
by: Jayson Sia, et al.
Published: (2024)

ProbMoE: Differentiable Probabilistic Routing for Mixture-of-Experts
by: Zhao, Heng, et al.
Published: (2026)

Deep Learning Algorithms for Alzheimer’s Disease Detection based on Diffusion MRI: Tests in Indian and North American Cohorts
by: Tamoghna Chattopadhyay, et al.
Published: (2024)

RepLoRA: Reparameterizing Low-Rank Adaptation via the Perspective of Mixture of Experts
by: Truong, Tuan, et al.
Published: (2025)

Routing-Free Mixture-of-Experts
by: Liu, Yilun, et al.
Published: (2026)

Multilingual Routing in Mixture-of-Experts
by: Bandarkar, Lucas, et al.
Published: (2025)

Cosine-Similarity Routing with Semantic Anchors for Interpretable Mixture-of-Experts Language Models
by: Ternovtsii, Ivan, et al.
Published: (2025)

Auditing Multi-Agent LLM Reasoning Trees Outperforms Majority Vote and LLM-as-Judge
by: Yang, Wei, et al.
Published: (2026)

Maximum Score Routing For Mixture-of-Experts
by: Dong, Bowen, et al.
Published: (2025)

A Review of Brain-Computer Interface Technologies: Signal Acquisition Methods and Interaction Paradigms
by: Wang, Yifan, et al.
Published: (2025)

Massively Multimodal Foundation Models: A Framework for Capturing Interactions with Specialized Mixture-of-Experts
by: Han, Xing, et al.
Published: (2025)

RouteHijack: Routing-Aware Attack on Mixture-of-Experts LLMs
by: Xu, Zhiyuan, et al.
Published: (2026)

Multi-Task Vehicle Routing Solver via Mixture of Specialized Experts under State-Decomposable MDP
by: Pan, Yuxin, et al.
Published: (2025)

Geometric Routing Enables Causal Expert Control in Mixture of Experts
by: Ternovtsii, Ivan, et al.
Published: (2026)

Multilinear Mixture of Experts: Scalable Expert Specialization through Factorization
by: Oldfield, James, et al.
Published: (2024)

Stein's Lemma for the Reparameterization Trick with Exponential Family Mixtures
by: Lin, Wu, et al.
Published: (2019)

Mixture of Experts Made Intrinsically Interpretable
by: Yang, Xingyi, et al.
Published: (2025)

Routing by Analogy: kNN-Augmented Expert Assignment for Mixture-of-Experts
by: Lyu, Boxuan, et al.
Published: (2026)

Beyond Routing: Characterising Expert Tuning and Representation in Vision Mixture-of-Experts
by: Tangtartharakul, Gene, et al.
Published: (2026)

Mixture-of-Clustered-Experts: Advancing Expert Specialization and Generalization in Instruction Tuning
by: Eo, Sugyeong, et al.
Published: (2025)