Saved in:
| Main Authors: | Yemets, Kyrylo, Lukashchuk, Mykola, Izonin, Ivan |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2508.17515 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
Composing Non-Conjugate Factor Graphs with Closed-Form Variational Inference
by: Lukashchuk, Mykola, et al.
Published: (2026)
by: Lukashchuk, Mykola, et al.
Published: (2026)
AME-TS: Anchored Mixture-of-Experts for Time Series Forecasting
by: Wang, Rui, et al.
Published: (2026)
by: Wang, Rui, et al.
Published: (2026)
Quadratic Gating Mixture of Experts: Statistical Insights into Self-Attention
by: Akbarian, Pedram, et al.
Published: (2024)
by: Akbarian, Pedram, et al.
Published: (2024)
Gaussian Variational Inference with Non-Gaussian Factors for State Estimation: A UWB Localization Case Study
by: Stirling, Andrew, et al.
Published: (2025)
by: Stirling, Andrew, et al.
Published: (2025)
Sigmoid Gating is More Sample Efficient than Softmax Gating in Mixture of Experts
by: Nguyen, Huy, et al.
Published: (2024)
by: Nguyen, Huy, et al.
Published: (2024)
DirMoE: Dirichlet-routed Mixture of Experts
by: Vahidi, Amirhossein, et al.
Published: (2026)
by: Vahidi, Amirhossein, et al.
Published: (2026)
A Statistical Theory of Gated Attention through the Lens of Hierarchical Mixture of Experts
by: Nguyen, Viet, et al.
Published: (2026)
by: Nguyen, Viet, et al.
Published: (2026)
Continual Traffic Forecasting via Mixture of Experts
by: Lee, Sanghyun, et al.
Published: (2024)
by: Lee, Sanghyun, et al.
Published: (2024)
Convergence Rates for Softmax Gating Mixture of Experts
by: Nguyen, Huy, et al.
Published: (2025)
by: Nguyen, Huy, et al.
Published: (2025)
Gaussian Process-Gated Hierarchical Mixtures of Experts
by: Liu, Yuhao, et al.
Published: (2023)
by: Liu, Yuhao, et al.
Published: (2023)
Resolution of the Borel-Kolmogorov Paradox via the Maximum Entropy Principle
by: Trésor, Raphaël, et al.
Published: (2025)
by: Trésor, Raphaël, et al.
Published: (2025)
On Expert Estimation in Hierarchical Mixture of Experts: Beyond Softmax Gating Functions
by: Nguyen, Huy, et al.
Published: (2024)
by: Nguyen, Huy, et al.
Published: (2024)
On Least Square Estimation in Softmax Gating Mixture of Experts
by: Nguyen, Huy, et al.
Published: (2024)
by: Nguyen, Huy, et al.
Published: (2024)
Fast Training of Mixture-of-Experts for Time Series Forecasting via Expert Loss Integration
by: Mahtout, Btissame El, et al.
Published: (2026)
by: Mahtout, Btissame El, et al.
Published: (2026)
Rethinking Multinomial Logistic Mixture of Experts with Sigmoid Gating Function
by: Pham, Tuan Minh, et al.
Published: (2026)
by: Pham, Tuan Minh, et al.
Published: (2026)
GatePro: Parameter-Free Expert Selection Optimization for Mixture-of-Experts Models
by: Zheng, Chen, et al.
Published: (2025)
by: Zheng, Chen, et al.
Published: (2025)
Wavelet Mixture of Experts for Time Series Forecasting
by: Zhou, Zheng, et al.
Published: (2025)
by: Zhou, Zheng, et al.
Published: (2025)
Mixture-of-Experts for Distributed Edge Computing with Channel-Aware Gating Function
by: Song, Qiuchen, et al.
Published: (2025)
by: Song, Qiuchen, et al.
Published: (2025)
Statistical Perspective of Top-K Sparse Softmax Gating Mixture of Experts
by: Nguyen, Huy, et al.
Published: (2023)
by: Nguyen, Huy, et al.
Published: (2023)
A General Theory for Softmax Gating Multinomial Logistic Mixture of Experts
by: Nguyen, Huy, et al.
Published: (2023)
by: Nguyen, Huy, et al.
Published: (2023)
Fate: Fast Edge Inference of Mixture-of-Experts Models via Cross-Layer Gate
by: Fang, Zhiyuan, et al.
Published: (2025)
by: Fang, Zhiyuan, et al.
Published: (2025)
A Gated Residual Kolmogorov-Arnold Networks for Mixtures of Experts
by: Inzirillo, Hugo, et al.
Published: (2024)
by: Inzirillo, Hugo, et al.
Published: (2024)
On Bayesian Softmax-Gated Mixture-of-Experts Models
by: Bariletto, Nicola, et al.
Published: (2026)
by: Bariletto, Nicola, et al.
Published: (2026)
Fed-GAME: Personalized Federated Learning with Graph Attention Mixture-of-Experts For Time-Series Forecasting
by: Li, Yi, et al.
Published: (2026)
by: Li, Yi, et al.
Published: (2026)
Mixture of Sparse Attention: Content-Based Learnable Sparse Attention via Expert-Choice Routing
by: Piękos, Piotr, et al.
Published: (2025)
by: Piękos, Piotr, et al.
Published: (2025)
Sub-MoE: Efficient Mixture-of-Expert LLMs Compression via Subspace Expert Merging
by: Li, Lujun, et al.
Published: (2025)
by: Li, Lujun, et al.
Published: (2025)
Mixture of Layers with Hybrid Attention
by: Ternovtsii, Ivan, et al.
Published: (2026)
by: Ternovtsii, Ivan, et al.
Published: (2026)
Efficiently Editing Mixture-of-Experts Models with Compressed Experts
by: He, Yifei, et al.
Published: (2025)
by: He, Yifei, et al.
Published: (2025)
Bandwidth-Efficient Adaptive Mixture-of-Experts via Low-Rank Compensation
by: Liu, Zhenyu, et al.
Published: (2025)
by: Liu, Zhenyu, et al.
Published: (2025)
On the Spatial Structure of Mixture-of-Experts in Transformers
by: Bershatsky, Daniel, et al.
Published: (2025)
by: Bershatsky, Daniel, et al.
Published: (2025)
Adaptive Sparsity Level during Training for Efficient Time Series Forecasting with Transformers
by: Atashgahi, Zahra, et al.
Published: (2023)
by: Atashgahi, Zahra, et al.
Published: (2023)
FaST: Efficient and Effective Long-Horizon Forecasting for Large-Scale Spatial-Temporal Graphs via Mixture-of-Experts
by: Zhao, Yiji, et al.
Published: (2026)
by: Zhao, Yiji, et al.
Published: (2026)
Klotski: Efficient Mixture-of-Expert Inference via Expert-Aware Multi-Batch Pipeline
by: Fang, Zhiyuan, et al.
Published: (2025)
by: Fang, Zhiyuan, et al.
Published: (2025)
Dynamic Adaptive Shared Experts with Grouped Multi-Head Attention Mixture of Experts
by: Li, Cheng, et al.
Published: (2025)
by: Li, Cheng, et al.
Published: (2025)
Mixture-of-Linear-Experts for Long-term Time Series Forecasting
by: Ni, Ronghao, et al.
Published: (2023)
by: Ni, Ronghao, et al.
Published: (2023)
Mixture-of-Experts under Finite-Rate Gating: Communication--Generalization Trade-offs
by: Khalesi, Ali, et al.
Published: (2026)
by: Khalesi, Ali, et al.
Published: (2026)
Expert Upcycling: Shifting the Compute-Efficient Frontier of Mixture-of-Experts
by: Dwivedi, Chaitanya, et al.
Published: (2026)
by: Dwivedi, Chaitanya, et al.
Published: (2026)
Differentiable Sparsity via $D$-Gating: Simple and Versatile Structured Penalization
by: Kolb, Chris, et al.
Published: (2025)
by: Kolb, Chris, et al.
Published: (2025)
Gated Ensemble of Spatio-temporal Mixture of Experts for Multi-task Learning in Ride-hailing System
by: Rahman, M. H., et al.
Published: (2020)
by: Rahman, M. H., et al.
Published: (2020)
Is Temperature Sample Efficient for Softmax Gaussian Mixture of Experts?
by: Nguyen, Huy, et al.
Published: (2024)
by: Nguyen, Huy, et al.
Published: (2024)
Similar Items
-
Composing Non-Conjugate Factor Graphs with Closed-Form Variational Inference
by: Lukashchuk, Mykola, et al.
Published: (2026) -
AME-TS: Anchored Mixture-of-Experts for Time Series Forecasting
by: Wang, Rui, et al.
Published: (2026) -
Quadratic Gating Mixture of Experts: Statistical Insights into Self-Attention
by: Akbarian, Pedram, et al.
Published: (2024) -
Gaussian Variational Inference with Non-Gaussian Factors for State Estimation: A UWB Localization Case Study
by: Stirling, Andrew, et al.
Published: (2025) -
Sigmoid Gating is More Sample Efficient than Softmax Gating in Mixture of Experts
by: Nguyen, Huy, et al.
Published: (2024)