Cover Image

Route Experts by Sequence, not by Token

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Wen, Tiansheng, Wang, Yifei, Feng, Aosong, Ma, Long, Liu, Xinyang, Wang, Yifan, Guo, Lixuan, Chen, Bo, Jegelka, Stefanie, You, Chenyu
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Artificial Intelligence Information Theory
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

CSRv2: Unlocking Ultra-Sparse Embeddings
by: Guo, Lixuan, et al.
Published: (2026)

No More K-means: Single-Stage Sparse Coding for Efficient Multi-Vector Retrieval
by: Guo, Lixuan, et al.
Published: (2026)

Beyond Matryoshka: Revisiting Sparse Coding for Adaptive Representation
by: Wen, Tiansheng, et al.
Published: (2025)

Scaling Attention via Feature Sparsity
by: Xie, Yan, et al.
Published: (2026)

An Information Criterion for Controlled Disentanglement of Multimodal Data
by: Wang, Chenyu, et al.
Published: (2024)

Understanding the Role of Equivariance in Self-supervised Learning
by: Wang, Yifei, et al.
Published: (2024)

Meta-Reinforcement Learning With Mixture of Experts for Generalizable Multi Access in Heterogeneous Wireless Networks
by: Liu, Zhaoyang, et al.
Published: (2024)

On Phi-entropic Dependence Measures and Non-local Correlations
by: Wang, Chenyu, et al.
Published: (2025)

Ribbons from Independence Structure: Hypercontractivity, $Φ$-Mutual Information, and Matrix $Φ$-Entropy
by: Wang, Chenyu, et al.
Published: (2026)

Expert Routing for Communication-Efficient MoE via Finite Expert Banks
by: Salehi, Mohammad Reza Deylam, et al.
Published: (2026)

Unified Block Signal Processing Framework for LPWANs: Sequence Index Modulation Spreading
by: Wen, Wenkun, et al.
Published: (2025)

Rethinking Grant-Free Protocol in mMTC
by: Zhu, Minhao, et al.
Published: (2024)

New Constructions of Locally Perfect Nonlinear Functions and Their Application to Sequence Sets With Low Ambiguity Zone
by: Yang, Zhiye, et al.
Published: (2025)

Text-Guided Token Communication for Wireless Image Transmission
by: Liu, Bole, et al.
Published: (2025)

Neural Estimation of Pairwise Mutual Information in Masked Discrete Sequence Models
by: Sharma, Jai, et al.
Published: (2026)

Successful Transmission Probability and SIR Meta Distribution Analysis for Multi-Antenna Cache-Enabled Networks with Interference Nulling
by: Feng, Tianming, et al.
Published: (2024)

Multi-Relational Structural Entropy
by: Cao, Yuwei, et al.
Published: (2024)

STAR-RIS-Enabled Multi-Path Beam Routing with Passive Beam Splitting
by: An, Bonan, et al.
Published: (2025)

Asymptotically Optimal Aperiodic Doppler Resilient Complementary Sequence Sets Via Generalized Quasi-Florentine Rectangles
by: Wang, Zheng, et al.
Published: (2025)

Joint Waveform Design for MIMO-OFDM DFRC Systems
by: Liu, Tianchen, et al.
Published: (2024)

Average Achievable Rate Analysis of Cell-Free Massive MIMO in the Finite Blocklength Regime with Imperfect CSI
by: Chen, Kai, et al.
Published: (2025)

Meta-Learning for Hybrid Precoding in Millimeter Wave MIMO System
by: Guo, Yifan
Published: (2024)

Robust Hybrid Precoding for Millimeter Wave MU-MISO System Via Meta-Learning
by: Guo, Yifan
Published: (2024)

Enhancing LEO Mega-Constellations with Inter-Satellite Links: Vision and Challenges
by: Wu, Chenyu, et al.
Published: (2024)

Sequence Reconstruction Problem for Ternary Deletion Channels
by: Wang, Xiang, et al.
Published: (2025)

Absorbing Markov Chain-Based Analysis of Age of Information in Discrete-Time Dual-Queue Systems
by: Feng, Yifan, et al.
Published: (2025)

Receiver-Centric Generative Semantic Communications
by: Liu, Xunze, et al.
Published: (2024)

Integrated Sensing, Computing, Communication, and Control for Time-Sequence-Based Semantic Communications
by: Li, Qingliang, et al.
Published: (2025)

Large Deviations for Sequential Tests of Statistical Sequence Matching
by: Zhou, Lin, et al.
Published: (2025)

Large and Small Deviations for Statistical Sequence Matching
by: Zhou, Lin, et al.
Published: (2024)

Maximum Length RLL Sequences in de Bruijn Graph
by: Chee, Yeow Meng, et al.
Published: (2024)

Sequence Reconstruction for Sticky Insertion/Deletion Channels
by: Pham, Van Long Phuoc, et al.
Published: (2025)

Fundamental Limits of Coded Caching with Fixed Subpacketization
by: Cheng, Minquan, et al.
Published: (2025)

Analysis Methodology for Age of Information under Sequence Based Scheduling
by: Liu, Fang, et al.
Published: (2024)

Some New Results on Sequence Reconstruction Problem for Deletion Channels
by: Wang, Xiang, et al.
Published: (2026)

Generative Channel Knowledge Base With Environmental Information for Joint Source-Channel Coding in Semantic Communications
by: Long, Xudong, et al.
Published: (2026)

Ambidextrous Degree Sequence Bounds for Pessimistic Cardinality Estimation
by: Lin, Yu-Ting, et al.
Published: (2025)

QoS-Aware and Routing-Flexible Network Slicing for Service-Oriented Networks
by: Chen, Wei-Kun, et al.
Published: (2024)

Explicit Performance Bound of Finite Blocklength Coded MIMO: Time-Domain versus Spatiotemporal Channel Coding
by: Ye, Feng, et al.
Published: (2024)

Joint Beamforming and Position Optimization for IRS-Aided SWIPT with Movable Antennas
by: Zhu, Yanze, et al.
Published: (2025)