Cover Image

ConceptMoE: Adaptive Token-to-Concept Compression for Implicit Compute Allocation

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Huang, Zihao, Zhou, Jundong, Qu, Xingwei, Min, Qiyang, Zhang, Ge
Format:	Preprint
Published:	2026
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Dynamic Large Concept Models: Latent Reasoning in an Adaptive Semantic Space
by: Qu, Xingwei, et al.
Published: (2025)

Frac-Connections: Fractional Extension of Hyper-Connections
by: Zhu, Defa, et al.
Published: (2025)

Concept Tokens: Learning Behavioral Embeddings Through Concept Definitions
by: Sastre, Ignacio, et al.
Published: (2026)

DriftMoE: A Mixture of Experts Approach to Handle Concept Drifts
by: Aspis, Miguel, et al.
Published: (2025)

Over-Tokenized Transformer: Vocabulary is Generally Worth Scaling
by: Huang, Hongzhi, et al.
Published: (2025)

Ultra-Sparse Memory Network
by: Huang, Zihao, et al.
Published: (2024)

Interpretable Neuropsychiatric Diagnosis via Concept-Guided Graph Neural Networks
by: Wang, Song, et al.
Published: (2025)

Trained on Tokens, Calibrated on Concepts: The Emergence of Semantic Calibration in LLMs
by: Nakkiran, Preetum, et al.
Published: (2025)

Adaptive Test-Time Intervention for Concept Bottleneck Models
by: Shen, Matthew, et al.
Published: (2025)

Direct Preference Optimization for Adaptive Concept-based Explanations
by: Teneggi, Jacopo, et al.
Published: (2025)

Diverse Concept Proposals for Concept Bottleneck Models
by: Brown, Katrina, et al.
Published: (2024)

Beyond Token Eviction: Mixed-Dimension Budget Allocation for Efficient KV Cache Compression
by: Miao, Ruijie, et al.
Published: (2026)

Unlearning Concepts in Diffusion Model via Concept Domain Correction and Concept Preserving Gradient
by: Wu, Yongliang, et al.
Published: (2024)

Concept Algebra for (Score-Based) Text-Controlled Generative Models
by: Wang, Zihao, et al.
Published: (2023)

Adaptive Domain Inference Attack with Concept Hierarchy
by: Gu, Yuechun, et al.
Published: (2023)

MoBE: Mixture-of-Basis-Experts for Compressing MoE-based LLMs
by: Chen, Xiaodong, et al.
Published: (2025)

Concept Graph Convolutions: Message Passing in the Concept Space
by: Magister, Lucie Charlotte, et al.
Published: (2026)

Subgraph Concept Networks: Concept Levels in Graph Classification
by: Magister, Lucie Charlotte, et al.
Published: (2026)

Understanding Inter-Concept Relationships in Concept-Based Models
by: Raman, Naveen, et al.
Published: (2024)

Online Boosting Adaptive Learning under Concept Drift for Multistream Classification
by: Yu, En, et al.
Published: (2023)

The Concept Allocation Zone: Tracking How Concepts Form Across Transformer Depth
by: Henry, James
Published: (2026)

Concept-Centric Token Interpretation for Vector-Quantized Generative Models
by: Yang, Tianze, et al.
Published: (2025)

Concept Gradient: Concept-based Interpretation Without Linear Assumption
by: Bai, Andrew, et al.
Published: (2022)

Lyapunov-Stable Adaptive Control for Multimodal Concept Drift
by: Pan, Tianyu Bell, et al.
Published: (2025)

MGAA: Multi-Granular Adaptive Allocation fof Low-Rank Compression of LLMs
by: Li, Guangyan, et al.
Published: (2025)

Optimal Resource Allocation for ML Model Training and Deployment under Concept Drift
by: Beytur, Hasan Burhan, et al.
Published: (2025)

Concept Factorization via Self-Representation and Adaptive Graph Structure Learning
by: Yang, Zhengqin, et al.
Published: (2025)

Adaptive Dual Prompting: Hierarchical Debiasing for Fairness-aware Graph Neural Networks
by: Yang, Yuhan, et al.
Published: (2025)

Concept Component Analysis: A Principled Approach for Concept Extraction in LLMs
by: Liu, Yuhang, et al.
Published: (2026)

ARA: Adaptive Rank Allocation for Efficient Large Language Model SVD Compression
by: Xv, Lin, et al.
Published: (2025)

Addressing Concept Mislabeling in Concept Bottleneck Models Through Preference Optimization
by: Penaloza, Emiliano, et al.
Published: (2025)

Incremental Residual Concept Bottleneck Models
by: Shang, Chenming, et al.
Published: (2024)

InfoCons: Identifying Interpretable Critical Concepts in Point Clouds via Information Theory
by: Li, Feifei, et al.
Published: (2025)

Generalizing GNNs with Tokenized Mixture of Experts
by: Guo, Xiaoguang, et al.
Published: (2026)

Controllable Concept Bottleneck Models
by: Lin, Hongbin, et al.
Published: (2026)

Adaptive Tokenization: On the Hop-Overpriority Problem in Tokenized Graph Learning Models
by: Wang, Zhibiao, et al.
Published: (2025)

Concept Boundary Vectors
by: Walker, Thomas
Published: (2024)

An Adaptive Sampling Framework for Detecting Localized Concept Drift under Label Scarcity
by: Pyeon, Junghee, et al.
Published: (2025)

I Predict Therefore I Am: Is Next Token Prediction Enough to Learn Human-Interpretable Concepts from Data?
by: Liu, Yuhang, et al.
Published: (2025)

Autonomous Concept Drift Threshold Determination
by: Lu, Pengqian, et al.
Published: (2025)