Imagen de Portada

MambaByte: Token-free Selective State Space Model

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Wang, Junxiong, Gangavarapu, Tushaar, Yan, Jing Nathan, Rush, Alexander M.
Formato:	Preprint
Publicado:	2024
Materias:	Computation and Language Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

IMAS: A Comprehensive Agentic Approach to Rural Healthcare Delivery
por: Gangavarapu, Agasthya, et al.
Publicado: (2024)

Introducing L2M3, A Multilingual Medical Large Language Model to Advance Health Equity in Low-Resource Regions
por: Gangavarapu, Agasthya
Publicado: (2024)

ByteFlow: Language Modeling through Adaptive Byte Compression without a Tokenizer
por: Deng, Chunyuan, et al.
Publicado: (2026)

SpaceByte: Towards Deleting Tokenization from Large Language Modeling
por: Slagle, Kevin
Publicado: (2024)

MemMamba: Rethinking Memory Patterns in State Space Model
por: Wang, Youjin, et al.
Publicado: (2025)

Rethinking Token Reduction for State Space Models
por: Zhan, Zheng, et al.
Publicado: (2024)

MoE-Mamba: Efficient Selective State Space Models with Mixture of Experts
por: Pióro, Maciej, et al.
Publicado: (2024)

Compute-Constrained Data Selection
por: Yin, Junjie Oscar, et al.
Publicado: (2024)

GPT-2 Through the Lens of Vector Symbolic Architectures
por: Knittel, Johannes, et al.
Publicado: (2024)

DenseMamba: State Space Models with Dense Hidden Connection for Efficient Large Language Models
por: He, Wei, et al.
Publicado: (2024)

The Mamba in the Llama: Distilling and Accelerating Hybrid Models
por: Wang, Junxiong, et al.
Publicado: (2024)

Lost in State Space: Probing Frozen Mamba Representations
por: Wagh, Bhagyashree, et al.
Publicado: (2026)

Exact Byte-Level Probabilities from Tokenized Language Models for FIM-Tasks and Model Ensembles
por: Phan, Buu, et al.
Publicado: (2024)

Distilling Token-Trained Models into Byte-Level Models
por: Bao, Zishuo, et al.
Publicado: (2026)

MatMamba: A Matryoshka State Space Model
por: Shukla, Abhinav, et al.
Publicado: (2024)

Data Distribution as a Lever for Guiding Optimizers Toward Superior Generalization in LLMs
por: Gangavarapu, Tushaar, et al.
Publicado: (2026)

Characterizing the Behavior of Training Mamba-based State Space Models on GPUs
por: Baruah, Trinayan, et al.
Publicado: (2025)

A Controlled Study on Long Context Extension and Generalization in LLMs
por: Lu, Yi, et al.
Publicado: (2024)

MrT5: Dynamic Token Merging for Efficient Byte-level Language Models
por: Kallini, Julie, et al.
Publicado: (2024)

Mamba-Shedder: Post-Transformer Compression for Efficient Selective Structured State Space Models
por: Muñoz, J. Pablo, et al.
Publicado: (2025)

R2Gen-Mamba: A Selective State Space Model for Radiology Report Generation
por: Sun, Yongheng, et al.
Publicado: (2024)

BlackMamba: Mixture of Experts for State-Space Models
por: Anthony, Quentin, et al.
Publicado: (2024)

The Computational Limits of State-Space Models and Mamba via the Lens of Circuit Complexity
por: Chen, Yifang, et al.
Publicado: (2024)

M1: Towards Scalable Test-Time Compute with Mamba Reasoning Models
por: Wang, Junxiong, et al.
Publicado: (2025)

MambaMixer: Efficient Selective State Space Models with Dual Token and Channel Selection
por: Behrouz, Ali, et al.
Publicado: (2024)

SENTRA: Selected-Next-Token Transformer for LLM Text Detection
por: Plyler, Mitchell, et al.
Publicado: (2025)

Parity-Aware Byte-Pair Encoding: Improving Cross-lingual Fairness in Tokenization
por: Foroutan, Negar, et al.
Publicado: (2025)

Conversations Gone Awry, But Then? Evaluating Conversational Forecasting Models
por: Tran, Son Quoc, et al.
Publicado: (2025)

GPUTOK: GPU Accelerated Byte Level BPE Tokenization
por: Kadamba, Venu Gopal, et al.
Publicado: (2026)

The Efficiency Gap in Byte Modeling
por: Lee, Celine, et al.
Publicado: (2026)

Taipan: Efficient and Expressive State Space Language Models with Selective Attention
por: Van Nguyen, Chien, et al.
Publicado: (2024)

Efficient Temporal Tokenization for Mobility Prediction with Large Language Models
por: He, Haoyu, et al.
Publicado: (2025)

Token Sparse Attention: Efficient Long-Context Inference with Interleaved Token Selection
por: Jo, Dongwon, et al.
Publicado: (2026)

Improving Diffusion Language Model Decoding through Joint Search in Generation Order and Token Space
por: Shen, Yangyi, et al.
Publicado: (2026)

Sessa: Selective State Space Attention
por: Horbatko, Liubomyr
Publicado: (2026)

Byte-token Enhanced Language Models for Temporal Point Processes Analysis
por: Kong, Quyu, et al.
Publicado: (2025)

Mixture-of-Mamba: Enhancing Multi-Modal State-Space Models with Modality-Aware Sparsity
por: Liang, Weixin, et al.
Publicado: (2025)

On the Expressiveness and Length Generalization of Selective State-Space Models on Regular Languages
por: Terzić, Aleksandar, et al.
Publicado: (2024)

Attamba: Attending To Multi-Token States
por: Akhauri, Yash, et al.
Publicado: (2024)

Attention with Trained Embeddings Provably Selects Important Tokens
por: Wu, Diyuan, et al.
Publicado: (2025)