Imagen de Portada

Byte Latent Transformer: Patches Scale Better Than Tokens

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Pagnoni, Artidoro, Pasunuru, Ram, Rodriguez, Pedro, Nguyen, John, Muller, Benjamin, Li, Margaret, Zhou, Chunting, Yu, Lili, Weston, Jason, Zettlemoyer, Luke, Ghosh, Gargi, Lewis, Mike, Holtzman, Ari, Iyer, Srinivasan
Formato:	Preprint
Publicado:	2024
Materias:	Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Fast Byte Latent Transformer
por: Kallini, Julie, et al.
Publicado: (2026)

Compute Optimal Tokenization
por: Limisiewicz, Tomasz, et al.
Publicado: (2026)

Predicting vs. Acting: A Trade-off Between World Modeling & Agent Modeling
por: Li, Margaret, et al.
Publicado: (2024)

Mixture-of-Transformers: A Sparse and Scalable Architecture for Multi-Modal Foundation Models
por: Liang, Weixin, et al.
Publicado: (2024)

Latent Speech-Text Transformer
por: Lu, Yen-Ju, et al.
Publicado: (2025)

MoMa: Efficient Early-Fusion Pre-training with Mixture of Modality-Aware Experts
por: Lin, Xi Victoria, et al.
Publicado: (2024)

Self-Alignment with Instruction Backtranslation
por: Li, Xian, et al.
Publicado: (2023)

CAT: Content-Adaptive Image Tokenization
por: Shen, Junhong, et al.
Publicado: (2025)

ALMA: Alignment with Minimal Annotation
por: Yasunaga, Michihiro, et al.
Publicado: (2024)

MYTE: Morphology-Driven Byte Encoding for Better and Fairer Multilingual Language Modeling
por: Limisiewicz, Tomasz, et al.
Publicado: (2024)

Better Alignment with Instruction Back-and-Forth Translation
por: Nguyen, Thao, et al.
Publicado: (2024)

Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Model
por: Zhou, Chunting, et al.
Publicado: (2024)

LMFusion: Adapting Pretrained Language Models for Multimodal Generation
por: Shi, Weijia, et al.
Publicado: (2024)

Computational Tradeoffs in Image Synthesis: Diffusion, Masked-Token, and Next-Token Prediction
por: Kilian, Maciej, et al.
Publicado: (2024)

Designing a Future-Proof Cryptography Strategy for Quantum Computing
por: Sreekanth Pasunuru
Publicado: (2024)

Instruction-tuned Language Models are Better Knowledge Learners
por: Jiang, Zhengbao, et al.
Publicado: (2024)

Memory Layers at Scale
por: Berges, Vincent-Pierre, et al.
Publicado: (2024)

Can You Keep a Secret? Involuntary Information Leakage in Language Model Writing
por: Holtzman, Ari, et al.
Publicado: (2026)

Linearly Decoding Refused Knowledge in Aligned Language Models
por: Shrivastava, Aryan, et al.
Publicado: (2025)

AI as Entertainment
por: Kommers, Cody, et al.
Publicado: (2026)

Prompting as Scientific Inquiry
por: Holtzman, Ari, et al.
Publicado: (2025)

(Mis)Fitting: A Survey of Scaling Laws
por: Li, Margaret, et al.
Publicado: (2025)

In-context Pretraining: Language Modeling Beyond Document Boundaries
por: Shi, Weijia, et al.
Publicado: (2023)

The weighted Bergman spaces and complex reflection groups
por: Ghosh, Gargi
Publicado: (2021)

Continual Learning via Sparse Memory Finetuning
por: Lin, Jessy, et al.
Publicado: (2025)

Megalodon: Efficient LLM Pretraining and Inference with Unlimited Context Length
por: Ma, Xuezhe, et al.
Publicado: (2024)

HoneyBee: Data Recipes for Vision-Language Reasoners
por: Bansal, Hritik, et al.
Publicado: (2025)

When Worse is Better: Navigating the compression-generation tradeoff in visual tokenization
por: Ramanujan, Vivek, et al.
Publicado: (2024)

Multi-Token Attention
por: Golovneva, Olga, et al.
Publicado: (2025)

Improving Factuality with Explicit Working Memory
por: Chen, Mingda, et al.
Publicado: (2024)

Entre el hábitat y la vivienda. Dos experiencias de organización comunitaria y cooperativa en la ciudad de Rosario (Argentina)
por: Anahí G. Pagnoni
Publicado: (2021)

Slicing and Dicing: Configuring Optimal Mixtures of Experts
por: Li, Margaret, et al.
Publicado: (2026)

LLM Probability Concentration: How Alignment Shrinks the Generative Horizon
por: Yang, Chenghao, et al.
Publicado: (2025)

MUSE: Machine Unlearning Six-Way Evaluation for Language Models
por: Shi, Weijia, et al.
Publicado: (2024)

Demystifying Prompts in Language Models via Perplexity Estimation
por: Gonen, Hila, et al.
Publicado: (2022)

Infini-gram: Scaling Unbounded n-gram Language Models to a Trillion Tokens
por: Liu, Jiacheng, et al.
Publicado: (2024)

Cancer Development in Sjögren's Syndrome: Prognostic Factors and Clinical Implications
por: Gianluca Pagnoni, et al.
Publicado: (2025)

$2$-proper holomorphic images of classical Cartan domains
por: Ghosh, Gargi, et al.
Publicado: (2023)

Holomorphic retracts in the Lie ball and the tetrablock
por: Ghosh, Gargi, et al.
Publicado: (2024)

Micro Language Models Enable Instant Responses
por: Cheng, Wen, et al.
Publicado: (2026)