Imagen de Portada

Bolmo: Byteifying the Next Generation of Language Models

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Minixhofer, Benjamin, Murray, Tyler, Limisiewicz, Tomasz, Korhonen, Anna, Zettlemoyer, Luke, Smith, Noah A., Ponti, Edoardo M., Soldaini, Luca, Hofmann, Valentin
Formato:	Preprint
Publicado:	2025
Materias:	Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Breaking the Curse of Multilinguality with Cross-lingual Expert Language Models
por: Blevins, Terra, et al.
Publicado: (2024)

MYTE: Morphology-Driven Byte Encoding for Better and Fairer Multilingual Language Modeling
por: Limisiewicz, Tomasz, et al.
Publicado: (2024)

Zero-Shot Tokenizer Transfer
por: Minixhofer, Benjamin, et al.
Publicado: (2024)

Universal Cross-Tokenizer Distillation via Approximate Likelihood Matching
por: Minixhofer, Benjamin, et al.
Publicado: (2025)

MAGNET: Improving the Multilingual Fairness of Language Models with Adaptive Gradient-Based Tokenization
por: Ahia, Orevaoghene, et al.
Publicado: (2024)

Scaling Sparse Fine-Tuning to Large Language Models
por: Ansell, Alan, et al.
Publicado: (2024)

Dual Debiasing: Remove Stereotypes and Keep Factual Gender for Fair Language Modeling and Translation
por: Limisiewicz, Tomasz, et al.
Publicado: (2025)

Demystifying Prompts in Language Models via Perplexity Estimation
por: Gonen, Hila, et al.
Publicado: (2022)

Bootstrapping Action-Grounded Visual Dynamics in Unified Vision-Language Models
por: Qiu, Yifu, et al.
Publicado: (2025)

Emergent Communication Pretraining for Few-Shot Machine Translation
por: Li, Yaoyiran, et al.
Publicado: (2020)

Does Liking Yellow Imply Driving a School Bus? Semantic Leakage in Language Models
por: Gonen, Hila, et al.
Publicado: (2024)

Spectral Editing of Activations for Large Language Model Alignment
por: Qiu, Yifu, et al.
Publicado: (2024)

Retrofitting Large Language Models with Dynamic Tokenization
por: Feher, Darius, et al.
Publicado: (2024)

Debiasing Algorithm through Model Adaptation
por: Limisiewicz, Tomasz, et al.
Publicado: (2023)

Fast Byte Latent Transformer
por: Kallini, Julie, et al.
Publicado: (2026)

Compute Optimal Tokenization
por: Limisiewicz, Tomasz, et al.
Publicado: (2026)

Beyond Literal Token Overlap: Token Alignability for Multilinguality
por: Hämmerl, Katharina, et al.
Publicado: (2025)

SILO Language Models: Isolating Legal Risk In a Nonparametric Datastore
por: Min, Sewon, et al.
Publicado: (2023)

Evaluating Copyright Takedown Methods for Language Models
por: Wei, Boyi, et al.
Publicado: (2024)

Bigram Subnetworks: Mapping to Next Tokens in Transformer Language Models
por: Chang, Tyler A., et al.
Publicado: (2025)

Self-Improving World Modelling with Latent Actions
por: Qiu, Yifu, et al.
Publicado: (2026)

Navigating the Alignment-Calibration Trade-off: A Pareto-Superior Frontier via Model Merging
por: Hu, Tiancheng, et al.
Publicado: (2025)

Quantifying Language Disparities in Multilingual Large Language Models
por: Hu, Songbo, et al.
Publicado: (2025)

Fine-tuning Large Language Models with Sequential Instructions
por: Hu, Hanxu, et al.
Publicado: (2024)

Polyglot Teachers: Evaluating Language Models for Multilingual Synthetic Data Generation
por: Miranda, Lester James V., et al.
Publicado: (2026)

Visual Sketchpad: Sketching as a Visual Chain of Thought for Multimodal Language Models
por: Hu, Yushi, et al.
Publicado: (2024)

Comparing Hallucination Detection Metrics for Multilingual Generation
por: Kang, Haoqiang, et al.
Publicado: (2024)

Cross-Lingual and Cross-Cultural Variation in Image Descriptions
por: Berger, Uri, et al.
Publicado: (2024)

MUSE: Machine Unlearning Six-Way Evaluation for Language Models
por: Shi, Weijia, et al.
Publicado: (2024)

Analyzing and Adapting Large Language Models for Few-Shot Multilingual NLU: Are We There Yet?
por: Razumovskaia, Evgeniia, et al.
Publicado: (2024)

Cultural Learning-Based Culture Adaptation of Language Models
por: Liu, Chen Cecilia, et al.
Publicado: (2025)

Teaching Models to Understand (but not Generate) High-risk Data
por: Wang, Ryan, et al.
Publicado: (2025)

SuperBPE: Space Travel for Language Models
por: Liu, Alisa, et al.
Publicado: (2025)

Micro Language Models Enable Instant Responses
por: Cheng, Wen, et al.
Publicado: (2026)

Generative Adapter: Contextualizing Language Models in Parameters with A Single Forward Pass
por: Chen, Tong, et al.
Publicado: (2024)

On Bilingual Lexicon Induction with Large Language Models
por: Li, Yaoyiran, et al.
Publicado: (2023)

Paloma: A Benchmark for Evaluating Language Model Fit
por: Magnusson, Ian, et al.
Publicado: (2023)

Mathfish: Evaluating Language Model Math Reasoning via Grounding in Educational Curricula
por: Lucy, Li, et al.
Publicado: (2024)

FlexOlmo: Open Language Models for Flexible Data Use
por: Shi, Weijia, et al.
Publicado: (2025)

Infini-gram: Scaling Unbounded n-gram Language Models to a Trillion Tokens
por: Liu, Jiacheng, et al.
Publicado: (2024)