Cover Image

Language Modeling Is Compression

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Delétang, Grégoire, Ruoss, Anian, Duquenne, Paul-Ambroise, Catt, Elliot, Genewein, Tim, Mattern, Christopher, Grau-Moya, Jordi, Wenliang, Li Kevin, Aitchison, Matthew, Orseau, Laurent, Hutter, Marcus, Veness, Joel
Format:	Preprint
Published:	2023
Subjects:	Machine Learning Artificial Intelligence Computation and Language Information Theory
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Learning Universal Predictors
by: Grau-Moya, Jordi, et al.
Published: (2024)

Understanding Prompt Tuning and In-Context Learning via Meta-Learning
by: Genewein, Tim, et al.
Published: (2025)

Amortized Planning with Large-Scale Transformers: A Case Study on Chess
by: Ruoss, Anian, et al.
Published: (2024)

Why is prompting hard? Understanding prompts on binary sequence predictors
by: Wenliang, Li Kevin, et al.
Published: (2025)

Compression via Pre-trained Transformers: A Study on Byte-Level Multimodal Data
by: Heurtel-Depeiges, David, et al.
Published: (2024)

Distributional Bellman Operators over Mean Embeddings
by: Wenliang, Li Kevin, et al.
Published: (2023)

Partition Tree Weighting for Non-Stationary Stochastic Bandits
by: Veness, Joel, et al.
Published: (2025)

Your Policy Regularizer is Secretly an Adversary
by: Brekelmans, Rob, et al.
Published: (2022)

Isotuning With Applications To Scale-Free Online Learning
by: Orseau, Laurent, et al.
Published: (2021)

LMAct: A Benchmark for In-Context Imitation Learning with Long Multimodal Demonstrations
by: Ruoss, Anian, et al.
Published: (2024)

Exponential Speedups by Rerooting Levin Tree Search
by: Orseau, Laurent, et al.
Published: (2024)

Levin Tree Search with Context Models
by: Orseau, Laurent, et al.
Published: (2023)

Evaluating Frontier Models for Dangerous Capabilities
by: Phuong, Mary, et al.
Published: (2024)

Unified Vision-Language Modeling via Concept Space Alignment
by: Qiu, Yifu, et al.
Published: (2026)

The semigroup of endomorphisms with restricted range of an independence algebra
by: Grau, Ambroise
Published: (2022)

Super-Exponential Regret for UCT, AlphaGo and Variants
by: Orseau, Laurent, et al.
Published: (2024)

Auf Pump
by: Ruoss, Matthias
Published: (2025)

Schweizerdeutsch und Sprachbewusstsein
by: Ruoss, Emanuel
Published: (2020)

An Information-Theoretic Diagnostic Analytics Framework for Mapping Past-Future Dependence in Horizon-Specific Forecastability
by: Catt, Peter Maurice
Published: (2026)

Forecastability as an Information-Theoretic Limit on Prediction
by: Catt, Peter Maurice
Published: (2026)

On the Limits of Prediction: Forecastability Profiles and Information Decay in Time Series
by: Catt, Peter Maurice
Published: (2026)

The Olympic Training Field for Planning Quality Library Services.
by: Catt, Martha E.
Published: (1995)

Learning to Skip the Middle Layers of Transformers
by: Lawson, Tim, et al.
Published: (2025)

Structure-Induced Information for Rerooting Levin Tree Search
by: Tuero, Jake, et al.
Published: (2026)

Translational hulls of semigroups of endomorphisms of an algebra
by: Gould, Victoria, et al.
Published: (2024)

Properties of Algorithmic Information Distance
by: Hutter, Marcus
Published: (2025)

Rafael M. Mérida Jiménez (2016). Transbarcelonas. Cultura, género y sexualidad en la España del siglo XX. Barcelona: Edicions Bellaterra. ISBN: 9788472907423
by: Jordi Mas Grau
Published: (2016)

Finding Increasingly Large Extremal Graphs with AlphaZero and Tabu Search
by: Mehrabian, Abbas, et al.
Published: (2023)

Editorial for “Participant Discomfort During 5 T MRI Examinations and Its Contributing Factors”
by: Hendrik Mattern
Published: (2025)

MethOxyfluraNe in InTerventiOnal Radiology (MONITOR): A randomised controlled trial
by: Ross Copping, et al.
Published: (2024)

A Generative Model of Conspicuous Consumption and Status Signaling
by: Cross, Logan, et al.
Published: (2026)

Tortugas marinas en Zanzibar. / Natalie, Aitchison
by: Aitchison, Natalie
Published: (1993)

Why you don't overfit, and don't need Bayes if you only train for one epoch
by: Aitchison, Laurence
Published: (2024)

A voz do Sul na CONFINTEA VI: a agenda da África
by: John Aitchison
Published: (2009)

LLMs are Greedy Agents: Effects of RL Fine-tuning on Decision-Making Abilities
by: Schmied, Thomas, et al.
Published: (2025)

La emigración en masa del Alto Volta: realidades y efectos
by: Ambroise Songre
Published: (1973)

Mass emigration from Upper Volta: the facts and implications
by: Ambroise Songre
Published: (1973)

L'émigration massive des Voltaïques: réalités et effets
by: Ambroise Songre
Published: (1973)

Academic drifts in vocational, professional, and continuing education: A multi-perspective approach for the case of Switzerland
by: Neumann, Jörg, et al.
Published: (2025)

Foundations of algorithmic thermodynamics
by: Ebtekar, Aram, et al.
Published: (2023)