Cover Image

A Simple Model of Inference Scaling Laws

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Levi, Noam
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Artificial Intelligence Information Theory
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

LLMs as Noisy Channels: A Shannon Perspective on Model Capacity and Scaling Laws
by: Ouyang, Xu, et al.
Published: (2026)

Learning Shrinks the Hard Tail: Training-Dependent Inference Scaling in a Solvable Linear Model
by: Levi, Noam
Published: (2026)

Understanding LLM Behaviors via Compression: Data Generation, Knowledge Acquisition and Scaling Laws
by: Pan, Zhixuan, et al.
Published: (2025)

Beyond the Loss Curve: Scaling Laws, Active Learning, and the Limits of Learning from Exact Posteriors
by: Khorasani, Arian, et al.
Published: (2026)

Simple Convergence Proof of Adam From a Sign-like Descent Perspective
by: Peng, Hanyang, et al.
Published: (2025)

Scaling Laws and Tradeoffs in Recurrent Networks of Expressive Neurons
by: Spieler, Aaron, et al.
Published: (2026)

Score-Based Variational Inference for Inverse Problems
by: Xue, Zhipeng, et al.
Published: (2024)

Modular Learning of Deep Causal Generative Models for High-dimensional Causal Inference
by: Rahman, Md Musfiqur, et al.
Published: (2024)

Semantic Rate Distortion and Posterior Design: Compute Constraints, Multimodality, and Strategic Inference
by: Akyol, Emrah
Published: (2026)

Dynamic Quality-Latency Aware Routing for LLM Inference in Wireless Edge-Device Networks
by: Bao, Rui, et al.
Published: (2025)

Random Aggregate Beamforming for Over-the-Air Federated Learning in Large-Scale Networks
by: Xu, Chunmei, et al.
Published: (2024)

A Wireless Foundation Model for Multi-Task Prediction
by: Sheng, Yucheng, et al.
Published: (2025)

Tele-LLMs: A Series of Specialized Large Language Models for Telecommunications
by: Maatouk, Ali, et al.
Published: (2024)

LLaTTE: Scaling Laws for Multi-Stage Sequence Modeling in Large-Scale Ads Recommendation
by: Xiong, Lee, et al.
Published: (2026)

How Much Is a Dataset Worth? Scaling Laws, the Vendi Score, and Matrix Spectral Functions
by: Bilmes, Jeff A., et al.
Published: (2026)

Scaling Laws for Online Advertisement Retrieval
by: Wang, Yunli, et al.
Published: (2024)

Diffusion Models for Wireless Communications
by: Letafati, Mehdi, et al.
Published: (2023)

On the Limits of Self-Improving in Large Language Models: The Singularity Is Not Near Without Symbolic Model Synthesis
by: Zenil, Hector
Published: (2026)

Curvature-Weighted Capacity Allocation: A Minimum Description Length Framework for Layer-Adaptive Large Language Model Optimization
by: Amaefuna, Theophilus, et al.
Published: (2026)

Large Language Models for Telecom: Forthcoming Impact on the Industry
by: Maatouk, Ali, et al.
Published: (2023)

InfoChess: A Game of Adversarial Inference and a Laboratory for Quantifiable Information Control
by: Murphy, Kieran A.
Published: (2026)

Collaborative Edge AI Inference over Cloud-RAN
by: Zhang, Pengfei, et al.
Published: (2024)

L$^2$M: Mutual Information Scaling Law for Long-Context Language Modeling
by: Chen, Zhuo, et al.
Published: (2025)

MARS: Margin and Semantic-Aware Data Augmentation for Reward Modeling
by: Bhattacharjee, Payel, et al.
Published: (2026)

Confidence-Based Decoding is Provably Efficient for Diffusion Language Models
by: Cai, Changxiao, et al.
Published: (2026)

General Information Metrics for Improving AI Model Training Efficiency
by: Xu, Jianfeng, et al.
Published: (2025)

WDMoE: Wireless Distributed Large Language Models with Mixture of Experts
by: Xue, Nan, et al.
Published: (2024)

IBB Traffic Graph Data: Benchmarking and Road Traffic Prediction Model
by: Olug, Eren, et al.
Published: (2024)

In-Context Learning for MIMO Equalization Using Transformer-Based Sequence Models
by: Zecchin, Matteo, et al.
Published: (2023)

Neural Estimation of Pairwise Mutual Information in Masked Discrete Sequence Models
by: Sharma, Jai, et al.
Published: (2026)

Conditional Denoising Diffusion Probabilistic Models for Data Reconstruction Enhancement in Wireless Communications
by: Letafati, Mehdi, et al.
Published: (2023)

Learning Unknown Intervention Targets in Structural Causal Models from Heterogeneous Data
by: Yang, Yuqin, et al.
Published: (2023)

Diffusion Model-Based Data Synthesis Aided Federated Semi-Supervised Learning
by: Wang, Zhongwei, et al.
Published: (2025)

Private Collaborative Edge Inference via Over-the-Air Computation
by: Yilmaz, Selim F., et al.
Published: (2024)

MambaJSCC: Adaptive Deep Joint Source-Channel Coding with Generalized State Space Model
by: Wu, Tong, et al.
Published: (2024)

Semantic Text Transmission via Prediction with Small Language Models: Cost-Similarity Trade-off
by: Madhabhavi, Bhavani A, et al.
Published: (2024)

Generative Model-Aided Continual Learning for CSI Feedback in FDD mMIMO-OFDM Systems
by: Liu, Guijun, et al.
Published: (2025)

Polynomial Context-Truncation Sensitivity in Autoregressive Language Models: Sequential Wyner-Ziv Bounds for KV Cache Compression
by: Kim, Munsik
Published: (2026)

SPEX: Scaling Feature Interaction Explanations for LLMs
by: Kang, Justin Singh, et al.
Published: (2025)

K*-Means: A Parameter-free Clustering Algorithm
by: Mahon, Louis, et al.
Published: (2025)