Image de couverture de livre

LLMs as Noisy Channels: A Shannon Perspective on Model Capacity and Scaling Laws

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Ouyang, Xu, Liu, Deyi, Cai, Yuhang, Liu, Jing, Yang, Yuan, Zheng, Chen, Hartvigsen, Thomas, Ma, Yiyuan
Format:	Preprint
Publié:	2026
Sujets:	Machine Learning Artificial Intelligence Information Theory
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Capacity-Achieving Codes for Noisy Insertion Channels
par: Liu, Hengfeng, et autres
Publié: (2025)

On the Capacity of Noisy Frequency-based Channels
par: Gerzon, Yuval, et autres
Publié: (2026)

Shannon meets Gödel-Tarski-Löb: Undecidability of Shannon Feedback Capacity for Finite-State Channels
par: Majumdar, Angshul
Publié: (2026)

Computability of the Zero-Error Capacity of Noisy Channels
par: Boche, Holger, et autres
Publié: (2020)

Advances in the Shannon Capacity of Graphs
par: Lavi, Nitay, et autres
Publié: (2025)

Channel Capacity of Near-Field Line-of-Sight Multiuser Communications
par: Zhao, Boqun, et autres
Publié: (2024)

Capacity Scaling Laws for Boundary-Induced Drift-Diffusion Noise Channels
par: Lee, Yen-Chi
Publié: (2026)

Second-Order Identification Capacity of AWGN Channels
par: Liu, Zhicheng, et autres
Publié: (2024)

Non-signaling Assisted Capacity of a Classical Channel with Causal CSIT
par: Yao, Yuhang, et autres
Publié: (2026)

Consensus Capacity of Noisy Broadcast Channels
par: Sangwan, Neha, et autres
Publié: (2022)

Network Oblivious Transfer via Noisy Channels: Limits and Capacities
par: Aghaee, Hadi, et autres
Publié: (2025)

Noisy Sorting Capacity
par: Wang, Ziao, et autres
Publié: (2022)

Quantum Entanglement Assistance Improves the Capacity and Activates the Zero-Error Capacity of Classical Channels with Causal CSIT
par: Yao, Yuhang, et autres
Publié: (2026)

Capacity Bounds on Doppler OFDM Channels
par: Orellana, Pablo, et autres
Publié: (2026)

On the Capacity of Vector Linear Computation over a Noiseless Quantum Multiple Access Channel with Entangled Transmitters
par: Yao, Yuhang, et autres
Publié: (2024)

Universal Coding for Shannon Ciphers under Side-Channel Attacks
par: Oohama, Yasutada, et autres
Publié: (2023)

Quantum Wiretap Channel Coding Assisted by Noisy Correlation
par: Cai, Minglai, et autres
Publié: (2024)

Returning to Shannon's Original Meaning
par: Yang, Xuezhi
Publié: (2019)

On Codes for the Noisy Substring Channel
par: Yehezkeally, Yonatan, et autres
Publié: (2021)

A Generalized Nyquist-Shannon Sampling Theorem Using the Koopman Operator
par: Zeng, Zhexuan, et autres
Publié: (2023)

Identification Over Noisy Permutation Channels
par: Sarkar, Abhishek, et autres
Publié: (2024)

New Channel Coding Lower Bounds for Noisy Permutation Channels
par: Feng, Lugaoze, et autres
Publié: (2024)

Constrained Coding for Composite DNA: Channel Capacity and Efficient Constructions
par: Nguyen, Tuan Thanh, et autres
Publié: (2025)

Capacity-Region-Achieving Sparse Regression Codes for MIMO Multiple-Access Channels
par: Yan, Hao, et autres
Publié: (2026)

Secrecy Capacity Analysis and Beamforming Optimization for MIMO-VLC Wiretap Channels
par: Yang, Sufang, et autres
Publié: (2026)

Asymptotic Capacity of 1-Bit MIMO Fading Channels
par: Yang, Sheng, et autres
Publié: (2024)

Binomial Channel: On the Capacity-Achieving Distribution and Bounds on the Capacity
par: Zieder, Ian, et autres
Publié: (2024)

Electromagnetic Channel Modeling and Capacity Analysis for HMIMO Communications
par: Wei, Li, et autres
Publié: (2025)

Coding Schemes for the Noisy Torn Paper Channel
par: Walter, Frederik, et autres
Publié: (2026)

New Upper Bounds for Noisy Permutation Channels
par: Feng, Lugaoze, et autres
Publié: (2024)

On Achievable Rates Over Noisy Nanopore Channels
par: Rameshwar, V. Arvind, et autres
Publié: (2025)

On the Capacity of Sequences of Coloring Channels
par: Yu, Wenjun, et autres
Publié: (2026)

The Capacity of the Weighted Read Channel
par: Yerushalmi, Omer, et autres
Publié: (2024)

The Capacity of 3 User Linear Computation Broadcast
par: Yao, Yuhang, et autres
Publié: (2022)

Influence of Behavioral Models on Multiuser Channel Capacity
par: Agrell, Erik, et autres
Publié: (2015)

Capacity Characterization of Pinching-Antenna Systems
par: Ouyang, Chongjun, et autres
Publié: (2025)

Sum Capacity Characterization of Pinching Antennas-assisted Multiple Access Channels
par: Chen, Guangji, et autres
Publié: (2025)

Outer Channel of DNA-Based Data Storage: Capacity and Efficient Coding Schemes
par: He, Xuan, et autres
Publié: (2023)

Network Oblivious Transfer via Noisy Broadcast Channels
par: Aghaee, Hadi, et autres
Publié: (2025)

On the Generic Capacity of $K$-User Symmetric Linear Computation Broadcast
par: Yao, Yuhang, et autres
Publié: (2022)