Cover Image

Thermodynamic Limits of Physical Intelligence

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Takahashi, Koichi, Hayashi, Yusuke
Format:	Preprint
Published:	2026
Subjects:	Machine Learning Artificial Intelligence Information Theory
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Lost and Found in Translation: Variational Diagnostics for Neural Codebook Channels
by: Hayashi, Yusuke
Published: (2026)

Universal AI maximizes Variational Empowerment
by: Hayashi, Yusuke, et al.
Published: (2025)

Integrated Sensing-Communication-Computation for Edge Artificial Intelligence
by: Wen, Dingzhu, et al.
Published: (2023)

On the Limits of Self-Improving in Large Language Models: The Singularity Is Not Near Without Symbolic Model Synthesis
by: Zenil, Hector
Published: (2026)

Beyond the Loss Curve: Scaling Laws, Active Learning, and the Limits of Learning from Exact Posteriors
by: Khorasani, Arian, et al.
Published: (2026)

Neural Networks Learn Generic Multi-Index Models Near Information-Theoretic Limit
by: Zhang, Bohan, et al.
Published: (2025)

Compression Represents Intelligence Linearly
by: Huang, Yuzhen, et al.
Published: (2024)

Capabilities and Fundamental Limits of Latent Chain-of-Thought
by: Zou, Jiaxuan, et al.
Published: (2026)

Know Your Limits: Entropy Estimation Modeling for Compression and Generalization
by: Badger, Benjamin L., et al.
Published: (2025)

The Blind Normalized Stein Variational Gradient Descent-Based Detection for Intelligent Random Access in Cellular IoT
by: Zhu, Xin, et al.
Published: (2024)

Deep Randomized Distributed Function Computation (DeepRDFC): Neural Distributed Channel Simulation
by: Bergström, Didrik, et al.
Published: (2026)

Contextual Control without Memory Growth in a Context-Switching Task
by: Kim, Song-Ju
Published: (2026)

Why Self-Supervised Encoders Want to Be Normal
by: Domb, Yuval
Published: (2026)

The Causal Description Gap: Information-Theoretic Separations Across Pearl's Hierarchy
by: Emadi, Seyed Morteza
Published: (2026)

A Rational Account of Categorization Based on Information Theory
by: MacLellan, Christopher J., et al.
Published: (2026)

On the Non-decoupling of Supervised Fine-tuning and Reinforcement Learning in Post-training
by: Niu, Xueyan, et al.
Published: (2026)

The Value of Covariance Matching in Gaussian DDPMs and the Lanczos Sampler
by: Akhtar, Md Sahil, et al.
Published: (2026)

Polynomial Context-Truncation Sensitivity in Autoregressive Language Models: Sequential Wyner-Ziv Bounds for KV Cache Compression
by: Kim, Munsik
Published: (2026)

Curvature-Weighted Capacity Allocation: A Minimum Description Length Framework for Layer-Adaptive Large Language Model Optimization
by: Amaefuna, Theophilus, et al.
Published: (2026)

MARS: Margin and Semantic-Aware Data Augmentation for Reward Modeling
by: Bhattacharjee, Payel, et al.
Published: (2026)

Innovation: An Almost Characterization of Hallucination
by: Das, Nishant P., et al.
Published: (2026)

High-Rate Quantized Matrix Multiplication II
by: Ordentlich, Or, et al.
Published: (2026)

Entropy-informed Decoding: Adaptive Information-Driven Branching
by: Evans, Benjamin Patrick, et al.
Published: (2026)

Score Based Error Correcting Code Decoder
by: Helvits, Alon, et al.
Published: (2026)

LLMs as Noisy Channels: A Shannon Perspective on Model Capacity and Scaling Laws
by: Ouyang, Xu, et al.
Published: (2026)

Neural Estimation of Pairwise Mutual Information in Masked Discrete Sequence Models
by: Sharma, Jai, et al.
Published: (2026)

FibQuant: Universal Vector Quantization for Random-Access KV-Cache Compression
by: Lee, Namyoon, et al.
Published: (2026)

Context Channel Capacity: An Information-Theoretic Framework for Understanding Catastrophic Forgetting
by: Cheng, Ran
Published: (2026)

Informationally Compressive Anonymization: Non-Degrading Sensitive Input Protection for Privacy-Preserving Supervised Machine Learning
by: Samuelson, Jeremy J
Published: (2026)

An Information-Theoretic Criterion for Efficient Data Synthesis
by: Li, Hanyu, et al.
Published: (2026)

PrismQuant: Rate-Distortion-Optimal Vector Quantization for Gaussian-Mixture Sources
by: Park, Bumsu, et al.
Published: (2026)

Estimating Mutual Information between Time Series and Temporal Event Sequences Across Diverse Analysis Tasks
by: Hu, Haoji, et al.
Published: (2026)

Confidence-Based Decoding is Provably Efficient for Diffusion Language Models
by: Cai, Changxiao, et al.
Published: (2026)

Order-Optimal Sample Complexity of Rectified Flows
by: Sahoo, Hari Krishna, et al.
Published: (2026)

The Critical Horizon: Inspection Design Principles for Multi-Stage Operations and Deep Reasoning
by: Emadi, Seyed Morteza
Published: (2026)

Persistent Entropy as a Detector of Phase Transitions
by: Rucco, Matteo
Published: (2026)

On the Fragility of AI-Based Channel Decoders under Small Channel Perturbations
by: Lei, Haoyu, et al.
Published: (2026)

Semantic Rate Distortion and Posterior Design: Compute Constraints, Multimodality, and Strategic Inference
by: Akyol, Emrah
Published: (2026)

ArcMark: Distortion-Free Multi-Byte LLM Watermark via Optimal Transport
by: Gilani, Atefeh, et al.
Published: (2026)

On the Benefits of Free Exploration for Regret Minimization in Multi-Armed Bandits
by: Hou, Yunlong, et al.
Published: (2026)