Cover Image

Information Theoretic Lower Bounds for Information Theoretic Upper Bounds

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Livni, Roi
Format:	Preprint
Published:	2023
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

All ERMs Can Fail in Stochastic Convex Optimization Lower Bounds in Linear Dimension
by: Burla, Tal, et al.
Published: (2026)

The Sample Complexity of Gradient Descent in Stochastic Convex Optimization
by: Livni, Roi
Published: (2024)

Information-Theoretic Generalization Bounds for Sequential Decision Making
by: Futami, Futoshi, et al.
Published: (2026)

Information-Theoretic Generalization Bounds for Transductive Learning and its Applications
by: Tang, Huayi, et al.
Published: (2023)

Information-Theoretic Generalization Bounds of Replay-based Continual Learning
by: Wen, Wen, et al.
Published: (2025)

Leveraging Flatness to Improve Information-Theoretic Generalization Bounds for SGD
by: Peng, Ze, et al.
Published: (2026)

Information-Theoretic Generalization Bounds for Deep Neural Networks
by: He, Haiyun, et al.
Published: (2024)

Information-Theoretic Causal Bounds under Unmeasured Confounding
by: Jung, Yonghan, et al.
Published: (2026)

Improved Information Theoretic Generalization Bounds for Distributed and Federated Learning
by: Barnes, L. P., et al.
Published: (2022)

Error Bounds of Supervised Classification from Information-Theoretic Perspective
by: Qi, Binchuan
Published: (2024)

Information-Theoretic Generalization Bounds for Stochastic Gradient Descent with Predictable Virtual Noise
by: Partohaghighi, Mohammad
Published: (2026)

Information-Theoretic Minimax Regret Bounds for Reinforcement Learning based on Duality
by: Bongole, Raghav, et al.
Published: (2024)

Low Resource Reconstruction Attacks Through Benign Prompts
by: Yarkoni, Sol, et al.
Published: (2025)

Information Complexity of Stochastic Convex Optimization: Applications to Generalization and Memorization
by: Attias, Idan, et al.
Published: (2024)

Reliable Abstention under Adversarial Injections: Tight Lower Bounds and New Upper Bounds
by: Edelman, Ezra, et al.
Published: (2026)

Rapid Overfitting of Multi-Pass Stochastic Gradient Descent in Stochastic Convex Optimization
by: Vansover-Hager, Shira, et al.
Published: (2025)

Approximation Error Upper and Lower Bounds for Hölder Class with Transformers
by: He, Xin, et al.
Published: (2026)

The Agent Capability Problem: Predicting Solvability Through Information-Theoretic Bounds
by: Lutati, Shahar
Published: (2025)

The Paradox of Outcome Optimization: A Causal Information-Theoretic Bound on Reasoning Shortcuts in LLMs
by: Chen, Zihan, et al.
Published: (2026)

Simplify to Amplify: Achieving Information-Theoretic Bounds with Fewer Steps in Spectral Community Detection
by: Dharmawan, Sie Hendrata, et al.
Published: (2026)

Risk Estimation in a Markov Cost Process: Lower and Upper Bounds
by: Thoppe, Gugan, et al.
Published: (2023)

Capability and Robustness Cannot Both Be Free: An Information-Theoretic Bound for Vision-Language-Action Models
by: Tai, Jianwei
Published: (2026)

Tighter Information-Theoretic Generalization Bounds via a Novel Class of Change of Measure Inequalities
by: Liu, Yanxiao, et al.
Published: (2026)

Bits Leaked per Query: Information-Theoretic Bounds on Adversarial Attacks against LLMs
by: Kaneko, Masahiro, et al.
Published: (2025)

The Reasoning Trap: An Information-Theoretic Bound on Closed-System Multi-Step LLM Reasoning
by: Shin, Kwan Soo
Published: (2026)

Credit Attribution and Stable Compression
by: Livni, Roi, et al.
Published: (2024)

Upper and Lower Bounds for Distributionally Robust Off-Dynamics Reinforcement Learning
by: Liu, Zhishuai, et al.
Published: (2024)

Can Copyright be Reduced to Privacy?
by: Elkin-Koren, Niva, et al.
Published: (2023)

The Scaling Law for LoRA Base on Mutual Information Upper Bound
by: Zhang, Jing, et al.
Published: (2025)

On Stopping Times of Power-one Sequential Tests: Tight Lower and Upper Bounds
by: Agrawal, Shubhada, et al.
Published: (2025)

Theoretical Compression Bounds for Wide Multilayer Perceptrons
by: Cheairi, Houssam El, et al.
Published: (2025)

Information-Theoretic Perspectives on Optimizers
by: Tan, Zhiquan, et al.
Published: (2025)

Theoretical Bound-Guided Hierarchical VAE for Neural Image Codecs
by: Zhang, Yichi, et al.
Published: (2024)

Bounding Hallucinations: Information-Theoretic Guarantees for RAG Systems via Merlin-Arthur Protocols
by: Deiseroth, Björn, et al.
Published: (2025)

Theoretical Analysis of Meta Reinforcement Learning: Generalization Bounds and Convergence Guarantees
by: Wang, Cangqing, et al.
Published: (2024)

Information-Theoretic Bounds and Task-Centric Learning Complexity for Real-World Dynamic Nonlinear Systems
by: Bulusu, Sri Satish Krishna Chaitanya, et al.
Published: (2025)

Autoregressive Learning in Joint KL: Sharp Oracle Bounds and Lower Bounds
by: Xu, Yunbei, et al.
Published: (2026)

Margin in Abstract Spaces
by: Ashlagi, Yair, et al.
Published: (2026)

An Information-Theoretic Approach to Generalization Theory
by: Rodríguez-Gálvez, Borja, et al.
Published: (2024)

Information-Theoretic Active Correlation Clustering
by: Aronsson, Linus, et al.
Published: (2024)