:: Library Catalog

Cover Image

Saved in:

Bibliographic Details
Main Authors:	Bansal, Rachit, Pruthi, Danish, Belinkov, Yonatan
Format:	Preprint
Published:	2022
Subjects:	Machine Learning Information Theory
Online Access:	https://arxiv.org/abs/2210.09404
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Trade-offs in Data Memorization via Strong Data Processing Inequalities
by: Feldman, Vitaly, et al.
Published: (2025)

Separable Computation of Information Measures
by: Xu, Xiangxiang, et al.
Published: (2025)

Memorization-Compression Cycles Improve Generalization
by: Yu, Fangyuan
Published: (2025)

Causal Entropy and Information Gain for Measuring Causal Control
by: Simoes, Francisco Nunes Ferreira Quialheiro, et al.
Published: (2023)

Information-Theoretic Measures on Lattices for High-Order Interactions
by: Liu, Zhaolu, et al.
Published: (2024)

Revisiting the Robustness of Watermarking to Paraphrasing Attacks
by: Rastogi, Saksham, et al.
Published: (2024)

Bounds on the Excess Minimum Risk via Generalized Information Divergence Measures
by: Omanwar, Ananya, et al.
Published: (2025)

Information-Theoretic Progress Measures reveal Grokking is an Emergent Phase Transition
by: Clauw, Kenzo, et al.
Published: (2024)

Understanding Encoder-Decoder Structures in Machine Learning Using Information Measures
by: Silva, Jorge F., et al.
Published: (2024)

Theoretical Analysis of Submodular Information Measures for Targeted Data Subset Selection
by: Beck, Nathan, et al.
Published: (2024)

Let's Measure Information Step-by-Step: AI-Based Evaluation Beyond Vibes
by: Robertson, Zachary, et al.
Published: (2025)

Tighter Information-Theoretic Generalization Bounds via a Novel Class of Change of Measure Inequalities
by: Liu, Yanxiao, et al.
Published: (2026)

How Patterns Dictate Learnability in Sequential Data
by: Morawski, Mario, et al.
Published: (2025)

Dictionary Based Pattern Entropy for Causal Direction Discovery
by: B, Harikrishnan N, et al.
Published: (2026)

Information-Theoretic Guarantees for Recovering Low-Rank Tensors from Symmetric Rank-One Measurements
by: Kızıldağ, Eren C.
Published: (2025)

Leveraging Prototypical Representations for Mitigating Social Bias without Demographic Information
by: Iskander, Shadi, et al.
Published: (2024)

Latency Optimization in LEO Satellite Communications with Hybrid Beam Pattern and Interference Control
by: Zhang, Qianqian, et al.
Published: (2024)

Measuring the Intrinsic Dimension of Earth Representations
by: Rao, Arjun, et al.
Published: (2025)

Measuring the Predictability of Recommender Systems using Structural Complexity Metrics
by: Abeliuk, Andrés, et al.
Published: (2024)

Probing the Information Theoretical Roots of Spatial Dependence Measures
by: Wang, Zhangyu, et al.
Published: (2024)

Learning Capacity: A Measure of the Effective Dimensionality of a Model
by: Chen, Daiwei, et al.
Published: (2023)

Digital Twin-Assisted Measurement Design and Channel Statistics Prediction
by: Williams, Robin J., et al.
Published: (2026)

Between the Layers Lies the Truth: Uncertainty Estimation in LLMs Using Intra-Layer Local Information Scores
by: Badash, Zvi N., et al.
Published: (2026)

Exact Recovery of Sparse Binary Vectors from Generalized Linear Measurements
by: Mazumdar, Arya, et al.
Published: (2025)

Rate-Distortion-Perception Tradeoff Based on the Conditional-Distribution Perception Measure
by: Salehkalaibar, Sadaf, et al.
Published: (2024)

A Survey of Deep Learning Architectures for Intelligent Reflecting Surfaces
by: Elbir, Ahmet M., et al.
Published: (2020)

Accelerating the Global Aggregation of Local Explanations
by: Mor, Alon, et al.
Published: (2023)

The Price of Sparsity: Sufficient Conditions for Sparse Recovery using Sparse and Sparsified Measurements
by: Chaabouni, Youssef, et al.
Published: (2025)

STAMP Your Content: Proving Dataset Membership via Watermarked Rephrasings
by: Rastogi, Saksham, et al.
Published: (2025)

Generating Rectifiable Measures through Neural Networks
by: Riegler, Erwin, et al.
Published: (2024)

Variations on the Expectation due to Changes in the Probability Measure
by: Perlaza, Samir M., et al.
Published: (2025)

Directed Information $γ$-covering: An Information-Theoretic Framework for Context Engineering
by: Huang, Hai
Published: (2025)

Measuring Uncertainty in Transformer Circuits with Effective Information Consistency
by: Krasnovsky, Anatoly A.
Published: (2025)

Which Similarity-Sensitive Entropy (Sentropy)?
by: Nguyen, Phuc, et al.
Published: (2025)

Information-Theoretic Discrete Diffusion
by: Jeon, Moongyu, et al.
Published: (2025)

Mutual Information Multinomial Estimation
by: Chen, Yanzhi, et al.
Published: (2024)

Interpretive Efficiency: Information-Geometric Foundations of Data Usefulness
by: Katende, Ronald
Published: (2025)

Information-Theoretic Proofs for Diffusion Sampling
by: Reeves, Galen, et al.
Published: (2025)

Information Theoretic Perspective on Representation Learning
by: Pereg, Deborah, et al.
Published: (2026)

An Information Theoretic Perspective on Conformal Prediction
by: Correia, Alvaro H. C., et al.
Published: (2024)