Imagen de Portada

Measures of Information Reflect Memorization Patterns

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Bansal, Rachit, Pruthi, Danish, Belinkov, Yonatan
Formato:	Preprint
Publicado:	2022
Materias:	Machine Learning Information Theory
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Trade-offs in Data Memorization via Strong Data Processing Inequalities
por: Feldman, Vitaly, et al.
Publicado: (2025)

Separable Computation of Information Measures
por: Xu, Xiangxiang, et al.
Publicado: (2025)

Causal Entropy and Information Gain for Measuring Causal Control
por: Simoes, Francisco Nunes Ferreira Quialheiro, et al.
Publicado: (2023)

Information-Theoretic Measures on Lattices for High-Order Interactions
por: Liu, Zhaolu, et al.
Publicado: (2024)

Bounds on the Excess Minimum Risk via Generalized Information Divergence Measures
por: Omanwar, Ananya, et al.
Publicado: (2025)

Information-Theoretic Progress Measures reveal Grokking is an Emergent Phase Transition
por: Clauw, Kenzo, et al.
Publicado: (2024)

Understanding Encoder-Decoder Structures in Machine Learning Using Information Measures
por: Silva, Jorge F., et al.
Publicado: (2024)

Theoretical Analysis of Submodular Information Measures for Targeted Data Subset Selection
por: Beck, Nathan, et al.
Publicado: (2024)

Memorization-Compression Cycles Improve Generalization
por: Yu, Fangyuan
Publicado: (2025)

Let's Measure Information Step-by-Step: AI-Based Evaluation Beyond Vibes
por: Robertson, Zachary, et al.
Publicado: (2025)

Tighter Information-Theoretic Generalization Bounds via a Novel Class of Change of Measure Inequalities
por: Liu, Yanxiao, et al.
Publicado: (2026)

How Patterns Dictate Learnability in Sequential Data
por: Morawski, Mario, et al.
Publicado: (2025)

Dictionary Based Pattern Entropy for Causal Direction Discovery
por: B, Harikrishnan N, et al.
Publicado: (2026)

Revisiting the Robustness of Watermarking to Paraphrasing Attacks
por: Rastogi, Saksham, et al.
Publicado: (2024)

Latency Optimization in LEO Satellite Communications with Hybrid Beam Pattern and Interference Control
por: Zhang, Qianqian, et al.
Publicado: (2024)

Measuring the Intrinsic Dimension of Earth Representations
por: Rao, Arjun, et al.
Publicado: (2025)

Information-Theoretic Guarantees for Recovering Low-Rank Tensors from Symmetric Rank-One Measurements
por: Kızıldağ, Eren C.
Publicado: (2025)

Measuring the Predictability of Recommender Systems using Structural Complexity Metrics
por: Abeliuk, Andrés, et al.
Publicado: (2024)

Learning Capacity: A Measure of the Effective Dimensionality of a Model
por: Chen, Daiwei, et al.
Publicado: (2023)

Digital Twin-Assisted Measurement Design and Channel Statistics Prediction
por: Williams, Robin J., et al.
Publicado: (2026)

Exact Recovery of Sparse Binary Vectors from Generalized Linear Measurements
por: Mazumdar, Arya, et al.
Publicado: (2025)

Rate-Distortion-Perception Tradeoff Based on the Conditional-Distribution Perception Measure
por: Salehkalaibar, Sadaf, et al.
Publicado: (2024)

Probing the Information Theoretical Roots of Spatial Dependence Measures
por: Wang, Zhangyu, et al.
Publicado: (2024)

Directed Information $γ$-covering: An Information-Theoretic Framework for Context Engineering
por: Huang, Hai
Publicado: (2025)

The Price of Sparsity: Sufficient Conditions for Sparse Recovery using Sparse and Sparsified Measurements
por: Chaabouni, Youssef, et al.
Publicado: (2025)

A Survey of Deep Learning Architectures for Intelligent Reflecting Surfaces
por: Elbir, Ahmet M., et al.
Publicado: (2020)

Information-Theoretic Discrete Diffusion
por: Jeon, Moongyu, et al.
Publicado: (2025)

Mutual Information Multinomial Estimation
por: Chen, Yanzhi, et al.
Publicado: (2024)

Information-Theoretic Proofs for Diffusion Sampling
por: Reeves, Galen, et al.
Publicado: (2025)

Information Theoretic Perspective on Representation Learning
por: Pereg, Deborah, et al.
Publicado: (2026)

An Information Theoretic Perspective on Conformal Prediction
por: Correia, Alvaro H. C., et al.
Publicado: (2024)

An Information-Theoretic Analysis of Temporal GNNs
por: Farzaneh, Amirmohammad
Publicado: (2024)

An Information-Theoretic Analysis of In-Context Learning
por: Jeon, Hong Jun, et al.
Publicado: (2024)

Structure Learning via Mutual Information
por: Nixon, Jeremy
Publicado: (2024)

Projection Head is Secretly an Information Bottleneck
por: Ouyang, Zhuo, et al.
Publicado: (2025)

Leveraging Prototypical Representations for Mitigating Social Bias without Demographic Information
por: Iskander, Shadi, et al.
Publicado: (2024)

On the Generalization for Transfer Learning: An Information-Theoretic Analysis
por: Wu, Xuetong, et al.
Publicado: (2022)

Generating Rectifiable Measures through Neural Networks
por: Riegler, Erwin, et al.
Publicado: (2024)

Variations on the Expectation due to Changes in the Probability Measure
por: Perlaza, Samir M., et al.
Publicado: (2025)

Generalization Bounds via Conditional $f$-Information
por: Wang, Ziqiao, et al.
Publicado: (2024)