Copertina

An Information-Theoretic Framework for Out-of-Distribution Generalization with Applications to Stochastic Gradient Langevin Dynamics

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Liu, Wenliang, Yu, Guanding, Wang, Lele, Liao, Renjie
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Information Theory Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

A PAC-Bayesian Analysis of Channel-Induced Degradation in Edge Inference
di: He, Yangshuo, et al.
Pubblicazione: (2026)

Improved Information Theoretic Generalization Bounds for Distributed and Federated Learning
di: Barnes, L. P., et al.
Pubblicazione: (2022)

Robustness in Wireless Distributed Learning: An Information-Theoretic Analysis
di: He, Yangshuo, et al.
Pubblicazione: (2024)

InfoDPCCA: Information-Theoretic Dynamic Probabilistic Canonical Correlation Analysis
di: Tang, Shiqin, et al.
Pubblicazione: (2025)

Characterizing Dependence of Samples along the Langevin Dynamics and Algorithms via Contraction of $Φ$-Mutual Information
di: Liang, Jiaming, et al.
Pubblicazione: (2024)

Information-Theoretic Framework for Understanding Modern Machine-Learning
di: Feder, Meir, et al.
Pubblicazione: (2025)

Directed Information $γ$-covering: An Information-Theoretic Framework for Context Engineering
di: Huang, Hai
Pubblicazione: (2025)

Theoretically Grounded Framework for LLM Watermarking: A Distribution-Adaptive Approach
di: He, Haiyun, et al.
Pubblicazione: (2024)

On the Generalization for Transfer Learning: An Information-Theoretic Analysis
di: Wu, Xuetong, et al.
Pubblicazione: (2022)

On the Generalization of Knowledge Distillation: An Information-Theoretic View
di: Li, Bingying, et al.
Pubblicazione: (2026)

An Effective Information Theoretic Framework for Channel Pruning
di: Chen, Yihao, et al.
Pubblicazione: (2024)

A Theoretical Framework for Statistical Evaluability of Generative Models
di: Aiyer, Shashaank, et al.
Pubblicazione: (2026)

Information-Theoretic Generalization Bounds for Deep Neural Networks
di: He, Haiyun, et al.
Pubblicazione: (2024)

Tighter Information-Theoretic Generalization Bounds via a Novel Class of Change of Measure Inequalities
di: Liu, Yanxiao, et al.
Pubblicazione: (2026)

Information-Theoretic Generative Clustering of Documents
di: Du, Xin, et al.
Pubblicazione: (2024)

Out-of-Distribution Detection using Maximum Entropy Coding
di: Abolfazli, Mojtaba, et al.
Pubblicazione: (2024)

Information-Theoretic Measures on Lattices for High-Order Interactions
di: Liu, Zhaolu, et al.
Pubblicazione: (2024)

Information-Theoretic Discrete Diffusion
di: Jeon, Moongyu, et al.
Pubblicazione: (2025)

Two Facets of SDE Under an Information-Theoretic Lens: Generalization of SGD via Training Trajectories and via Terminal States
di: Wang, Ziqiao, et al.
Pubblicazione: (2022)

Conditional Diffusion Under Linear Constraints: Langevin Mixing and Information-Theoretic Guarantees
di: Aghapour, Ahmad, et al.
Pubblicazione: (2026)

On the Hardness of Unsupervised Domain Adaptation: Optimal Learners and Information-Theoretic Perspective
di: Dong, Zhiyi, et al.
Pubblicazione: (2025)

Generalization in Federated Learning: A Conditional Mutual Information Framework
di: Wang, Ziqiao, et al.
Pubblicazione: (2025)

An Information Theoretic Perspective on Conformal Prediction
di: Correia, Alvaro H. C., et al.
Pubblicazione: (2024)

An Information-Theoretic Analysis of Temporal GNNs
di: Farzaneh, Amirmohammad
Pubblicazione: (2024)

An Information-Theoretic Analysis of In-Context Learning
di: Jeon, Hong Jun, et al.
Pubblicazione: (2024)

Information-Theoretic Proofs for Diffusion Sampling
di: Reeves, Galen, et al.
Pubblicazione: (2025)

Information Theoretic Perspective on Representation Learning
di: Pereg, Deborah, et al.
Pubblicazione: (2026)

Distributional Information Embedding: A Framework for Multi-bit Watermarking
di: He, Haiyun, et al.
Pubblicazione: (2025)

A General Error-Theoretical Analysis Framework for Constructing Compression Strategies
di: Zhang, Boyang, et al.
Pubblicazione: (2025)

Leave-One-Out Analysis for Nonconvex Robust Matrix Completion with General Thresholding Functions
di: Wang, Tianming, et al.
Pubblicazione: (2024)

VBO-MI: A Fully Gradient-Based Bayesian Optimization Framework Using Variational Mutual Information Estimation
di: Mirkarimi, Farhad
Pubblicazione: (2026)

Dual-Mind World Models: A General Framework for Learning in Dynamic Wireless Networks
di: Wang, Lingyi, et al.
Pubblicazione: (2025)

Information Theoretic Learning for Diffusion Models with Warm Start
di: Shen, Yirong, et al.
Pubblicazione: (2025)

Unifying Information-Theoretic and Pair-Counting Clustering Similarity
di: Gates, Alexander J.
Pubblicazione: (2025)

Generalized Exponentiated Gradient Algorithms and Their Application to On-Line Portfolio Selection
di: Cichocki, Andrzej, et al.
Pubblicazione: (2024)

Context Channel Capacity: An Information-Theoretic Framework for Understanding Catastrophic Forgetting
di: Cheng, Ran
Pubblicazione: (2026)

A General Framework for Interpretable Neural Learning based on Local Information-Theoretic Goal Functions
di: Makkeh, Abdullah, et al.
Pubblicazione: (2023)

Neural Networks Learn Generic Multi-Index Models Near Information-Theoretic Limit
di: Zhang, Bohan, et al.
Pubblicazione: (2025)

Information Theoretic Guarantees For Policy Alignment In Large Language Models
di: Mroueh, Youssef
Pubblicazione: (2024)

Information-Theoretic Thresholds for the Alignments of Partially Correlated Graphs
di: Huang, Dong, et al.
Pubblicazione: (2024)