Cover Image

Tail-Aware Information-Theoretic Generalization for RLHF and SGLD

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zhang, Huiming, Li, Binghan, Tian, Wan, Sun, Qiang
Format:	Preprint
Published:	2026
Subjects:	Machine Learning Artificial Intelligence Probability Statistics Theory
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

A Score-Based Density Formula, with Applications in Diffusion Generative Models
by: Li, Gen, et al.
Published: (2024)

Scaling Limits of Long-Context Transformers
by: Bruno, Giuseppe, et al.
Published: (2026)

Variational Tail Bounds for Norms of Random Vectors and Matrices
by: Bahmani, Sohail
Published: (2025)

On the Exponential Convergence for Offline RLHF with Pairwise Comparisons
by: Chen, Zhirui, et al.
Published: (2024)

Diffusion Models with Heavy-Tailed Targets: Score Estimation and Sampling Guarantees
by: Yu, Yifeng, et al.
Published: (2026)

Sharp Concentration Inequalities: Phase Transition and Mixing of Orlicz Tails with Variance
by: Shen, Yinan, et al.
Published: (2026)

A Method For Bounding Tail Probabilities
by: Zlatanov, Nikola
Published: (2024)

Huber-energy measure quantization
by: Turinici, Gabriel
Published: (2022)

Neural Networks Learn Generic Multi-Index Models Near Information-Theoretic Limit
by: Zhang, Bohan, et al.
Published: (2025)

Information-Theoretic Guarantees for Recovering Low-Rank Tensors from Symmetric Rank-One Measurements
by: Kızıldağ, Eren C.
Published: (2025)

Information-Theoretic Limits and Strong Consistency on Binary Non-uniform Hypergraph Stochastic Block Models
by: Wang, Hai-Xiao
Published: (2023)

Can Generative Artificial Intelligence Survive Data Contamination? Theoretical Guarantees under Contaminated Recursive Training
by: Wang, Kevin, et al.
Published: (2026)

Tail-Sensitive KL and Rényi Convergence of Unadjusted Hamiltonian Monte Carlo via One-Shot Couplings
by: Bou-Rabee, Nawaf, et al.
Published: (2026)

Joint stochastic localization and applications
by: Alberts, Tom, et al.
Published: (2025)

From Spikes to Heavy Tails: Unveiling the Spectral Evolution of Neural Networks
by: Kothapalli, Vignesh, et al.
Published: (2024)

L$^2$M: Mutual Information Scaling Law for Long-Context Language Modeling
by: Chen, Zhuo, et al.
Published: (2025)

Bayesian Inference with Deep Weakly Nonlinear Networks
by: Hanin, Boris, et al.
Published: (2024)

DeepOHeat-v1: Efficient Operator Learning for Fast and Trustworthy Thermal Simulation and Optimization in 3D-IC Design
by: Yu, Xinling, et al.
Published: (2025)

Selective Reviews of Bandit Problems in AI via a Statistical View
by: Zhou, Pengjie, et al.
Published: (2024)

PRL-Bench: A Comprehensive Benchmark Evaluating LLMs' Capabilities in Frontier Physics Research
by: Miao, Tingjia, et al.
Published: (2026)

Probabilistic Inference and Learning with Stein's Method
by: Liu, Qiang, et al.
Published: (2026)

Revenue Maximization Under Sequential Price Competition Via The Estimation Of s-Concave Demand Functions
by: Bracale, Daniele, et al.
Published: (2025)

Dimension-Free Bounds for Generalized First-Order Methods via Gaussian Coupling
by: Reeves, Galen
Published: (2025)

Spectral Estimators for Structured Generalized Linear Models via Approximate Message Passing
by: Zhang, Yihan, et al.
Published: (2023)

A Computational Transition for Detecting Multivariate Shuffled Linear Regression by Low-Degree Polynomials
by: Li, Zhangsong
Published: (2025)

Optimal Estimation in Orthogonally Invariant Generalized Linear Models: Spectral Initialization and Approximate Message Passing
by: Zhang, Yihan, et al.
Published: (2026)

A Theory of the Mechanics of Information: Generalization Through Measurement of Uncertainty (Learning is Measuring)
by: Hazard, Christopher J., et al.
Published: (2025)

kTULA: A Langevin sampling algorithm with improved KL bounds under super-linear log-gradients
by: Lytras, Iosif, et al.
Published: (2025)

Pointwise Generalization in Deep Neural Networks
by: Li, Shaojie, et al.
Published: (2026)

Variational Optimality of Föllmer Processes in Generative Diffusions
by: Chen, Yifan, et al.
Published: (2026)

Generating Rectifiable Measures through Neural Networks
by: Riegler, Erwin, et al.
Published: (2024)

Statistical limits of correlation detection in trees
by: Ganassali, Luca, et al.
Published: (2022)

Dimension-free error estimate for diffusion model and optimal scheduling
by: de Bortoli, Valentin, et al.
Published: (2025)

Superposition unifies power-law training dynamics
by: Chen, Zixin Jessie, et al.
Published: (2026)

When Attention Collapses: Residual Evidence Modeling for Compositional Inference
by: Houba, Niklas
Published: (2026)

The most likely common cause
by: Hovhannisyan, A., et al.
Published: (2023)

Optimal Symmetries in Binary Classification
by: Ngairangbam, Vishal S., et al.
Published: (2024)

Physics of Skill Learning
by: Liu, Ziming, et al.
Published: (2025)

Nonnegative matrix factorization and the principle of the common cause
by: Khalafyan, E., et al.
Published: (2025)

Uncertainty Quantification with Bayesian Higher Order ReLU KANs
by: Giroux, James, et al.
Published: (2024)