Imagen de Portada

Information Theoretic Guarantees For Policy Alignment In Large Language Models

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autor principal:	Mroueh, Youssef
Formato:	Preprint
Publicado:	2024
Materias:	Machine Learning Information Theory
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Information-Theoretic Thresholds for the Alignments of Partially Correlated Graphs
por: Huang, Dong, et al.
Publicado: (2024)

Theoretical Guarantees for Low-Rank Compression of Deep Neural Networks
por: Zhang, Shihao, et al.
Publicado: (2025)

Theoretical Limits of Language Model Alignment
por: Paes, Lucas Monteiro, et al.
Publicado: (2026)

Information-Theoretic Guarantees for Recovering Low-Rank Tensors from Symmetric Rank-One Measurements
por: Kızıldağ, Eren C.
Publicado: (2025)

Asymptotics of Language Model Alignment
por: Yang, Joy Qiping, et al.
Publicado: (2024)

Reinforcement Learning with Verifiable Rewards: GRPO's Effective Loss, Dynamics, and Success Amplification
por: Mroueh, Youssef
Publicado: (2025)

Information Theoretic Learning for Diffusion Models with Warm Start
por: Shen, Yirong, et al.
Publicado: (2025)

Information-Theoretic Policy Pre-Training with Empowerment
por: Schneider, Moritz, et al.
Publicado: (2025)

Information-Theoretic Discrete Diffusion
por: Jeon, Moongyu, et al.
Publicado: (2025)

An Information Theoretic Perspective on Conformal Prediction
por: Correia, Alvaro H. C., et al.
Publicado: (2024)

An Information-Theoretic Analysis of Temporal GNNs
por: Farzaneh, Amirmohammad
Publicado: (2024)

An Information-Theoretic Analysis of In-Context Learning
por: Jeon, Hong Jun, et al.
Publicado: (2024)

Information-Theoretic Proofs for Diffusion Sampling
por: Reeves, Galen, et al.
Publicado: (2025)

Information Theoretic Perspective on Representation Learning
por: Pereg, Deborah, et al.
Publicado: (2026)

On the Generalization for Transfer Learning: An Information-Theoretic Analysis
por: Wu, Xuetong, et al.
Publicado: (2022)

On the Generalization of Knowledge Distillation: An Information-Theoretic View
por: Li, Bingying, et al.
Publicado: (2026)

On Causality in Domain Adaptation and Semi-Supervised Learning: an Information-Theoretic Analysis for Parametric Models
por: Wu, Xuetong, et al.
Publicado: (2022)

Directed Information $γ$-covering: An Information-Theoretic Framework for Context Engineering
por: Huang, Hai
Publicado: (2025)

ItDPDM: Information-Theoretic Discrete Poisson Diffusion Model
por: Bhattacharya, Sagnik, et al.
Publicado: (2025)

Efficient Sampling with Discrete Diffusion Models: Sharp and Adaptive Guarantees
por: Dmitriev, Daniil, et al.
Publicado: (2026)

Multivariate Stochastic Dominance via Optimal Transport and Applications to Models Benchmarking
por: Rioux, Gabriel, et al.
Publicado: (2024)

Information-Theoretic Measures on Lattices for High-Order Interactions
por: Liu, Zhaolu, et al.
Publicado: (2024)

Information-Theoretic Generalization Bounds for Deep Neural Networks
por: He, Haiyun, et al.
Publicado: (2024)

Information-Theoretic Framework for Understanding Modern Machine-Learning
por: Feder, Meir, et al.
Publicado: (2025)

Unifying Information-Theoretic and Pair-Counting Clustering Similarity
por: Gates, Alexander J.
Publicado: (2025)

Theoretical Guarantees of Data Augmented Last Layer Retraining Methods
por: Welfert, Monica, et al.
Publicado: (2024)

Risk Aware Benchmarking of Large Language Models
por: Nitsure, Apoorva, et al.
Publicado: (2023)

Improved Information Theoretic Generalization Bounds for Distributed and Federated Learning
por: Barnes, L. P., et al.
Publicado: (2022)

Forecastability as an Information-Theoretic Limit on Prediction
por: Catt, Peter Maurice
Publicado: (2026)

Conditional Diffusion Under Linear Constraints: Langevin Mixing and Information-Theoretic Guarantees
por: Aghapour, Ahmad, et al.
Publicado: (2026)

Information-Theoretic Progress Measures reveal Grokking is an Emergent Phase Transition
por: Clauw, Kenzo, et al.
Publicado: (2024)

Analyzing Multimodal Integration in the Variational Autoencoder from an Information-Theoretic Perspective
por: Langer, Carlotta, et al.
Publicado: (2024)

Theoretical Analysis of Submodular Information Measures for Targeted Data Subset Selection
por: Beck, Nathan, et al.
Publicado: (2024)

Information-Theoretic Minimax Regret Bounds for Reinforcement Learning based on Duality
por: Bongole, Raghav, et al.
Publicado: (2024)

InfoDPCCA: Information-Theoretic Dynamic Probabilistic Canonical Correlation Analysis
por: Tang, Shiqin, et al.
Publicado: (2025)

On the Hardness of Unsupervised Domain Adaptation: Optimal Learners and Information-Theoretic Perspective
por: Dong, Zhiyi, et al.
Publicado: (2025)

The Price of Sparsity: Sufficient Conditions for Sparse Recovery using Sparse and Sparsified Measurements
por: Chaabouni, Youssef, et al.
Publicado: (2025)

Price of Quality: Sufficient Conditions for Sparse Recovery using Mixed-Quality Data
por: Chaabouni, Youssef, et al.
Publicado: (2026)

Information-Theoretic Generative Clustering of Documents
por: Du, Xin, et al.
Publicado: (2024)

A Theoretical Framework for Statistical Evaluability of Generative Models
por: Aiyer, Shashaank, et al.
Publicado: (2026)