Cover Image

Averaging log-likelihoods in direct alignment

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Grinsztajn, Nathan, Flet-Berliac, Yannis, Azar, Mohammad Gheshlaghi, Strub, Florian, Wu, Bill, Choi, Eugene, Cremer, Chris, Ahmadian, Arash, Chandak, Yash, Pietquin, Olivier, Geist, Matthieu
Format:	Preprint
Published:	2024
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Contrastive Policy Gradient: Aligning LLMs on sequence-level scores in a supervised-friendly fashion
by: Flet-Berliac, Yannis, et al.
Published: (2024)

Self-Improving Robust Preference Optimization
by: Choi, Eugene, et al.
Published: (2024)

ShiQ: Bringing back Bellman to LLMs
by: Clavier, Pierre, et al.
Published: (2025)

OPERA: Automatic Offline Policy Evaluation with Re-weighted Aggregates of Multiple Estimators
by: Nie, Allen, et al.
Published: (2024)

Back to Basics: Revisiting REINFORCE Style Optimization for Learning from Human Feedback in LLMs
by: Ahmadian, Arash, et al.
Published: (2024)

Bench-MFG: A Benchmark Suite for Learning in Stationary Mean Field Games
by: Magnino, Lorenzo, et al.
Published: (2026)

Population-aware Online Mirror Descent for Mean-Field Games with Common Noise by Deep Reinforcement Learning
by: Wu, Zida, et al.
Published: (2025)

Population-aware Online Mirror Descent for Mean-Field Games by Deep Reinforcement Learning
by: Wu, Zida, et al.
Published: (2024)

A Survey of Temporal Credit Assignment in Deep Reinforcement Learning
by: Pignatelli, Eduardo, et al.
Published: (2023)

Audio-to-Image Bird Species Retrieval without Audio-Image Pairs via Text Distillation
by: Moummad, Ilyass, et al.
Published: (2026)

Learning in Mean Field Games: A Survey
by: Laurière, Mathieu, et al.
Published: (2022)

Countering Reward Over-optimization in LLM with Demonstration-Guided Reinforcement Learning
by: Rita, Mathieu, et al.
Published: (2024)

Language Evolution with Deep Learning
by: Rita, Mathieu, et al.
Published: (2024)

NatureLM-audio: an Audio-Language Foundation Model for Bioacoustics
by: Robinson, David, et al.
Published: (2024)

Compact Hypercube Embeddings for Fast Text-based Wildlife Observation Retrieval
by: Moummad, Ilyass, et al.
Published: (2026)

Beyond the Baseband: Adaptive Multi-Band Encoding for Full-Spectrum Bioacoustics Classification
by: Sarkar, Eklavya, et al.
Published: (2026)

Short-Long Policy Evaluation with Novel Actions
by: Nam, Hyunji Alex, et al.
Published: (2024)

MWA tied-array processing V: Super-resolved localisation via amplitude-only maximum likelihood direction finding
by: Meyers, Bradley W., et al.
Published: (2026)

Are you using test log-likelihood correctly?
by: Deshpande, Sameer K., et al.
Published: (2022)

Risk-seeking conservative policy iteration with agent-state based policies for Dec-POMDPs with guaranteed convergence
by: Sinha, Amit, et al.
Published: (2026)

Solving robust MDPs as a sequence of static RL problems
by: Zouitine, Adil, et al.
Published: (2024)

Convergence of regularized agent-state-based Q-learning in POMDPs
by: Sinha, Amit, et al.
Published: (2025)

Periodic agent-state based Q-learning for POMDPs
by: Sinha, Amit, et al.
Published: (2024)

Comment Parameter Estimation of Base-Age Invariant Site Index Models: Which Data Structure to Use?---A Discussion
by: Cieszewski, Chris J. - Strub, Mike
Published: (2007)

Composite likelihood inference for the Poisson log-normal model
by: Stoehr, Julien, et al.
Published: (2024)

MusicRL: Aligning Music Generation to Human Preferences
by: Cideron, Geoffrey, et al.
Published: (2024)

Average dip directions from intervals of dipmeter log in drill hole CRP-2A
by: Jarrard, Richard D, et al.
Published: (2000)

BAGEL: Benchmarking Animal Knowledge Expertise in Language Models
by: Shen, Jiacheng, et al.
Published: (2026)

Nash Learning from Human Feedback
by: Munos, Rémi, et al.
Published: (2023)

Towards Minimax Optimality of Model-based Robust Reinforcement Learning
by: Clavier, Pierre, et al.
Published: (2023)

Non-Expansive Mappings in Two-Time-Scale Stochastic Approximation: Finite-Time Analysis
by: Chandak, Siddharth
Published: (2025)

$O(1/k)$ Finite-Time Bound for Non-Linear Two-Time-Scale Stochastic Approximation
by: Chandak, Siddharth
Published: (2025)

Optimal and computationally tractable lower bounds for logistic log-likelihoods
by: Anceschi, Niccolò, et al.
Published: (2024)

Editorial: Physio-logging in marine animals: recent advances and future directions.
by: Aoki, Kagari, et al.
Published: (2025)

A/B testing under Interference with Partial Network Information
by: Shankar, Shiv, et al.
Published: (2024)

Radiochemie: von Np zu Np
by: Erik Strub
Published: (2024)

Closing the Gap between TD Learning and Supervised Learning -- A Generalisation Point of View
by: Ghugare, Raj, et al.
Published: (2024)

Cluster expansion of the log-likelihood ratio: Optimal detection of planted matchings
by: Wee, Timothy L. H., et al.
Published: (2025)

Finite-sample performance of the maximum likelihood estimator in logistic regression
by: Chardon, Hugo, et al.
Published: (2024)

Gravity-aligned Rotation Averaging with Circular Regression
by: Pan, Linfei, et al.
Published: (2024)