Image de couverture de livre

Design Considerations in Offline Preference-based RL

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Agarwal, Alekh, Dann, Christoph, Marinov, Teodor V.
Format:	Preprint
Publié:	2025
Sujets:	Machine Learning Artificial Intelligence
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Mitigating Preference Hacking in Policy Optimization with Pessimism
par: Gupta, Dhawal, et autres
Publié: (2025)

Offline Imitation Learning from Multiple Baselines with Applications to Compiler Optimization
par: Marinov, Teodor V., et autres
Publié: (2024)

Non-Linear Reinforcement Learning in Large Action Spaces: Structural Conditions and Sample-efficiency of Posterior Sampling
par: Agarwal, Alekh, et autres
Publié: (2022)

Hindsight Preference Learning for Offline Preference-based Reinforcement Learning
par: Gao, Chen-Xiao, et autres
Publié: (2024)

Budgeting Counterfactual for Offline RL
par: Liu, Yao, et autres
Publié: (2023)

Dual Alignment Maximin Optimization for Offline Model-based RL
par: Zhou, Chi, et autres
Publié: (2025)

Preserving Expert-Level Privacy in Offline Reinforcement Learning
par: Sharma, Navodita, et autres
Publié: (2024)

Data-Driven Online Model Selection With Regret Guarantees
par: Pacchiano, Aldo, et autres
Publié: (2023)

Selective Uncertainty Propagation in Offline RL
par: Krishnamurthy, Sanath Kumar, et autres
Publié: (2023)

Decoupled Prioritized Resampling for Offline RL
par: Yue, Yang, et autres
Publié: (2023)

Augmenting Offline RL with Unlabeled Data
par: Wang, Zhao, et autres
Publié: (2024)

An Empirical Study on the Effectiveness of Incorporating Offline RL As Online RL Subroutines
par: Su, Jianhai, et autres
Publié: (2025)

Policy Agnostic RL: Offline RL and Online RL Fine-Tuning of Any Class and Backbone
par: Mark, Max Sobol, et autres
Publié: (2024)

Adversarial Policy Optimization for Offline Preference-based Reinforcement Learning
par: Kang, Hyungkyu, et autres
Publié: (2025)

Listwise Reward Estimation for Offline Preference-based Reinforcement Learning
par: Choi, Heewoong, et autres
Publié: (2024)

A Tractable Inference Perspective of Offline RL
par: Liu, Xuejie, et autres
Publié: (2023)

Are Expressive Models Truly Necessary for Offline RL?
par: Wang, Guan, et autres
Publié: (2024)

OGBench: Benchmarking Offline Goal-Conditioned RL
par: Park, Seohong, et autres
Publié: (2024)

OMG-RL:Offline Model-based Guided Reward Learning for Heparin Treatment
par: Lim, Yooseok, et autres
Publié: (2024)

Preference Elicitation for Offline Reinforcement Learning
par: Pace, Alizée, et autres
Publié: (2024)

LEASE: Offline Preference-based Reinforcement Learning with High Sample Efficiency
par: Liu, Xiao-Yin, et autres
Publié: (2024)

OPRIDE: Offline Preference-based Reinforcement Learning via In-Dataset Exploration
par: Yang, Yiqin, et autres
Publié: (2026)

In-Dataset Trajectory Return Regularization for Offline Preference-based Reinforcement Learning
par: Tu, Songjun, et autres
Publié: (2024)

Yes, Q-learning Helps Offline In-Context RL
par: Tarasov, Denis, et autres
Publié: (2025)

Scalable Offline Model-Based RL with Action Chunks
par: Park, Kwanyoung, et autres
Publié: (2025)

Offline Multi-task Transfer RL with Representational Penalization
par: Bose, Avinandan, et autres
Publié: (2024)

Is Value Learning Really the Main Bottleneck in Offline RL?
par: Park, Seohong, et autres
Publié: (2024)

The Role of Deep Learning Regularizations on Actors in Offline RL
par: Tarasov, Denis, et autres
Publié: (2024)

Offline vs. Online Learning in Model-based RL: Lessons for Data Collection Strategies
par: Chen, Jiaqi, et autres
Publié: (2025)

Can RLHF be More Efficient with Imperfect Reward Models? A Policy Coverage Perspective
par: Huang, Jiawei, et autres
Publié: (2025)

Behavior Preference Regression for Offline Reinforcement Learning
par: Srinivasan, Padmanaba, et autres
Publié: (2025)

Latent Adversarial Regularization for Offline Preference Optimization
par: Jiang, Enyi, et autres
Publié: (2026)

AD4RL: Autonomous Driving Benchmarks for Offline Reinforcement Learning with Value-based Dataset
par: Lee, Dongsu, et autres
Publié: (2024)

Offline RLAIF: Piloting VLM Feedback for RL via SFO
par: Beck, Jacob
Publié: (2025)

Integrating Domain Knowledge for handling Limited Data in Offline RL
par: Gangopadhyay, Briti, et autres
Publié: (2024)

PROF: An LLM-based Reward Code Preference Optimization Framework for Offline Imitation Learning
par: Sun, Shengjie, et autres
Publié: (2025)

RL-ACRGNet: Reinforcement Learning-Based Chest Radiology Report Generation Network
par: Meena, Yogesh Kumar, et autres
Publié: (2026)

Preference-Guided Diffusion for Multi-Objective Offline Optimization
par: Annadani, Yashas, et autres
Publié: (2025)

Exploring and Addressing Reward Confusion in Offline Preference Learning
par: Chen, Xin, et autres
Publié: (2024)

Language-Conditioned Offline RL for Multi-Robot Navigation
par: Morad, Steven, et autres
Publié: (2024)