Imagen de Portada

Stepwise Alignment for Constrained Language Model Policy Optimization

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Wachi, Akifumi, Tran, Thien Q., Sato, Rei, Tanabe, Takumi, Akimoto, Youhei
Formato:	Preprint
Publicado:	2024
Materias:	Machine Learning Artificial Intelligence Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Vulnerability Mitigation for Safety-Aligned Language Models via Debiasing
por: Tran, Thien Q., et al.
Publicado: (2025)

A Provable Approach for End-to-End Safe Reinforcement Learning
por: Wachi, Akifumi, et al.
Publicado: (2025)

Sample-Efficient Hypergradient Estimation for Decentralized Bi-Level Reinforcement Learning
por: Kudo, Mikoto, et al.
Publicado: (2026)

Cost-Minimized Label-Flipping Poisoning Attack to LLM Alignment
por: Kusaka, Shigeki, et al.
Publicado: (2025)

A Relative-Budget Theory for Reinforcement Learning with Verifiable Rewards in Large Language Model Reasoning
por: Wachi, Akifumi, et al.
Publicado: (2026)

Target Return Optimizer for Multi-Game Decision Transformer
por: Tatematsu, Kensuke, et al.
Publicado: (2025)

Stepwise Guided Policy Optimization: Coloring your Incorrect Reasoning in GRPO
por: Chen, Peter, et al.
Publicado: (2025)

Gradient-Adaptive Policy Optimization: Towards Multi-Objective Alignment of Large Language Models
por: Li, Chengao, et al.
Publicado: (2025)

Stepwise Self-Consistent Mathematical Reasoning with Large Language Models
por: Zhao, Zilong, et al.
Publicado: (2024)

A Survey of Constraint Formulations in Safe Reinforcement Learning
por: Wachi, Akifumi, et al.
Publicado: (2024)

Stepwise Verification and Remediation of Student Reasoning Errors with Large Language Model Tutors
por: Daheim, Nico, et al.
Publicado: (2024)

Binary Classifier Optimization for Large Language Model Alignment
por: Jung, Seungjae, et al.
Publicado: (2024)

Accelerated Preference Optimization for Large Language Model Alignment
por: He, Jiafan, et al.
Publicado: (2024)

Self-Play Preference Optimization for Language Model Alignment
por: Wu, Yue, et al.
Publicado: (2024)

Stepwise Perplexity-Guided Refinement for Efficient Chain-of-Thought Reasoning in Large Language Models
por: Cui, Yingqian, et al.
Publicado: (2025)

One STEP at a time: Language Agents are Stepwise Planners
por: Nguyen, Minh, et al.
Publicado: (2024)

AlignDistil: Token-Level Language Model Alignment as Adaptive Policy Distillation
por: Zhang, Songming, et al.
Publicado: (2025)

How Alignment Routes: Localizing, Scaling, and Controlling Policy Circuits in Language Models
por: Frank, Gregory N.
Publicado: (2026)

Personalized Group Relative Policy Optimization for Heterogenous Preference Alignment
por: Wang, Jialu, et al.
Publicado: (2026)

Long-term Safe Reinforcement Learning with Binary Feedback
por: Wachi, Akifumi, et al.
Publicado: (2024)

Group Preference Optimization: Few-Shot Alignment of Large Language Models
por: Zhao, Siyan, et al.
Publicado: (2023)

Statistically Significant Concept-based Explanation of Image Classifiers via Model Knockoffs
por: Xu, Kaiwen, et al.
Publicado: (2023)

Towards Robust Alignment of Language Models: Distributionally Robustifying Direct Preference Optimization
por: Wu, Junkang, et al.
Publicado: (2024)

TLPO: Token-Level Policy Optimization for Mitigating Language Confusion in Large Language Models
por: Choo, Jinho, et al.
Publicado: (2026)

Alignment-Constrained Dynamic Pruning for LLMs: Identifying and Preserving Alignment-Critical Circuits
por: Patel, Dev, et al.
Publicado: (2025)

Scaling Data-Constrained Language Models
por: Muennighoff, Niklas, et al.
Publicado: (2023)

Frictive Policy Optimization for LLMs: Epistemic Intervention, Risk-Sensitive Control, and Reflective Alignment
por: Pustejovsky, James, et al.
Publicado: (2026)

LifeAlign: Lifelong Alignment for Large Language Models with Memory-Augmented Focalized Preference Optimization
por: Li, Junsong, et al.
Publicado: (2025)

On the Robustness of Reward Models for Language Model Alignment
por: Hong, Jiwoo, et al.
Publicado: (2025)

HAPO: Training Language Models to Reason Concisely via History-Aware Policy Optimization
por: Huang, Chengyu, et al.
Publicado: (2025)

Boundary-Guided Policy Optimization for Memory-efficient RL of Diffusion Large Language Models
por: Lin, Nianyi, et al.
Publicado: (2025)

Stepwise Penalization for Length-Efficient Chain-of-Thought Reasoning
por: Li, Xintong, et al.
Publicado: (2026)

StateAct: Enhancing LLM Base Agents via Self-prompting and State-tracking
por: Rozanov, Nikolai, et al.
Publicado: (2024)

Evolutionary Contrastive Distillation for Language Model Alignment
por: Katz-Samuels, Julian, et al.
Publicado: (2024)

Pareto Multi-Objective Alignment for Language Models
por: He, Qiang, et al.
Publicado: (2025)

Leveraging Group Relative Policy Optimization to Advance Large Language Models in Traditional Chinese Medicine
por: Xie, Jiacheng, et al.
Publicado: (2025)

Segment Policy Optimization: Effective Segment-Level Credit Assignment in RL for Large Language Models
por: Guo, Yiran, et al.
Publicado: (2025)

Rethinking the Role of Proxy Rewards in Language Model Alignment
por: Kim, Sungdong, et al.
Publicado: (2024)

Value Augmented Sampling for Language Model Alignment and Personalization
por: Han, Seungwook, et al.
Publicado: (2024)

Spectral Editing of Activations for Large Language Model Alignment
por: Qiu, Yifu, et al.
Publicado: (2024)