Imagen de Portada

Thinking Preference Optimization

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Yang, Wang, Jin, Hongye, Yang, Jingfeng, Chaudhary, Vipin, Han, Xiaotian
Formato:	Preprint
Publicado:	2025
Materias:	Machine Learning Artificial Intelligence
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Longer Context, Deeper Thinking: Uncovering the Role of Long-Context Ability in Reasoning
por: Yang, Wang, et al.
Publicado: (2025)

Demystifying Hybrid Thinking: Can LLMs Truly Switch Between Think and No-Think?
por: Wang, Shouren, et al.
Publicado: (2025)

100-LongBench: Are de facto Long-Context Benchmarks Literally Evaluating Long-Context Ability?
por: Yang, Wang, et al.
Publicado: (2025)

Mid-Think: Training-Free Intermediate-Budget Reasoning via Token-Level Triggers
por: Yang, Wang, et al.
Publicado: (2026)

Speculative Thinking: Enhancing Small-Model Reasoning with Large Model Guidance at Inference Time
por: Yang, Wang, et al.
Publicado: (2025)

LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning
por: Jin, Hongye, et al.
Publicado: (2024)

Path-Lock Expert: Separating Reasoning Mode in Hybrid Thinking via Architecture-Level Separation
por: Wang, Shouren, et al.
Publicado: (2026)

When Domains Interact: Asymmetric and Order-Sensitive Cross-Domain Effects in Reinforcement Learning for Reasoning
por: Yang, Wang, et al.
Publicado: (2026)

SIPO: Stabilized and Improved Preference Optimization for Aligning Diffusion Models
por: Yang, Xiaomeng, et al.
Publicado: (2025)

Adversarial Preference Learning for Robust LLM Alignment
por: Wang, Yuanfu, et al.
Publicado: (2025)

AdapThink: Adaptive Thinking Preferences for Reasoning Language Model
por: Wan, Xu, et al.
Publicado: (2025)

$β$-DPO: Direct Preference Optimization with Dynamic $β$
por: Wu, Junkang, et al.
Publicado: (2024)

Causal Information Prioritization for Efficient Reinforcement Learning
por: Cao, Hongye, et al.
Publicado: (2025)

Beyond One-Preference-Fits-All Alignment: Multi-Objective Direct Preference Optimization
por: Zhou, Zhanhui, et al.
Publicado: (2023)

ADPO: Anchored Direct Preference Optimization
por: Zixian, Wang
Publicado: (2025)

APO: Alpha-Divergence Preference Optimization
por: Zixian, Wang
Publicado: (2025)

Risk-aware Direct Preference Optimization under Nested Risk Measure
por: Zhang, Lijun, et al.
Publicado: (2025)

Taylor Unswift: Secured Weight Release for Large Language Models via Taylor Expansion
por: Wang, Guanchu, et al.
Publicado: (2024)

Aligning CodeLLMs with Direct Preference Optimization
por: Miao, Yibo, et al.
Publicado: (2024)

Stable Preference Optimization: A Bilevel Approach to Catastrophic Preference Shift
por: Jian, Chengtao, et al.
Publicado: (2025)

Don't Pass@k: A Bayesian Framework for Large Language Model Evaluation
por: Hariri, Mohsen, et al.
Publicado: (2025)

Adversarial Generative Flow Network for Solving Vehicle Routing Problems
por: Zhang, Ni, et al.
Publicado: (2025)

Towards Disentangled Preference Optimization Dynamics: Suppress the Loser, Preserve the Winner
por: Chen, Wei, et al.
Publicado: (2026)

Interpretable Hybrid-Rule Temporal Point Processes
por: Cao, Yunyang, et al.
Publicado: (2025)

Scaffold-Conditioned Preference Triplets for Controllable Molecular Optimization with Large Language Models
por: Xiong, Yi, et al.
Publicado: (2026)

Value-Incentivized Preference Optimization: A Unified Approach to Online and Offline RLHF
por: Cen, Shicong, et al.
Publicado: (2024)

Adaptive Friction in Deep Learning: Enhancing Optimizers with Sigmoid and Tanh Function
por: Zheng, Hongye, et al.
Publicado: (2024)

Model-Based Offline Reinforcement Learning with Adversarial Data Augmentation
por: Cao, Hongye, et al.
Publicado: (2025)

Preference as Reward, Maximum Preference Optimization with Importance Sampling
por: Jiang, Zaifan, et al.
Publicado: (2023)

CuDIP: Enhancing Theorem Proving in LLMs via Curriculum Learning-based Direct Preference Optimization
por: Shi, Shuming, et al.
Publicado: (2025)

KL Penalty Control via Perturbation for Direct Preference Optimization
por: Lee, Sangkyu, et al.
Publicado: (2025)

VAGPO: Vision-augmented Asymmetric Group Preference Optimization for Graph Routing Problems
por: Liu, Shiyan, et al.
Publicado: (2025)

HAT-CL: A Hard-Attention-to-the-Task PyTorch Library for Continual Learning
por: Duan, Xiaotian
Publicado: (2023)

On the Role of Preference Variance in Preference Optimization
por: Guo, Jiacheng, et al.
Publicado: (2025)

POLO: Preference-Guided Multi-Turn Reinforcement Learning for Lead Optimization
por: Wang, Ziqing, et al.
Publicado: (2025)

Orthogonal Finetuning for Direct Preference Optimization
por: Yang, Chenxu, et al.
Publicado: (2024)

C2-DPO: Constrained Controlled Direct Preference Optimization
por: Asadi, Kavosh, et al.
Publicado: (2025)

Iterative Refinement Neural Operators are Learned Fixed-Point Solvers: A Principled Approach to Spectral Bias Mitigation
por: Liu, Xiaotian, et al.
Publicado: (2026)

Towards Empowerment Gain through Causal Structure Learning in Model-Based RL
por: Cao, Hongye, et al.
Publicado: (2025)

Labels or Preferences? Budget-Constrained Learning with Human Judgments over AI-Generated Outputs
por: Dong, Zihan, et al.
Publicado: (2026)