Imagen de Portada

SLIME: Stabilized Likelihood Implicit Margin Enforcement for Preference Optimization

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Afanasyev, Maksim, Iov, Illarion
Formato:	Preprint
Publicado:	2026
Materias:	Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Selective Adversarial Attacks on LLM Benchmarks
por: Dubrovsky, Ivan, et al.
Publicado: (2025)

Offline Preference Optimization via Maximum Marginal Likelihood Estimation
por: Najafi, Saeed, et al.
Publicado: (2025)

Explicit Preference Optimization: No Need for an Implicit Reward Model
por: Hu, Xiangkun, et al.
Publicado: (2025)

Joint Model and Data Sparsification via the Marginal Likelihood
por: Timans, Alexander, et al.
Publicado: (2026)

Marginal Pseudo-Likelihood Learning of Markov Network structures
por: Pensar, Johan, et al.
Publicado: (2014)

Unintentional Unalignment: Likelihood Displacement in Direct Preference Optimization
por: Razin, Noam, et al.
Publicado: (2024)

Warm Start Marginal Likelihood Optimisation for Iterative Gaussian Processes
por: Lin, Jihao Andreas, et al.
Publicado: (2024)

Momentum SVGD-EM for Accelerated Maximum Marginal Likelihood Estimation
por: Rozzio, Adam, et al.
Publicado: (2026)

$ξ$-DPO: Direct Preference Optimization via Ratio Reward Margin
por: Fan, Zhengyuan, et al.
Publicado: (2026)

Interacting Particle Langevin Algorithm for Maximum Marginal Likelihood Estimation
por: Akyildiz, Ö. Deniz, et al.
Publicado: (2023)

Preference Elicitation for Multi-objective Combinatorial Optimization with Active Learning and Maximum Likelihood Estimation
por: Defresne, Marianne, et al.
Publicado: (2025)

AlphaDPO: Adaptive Reward Margin for Direct Preference Optimization
por: Wu, Junkang, et al.
Publicado: (2024)

Dual-Agent Co-Training for Health Coaching via Implicit Adversarial Preference Optimization
por: Long, Da, et al.
Publicado: (2026)

Margin Adaptive DPO: Leveraging Reward Model for Granular Control in Preference Optimization
por: Rho, Hyung Gyu
Publicado: (2025)

Least Squares and Marginal Log-Likelihood Model Predictive Control using Normalizing Flows
por: Cramer, Eike
Publicado: (2024)

Shaving Weights with Occam's Razor: Bayesian Sparsification for Neural Networks Using the Marginal Likelihood
por: Dhahri, Rayen, et al.
Publicado: (2024)

AVERE: Improving Audiovisual Emotion Reasoning with Preference Optimization
por: Chaubey, Ashutosh, et al.
Publicado: (2026)

Gradient-Gated DPO: Stabilizing Preference Optimization in Language Models
por: Mouiche, Inoussa
Publicado: (2026)

Flavors of Margin: Implicit Bias of Steepest Descent in Homogeneous Neural Networks
por: Tsilivis, Nikolaos, et al.
Publicado: (2024)

On the Limited Generalization Capability of the Implicit Reward Model Induced by Direct Preference Optimization
por: Lin, Yong, et al.
Publicado: (2024)

Adaptive Margin RLHF via Preference over Preferences
por: Chittepu, Yaswanth, et al.
Publicado: (2025)

Set-based Implicit Likelihood Inference of Galaxy Cluster Mass
por: Wang, Bonny Y., et al.
Publicado: (2025)

Implicit Statistical Inference in Transformers: Approximating Likelihood-Ratio Tests In-Context
por: Chaudhry, Faris, et al.
Publicado: (2026)

InfiFPO: Implicit Model Fusion via Preference Optimization in Large Language Models
por: Gu, Yanggan, et al.
Publicado: (2025)

Lookahead Path Likelihood Optimization for Diffusion LLMs
por: Liu, Xuejie, et al.
Publicado: (2026)

FastWave: Optimized Diffusion Model for Audio Super-Resolution
por: Kuznetsov, Nikita, et al.
Publicado: (2026)

Exploratory Preference Optimization: Harnessing Implicit Q*-Approximation for Sample-Efficient RLHF
por: Xie, Tengyang, et al.
Publicado: (2024)

SIPO: Stabilized and Improved Preference Optimization for Aligning Diffusion Models
por: Yang, Xiaomeng, et al.
Publicado: (2025)

TEMPO: Temporal Enforcement via Mode-Separated Policy Optimization for Trustworthy LLM Backtesting
por: Zhang, Zeyu, et al.
Publicado: (2026)

Implicit Maximum Likelihood Estimation for Real-time Generative Model Predictive Control
por: Lee, Grayson, et al.
Publicado: (2026)

MALIBO: Meta-learning for Likelihood-free Bayesian Optimization
por: Pan, Jiarong, et al.
Publicado: (2023)

SPO: Multi-Dimensional Preference Sequential Alignment With Implicit Reward Modeling
por: Lou, Xingzhou, et al.
Publicado: (2024)

RoseRAG: Robust Retrieval-augmented Generation with Small-scale LLMs via Margin-aware Preference Optimization
por: Liu, Tianci, et al.
Publicado: (2025)

AMIR-GRPO: Inducing Implicit Preference Signals into GRPO
por: Yari, Amir Hossein, et al.
Publicado: (2026)

Direct Preference Optimization With Unobserved Preference Heterogeneity: The Necessity of Ternary Preferences
por: Chidambaram, Keertana, et al.
Publicado: (2024)

Larger or Smaller Reward Margins to Select Preferences for Alignment?
por: Huang, Kexin, et al.
Publicado: (2025)

Hadamard-Riemannian Optimization for Margin-Variance Ensemble
por: Jin, Zexu
Publicado: (2025)

DR-SNE: Density-Regularized Stochastic Neighbor Embedding
por: Kazanskii, Maksim
Publicado: (2026)

Preference Optimization for Combinatorial Optimization Problems
por: Pan, Mingjun, et al.
Publicado: (2025)

Soft Sequence Policy Optimization
por: Glazyrina, Svetlana, et al.
Publicado: (2026)