Copertina

Direct Preference Optimization of Video Large Multimodal Models from Language Model Reward

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Zhang, Ruohong, Gui, Liangke, Sun, Zhiqing, Feng, Yihao, Xu, Keyang, Zhang, Yuanhan, Fu, Di, Li, Chunyuan, Hauptmann, Alexander, Bisk, Yonatan, Yang, Yiming
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Computer Vision and Pattern Recognition Artificial Intelligence
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

LLaVA-NeXT-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal Models
di: Li, Feng, et al.
Pubblicazione: (2024)

Learning Model Successors
di: Chang, Yingshan, et al.
Pubblicazione: (2025)

Language Models Need Inductive Biases to Count Inductively
di: Chang, Yingshan, et al.
Pubblicazione: (2024)

Uncertainty-Aware Exploratory Direct Preference Optimization for Multimodal Large Language Models
di: Zhang, Huatian, et al.
Pubblicazione: (2026)

Energy Considerations of Large Language Model Inference and Efficiency Optimizations
di: Fernandez, Jared, et al.
Pubblicazione: (2025)

Gradient Localization Improves Lifelong Pretraining of Language Models
di: Fernandez, Jared, et al.
Pubblicazione: (2024)

VistaDPO: Video Hierarchical Spatial-Temporal Direct Preference Optimization for Large Video Models
di: Huang, Haojian, et al.
Pubblicazione: (2025)

LMMs-Eval: Reality Check on the Evaluation of Large Multimodal Models
di: Zhang, Kaichen, et al.
Pubblicazione: (2024)

Self-Play Preference Optimization for Language Model Alignment
di: Wu, Yue, et al.
Pubblicazione: (2024)

Debiasing Multimodal Large Language Models via Noise-Aware Preference Optimization
di: Zhang, Zefeng, et al.
Pubblicazione: (2025)

On the Limited Generalization Capability of the Implicit Reward Model Induced by Direct Preference Optimization
di: Lin, Yong, et al.
Pubblicazione: (2024)

Affordance RAG: Hierarchical Multimodal Retrieval with Affordance-Aware Embodied Memory for Mobile Manipulation
di: Korekata, Ryosuke, et al.
Pubblicazione: (2025)

Mitigating Hallucination in Multimodal Large Language Model via Hallucination-targeted Direct Preference Optimization
di: Fu, Yuhan, et al.
Pubblicazione: (2024)

Improve Vision Language Model Chain-of-thought Reasoning
di: Zhang, Ruohong, et al.
Pubblicazione: (2024)

LLaVA-Video: Video Instruction Tuning With Synthetic Data
di: Zhang, Yuanhan, et al.
Pubblicazione: (2024)

Direct Preference Optimization: Your Language Model is Secretly a Reward Model
di: Rafailov, Rafael, et al.
Pubblicazione: (2023)

SymDPO: Boosting In-Context Learning of Large Multimodal Models with Symbol Demonstration Direct Preference Optimization
di: Jia, Hongrui, et al.
Pubblicazione: (2024)

Strengthening Multimodal Large Language Model with Bootstrapped Preference Optimization
di: Pi, Renjie, et al.
Pubblicazione: (2024)

ANAVI: Audio Noise Awareness using Visuals of Indoor environments for NAVIgation
di: Jain, Vidhi, et al.
Pubblicazione: (2024)

VideoAuteur: Towards Long Narrative Video Generation
di: Xiao, Junfei, et al.
Pubblicazione: (2025)

SALMON: Self-Alignment with Instructable Reward Models
di: Sun, Zhiqing, et al.
Pubblicazione: (2023)

VideoRewardBench: Comprehensive Evaluation of Multimodal Reward Models for Video Understanding
di: Zhang, Zhihong, et al.
Pubblicazione: (2025)

Graphic Design with Large Multimodal Model
di: Cheng, Yutao, et al.
Pubblicazione: (2024)

Diffusion Model as a Noise-Aware Latent Reward Model for Step-Level Preference Optimization
di: Zhang, Tao, et al.
Pubblicazione: (2025)

Beyond Raw Videos: Understanding Edited Videos with Large Multimodal Model
di: Xu, Lu, et al.
Pubblicazione: (2024)

Generation-driven Contrastive Self-training for Zero-shot Text Classification with Instruction-following LLM
di: Zhang, Ruohong, et al.
Pubblicazione: (2023)

How to Train Your Fact Verifier: Knowledge Transfer with Multimodal Open Models
di: Lee, Jaeyoung, et al.
Pubblicazione: (2024)

REM: Evaluating LLM Embodied Spatial Reasoning through Multi-Frame Trajectories
di: Thompson, Jacob, et al.
Pubblicazione: (2025)

Multimodal Large Language Models with Adaptive Preference Optimization for Sequential Recommendation
di: Wang, Yu, et al.
Pubblicazione: (2025)

Diffusion-SDPO: Safeguarded Direct Preference Optimization for Diffusion Models
di: Fu, Minghao, et al.
Pubblicazione: (2025)

DegustaBot: Zero-Shot Visual Preference Estimation for Personalized Multi-Object Rearrangement
di: Newman, Benjamin A., et al.
Pubblicazione: (2024)

$ϕ$-DPO: Fairness Direct Preference Optimization Approach to Continual Learning in Large Multimodal Models
di: Truong, Thanh-Dat, et al.
Pubblicazione: (2026)

mDPO: Conditional Preference Optimization for Multimodal Large Language Models
di: Wang, Fei, et al.
Pubblicazione: (2024)

InfiFPO: Implicit Model Fusion via Preference Optimization in Large Language Models
di: Gu, Yanggan, et al.
Pubblicazione: (2025)

Fine-Tuning Large Language Models for Stock Return Prediction Using Newsflow
di: Guo, Tian, et al.
Pubblicazione: (2024)

SPL-LNS: Sampling-Enhanced Large Neighborhood Search for Solving Integer Linear Programs
di: Feng, Shengyu, et al.
Pubblicazione: (2025)

Skews in the Phenomenon Space Hinder Generalization in Text-to-Image Generation
di: Chang, Yingshan, et al.
Pubblicazione: (2024)

TPMM-DPO: Trajectory-aware Preference-guided Model Merging for Iterative Direct Preference Optimization
di: Fu, Lingling, et al.
Pubblicazione: (2026)

Mind the Generative Details: Direct Localized Detail Preference Optimization for Video Diffusion Models
di: Huang, Zitong, et al.
Pubblicazione: (2026)

BaseReward: A Strong Baseline for Multimodal Reward Model
di: Zhang, Yi-Fan, et al.
Pubblicazione: (2025)