VLM Q-Learning: Aligning Vision-Language Models for Interactive Decision-Making
Fuente:
arXiv
Guardado en:
| Autores principales: | Grigsby, Jake, Zhu, Yuke, Ryoo, Michael, Niebles, Juan Carlos |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
Ejemplares similares
AMAGO: Scalable In-Context Reinforcement Learning for Adaptive Agents
por: Grigsby, Jake, et al.
Publicado: (2023)
por: Grigsby, Jake, et al.
Publicado: (2023)
Human-Level Competitive Pokémon via Scalable Offline Reinforcement Learning with Transformers
por: Grigsby, Jake, et al.
Publicado: (2025)
por: Grigsby, Jake, et al.
Publicado: (2025)
AMAGO-2: Breaking the Multi-Task Barrier in Meta-Reinforcement Learning with Transformers
por: Grigsby, Jake, et al.
Publicado: (2024)
por: Grigsby, Jake, et al.
Publicado: (2024)
Aligning Learning and Endogenous Decision-Making
por: Cristian, Rares, et al.
Publicado: (2025)
por: Cristian, Rares, et al.
Publicado: (2025)
LAM SIMULATOR: Advancing Data Generation for Large Action Model Training via Online Exploration and Trajectory Feedback
por: Hoang, Thai, et al.
Publicado: (2025)
por: Hoang, Thai, et al.
Publicado: (2025)
HandsOnVLM: Vision-Language Models for Hand-Object Interaction Prediction
por: Bao, Chen, et al.
Publicado: (2024)
por: Bao, Chen, et al.
Publicado: (2024)
Pretrained Vision-Language-Action Models are Surprisingly Resistant to Forgetting in Continual Learning
por: Liu, Huihan, et al.
Publicado: (2026)
por: Liu, Huihan, et al.
Publicado: (2026)
SDM-Q: Cost-Aware Staged Decision-Making for Multi-Omics Classification with Deep Q-Learning
por: Mu, Nan, et al.
Publicado: (2026)
por: Mu, Nan, et al.
Publicado: (2026)
Efficient Sequential Decision Making with Large Language Models
por: Chen, Dingyang, et al.
Publicado: (2024)
por: Chen, Dingyang, et al.
Publicado: (2024)
Model-Based Runtime Monitoring with Interactive Imitation Learning
por: Liu, Huihan, et al.
Publicado: (2023)
por: Liu, Huihan, et al.
Publicado: (2023)
DriVLM: Domain Adaptation of Vision-Language Models in Autonomous Driving
por: Zheng, Xuran, et al.
Publicado: (2025)
por: Zheng, Xuran, et al.
Publicado: (2025)
GraphVLM: Benchmarking Vision Language Models for Multimodal Graph Learning
por: Liu, Jiajin, et al.
Publicado: (2026)
por: Liu, Jiajin, et al.
Publicado: (2026)
AsymVLM: Asymmetric Token Pruning for Efficient Vision-Language Model Inference
por: Feng, Yilin, et al.
Publicado: (2026)
por: Feng, Yilin, et al.
Publicado: (2026)
Strefer: Empowering Video LLMs with Space-Time Referring and Reasoning via Synthetic Instruction Data
por: Zhou, Honglu, et al.
Publicado: (2025)
por: Zhou, Honglu, et al.
Publicado: (2025)
Gen-DFL: Decision-Focused Generative Learning for Robust Decision Making
por: Wang, Prince Zizhuang, et al.
Publicado: (2025)
por: Wang, Prince Zizhuang, et al.
Publicado: (2025)
RL-VLM-F: Reinforcement Learning from Vision Language Foundation Model Feedback
por: Wang, Yufei, et al.
Publicado: (2024)
por: Wang, Yufei, et al.
Publicado: (2024)
On the Importance of Uncertainty in Decision-Making with Large Language Models
por: Felicioni, Nicolò, et al.
Publicado: (2024)
por: Felicioni, Nicolò, et al.
Publicado: (2024)
FastVLM: Efficient Vision Encoding for Vision Language Models
por: Vasu, Pavan Kumar Anasosalu, et al.
Publicado: (2024)
por: Vasu, Pavan Kumar Anasosalu, et al.
Publicado: (2024)
DRESS: Instructing Large Vision-Language Models to Align and Interact with Humans via Natural Language Feedback
por: Chen, Yangyi, et al.
Publicado: (2023)
por: Chen, Yangyi, et al.
Publicado: (2023)
DocVLM: Make Your VLM an Efficient Reader
por: Nacson, Mor Shpigel, et al.
Publicado: (2024)
por: Nacson, Mor Shpigel, et al.
Publicado: (2024)
InvestAlign: Overcoming Data Scarcity in Aligning Large Language Models with Investor Decision-Making Processes under Herd Behavior
por: Wang, Huisheng, et al.
Publicado: (2025)
por: Wang, Huisheng, et al.
Publicado: (2025)
The Relative Value of Prediction in Algorithmic Decision Making
por: Perdomo, Juan Carlos
Publicado: (2023)
por: Perdomo, Juan Carlos
Publicado: (2023)
FastVLM: Self-Speculative Decoding for Fast Vision-Language Model Inference
por: Bajpai, Divya Jyoti, et al.
Publicado: (2025)
por: Bajpai, Divya Jyoti, et al.
Publicado: (2025)
Geometry of Decision Making in Language Models
por: Joshi, Abhinav, et al.
Publicado: (2025)
por: Joshi, Abhinav, et al.
Publicado: (2025)
Human-Aligned Calibration for AI-Assisted Decision Making
por: Benz, Nina L. Corvelo, et al.
Publicado: (2023)
por: Benz, Nina L. Corvelo, et al.
Publicado: (2023)
Aligning Diffusion Behaviors with Q-functions for Efficient Continuous Control
por: Chen, Huayu, et al.
Publicado: (2024)
por: Chen, Huayu, et al.
Publicado: (2024)
Unifying Specialized Visual Encoders for Video Language Models
por: Chung, Jihoon, et al.
Publicado: (2025)
por: Chung, Jihoon, et al.
Publicado: (2025)
CF-VLM:CounterFactual Vision-Language Fine-tuning
por: Zhang, Jusheng, et al.
Publicado: (2025)
por: Zhang, Jusheng, et al.
Publicado: (2025)
GROW: Aligning GRPO with State-Action Modeling for Open-World VLM Agents
por: Wu, Xiongbin, et al.
Publicado: (2026)
por: Wu, Xiongbin, et al.
Publicado: (2026)
Memory-Driven Self-Improvement for Decision Making with Large Language Models
por: Yan, Xue, et al.
Publicado: (2025)
por: Yan, Xue, et al.
Publicado: (2025)
Fine-Tuning Large Vision-Language Models as Decision-Making Agents via Reinforcement Learning
por: Zhai, Yuexiang, et al.
Publicado: (2024)
por: Zhai, Yuexiang, et al.
Publicado: (2024)
Can Vision Language Models Learn Intuitive Physics from Interaction?
por: Buschoff, Luca M. Schulze, et al.
Publicado: (2026)
por: Buschoff, Luca M. Schulze, et al.
Publicado: (2026)
Vision-Language-Action Models for Robotics: A Review Towards Real-World Applications
por: Kawaharazuka, Kento, et al.
Publicado: (2025)
por: Kawaharazuka, Kento, et al.
Publicado: (2025)
Aligning Large Vision-Language Models by Deep Reinforcement Learning and Direct Preference Optimization
por: Nguyen, Thanh Thi, et al.
Publicado: (2025)
por: Nguyen, Thanh Thi, et al.
Publicado: (2025)
Causal-aware Large Language Models: Enhancing Decision-Making Through Learning, Adapting and Acting
por: Chen, Wei, et al.
Publicado: (2025)
por: Chen, Wei, et al.
Publicado: (2025)
Reinforcement Learning for Aligning Large Language Models Agents with Interactive Environments: Quantifying and Mitigating Prompt Overfitting
por: Aissi, Mohamed Salim, et al.
Publicado: (2024)
por: Aissi, Mohamed Salim, et al.
Publicado: (2024)
Where Not to Learn: Prior-Aligned Training with Subset-based Attribution Constraints for Reliable Decision-Making
por: Chen, Ruoyu, et al.
Publicado: (2026)
por: Chen, Ruoyu, et al.
Publicado: (2026)
Continual Learning in Vision-Language Models via Aligned Model Merging
por: Sokar, Ghada, et al.
Publicado: (2025)
por: Sokar, Ghada, et al.
Publicado: (2025)
Aligning Language Models from User Interactions
por: Buening, Thomas Kleine, et al.
Publicado: (2026)
por: Buening, Thomas Kleine, et al.
Publicado: (2026)
GeoFlowVLM: Geometry-Aware Joint Uncertainty for Frozen Vision-Language Embedding
por: Nautiyal, Mayank, et al.
Publicado: (2026)
por: Nautiyal, Mayank, et al.
Publicado: (2026)
Ejemplares similares
-
AMAGO: Scalable In-Context Reinforcement Learning for Adaptive Agents
por: Grigsby, Jake, et al.
Publicado: (2023) -
Human-Level Competitive Pokémon via Scalable Offline Reinforcement Learning with Transformers
por: Grigsby, Jake, et al.
Publicado: (2025) -
AMAGO-2: Breaking the Multi-Task Barrier in Meta-Reinforcement Learning with Transformers
por: Grigsby, Jake, et al.
Publicado: (2024) -
Aligning Learning and Endogenous Decision-Making
por: Cristian, Rares, et al.
Publicado: (2025) -
LAM SIMULATOR: Advancing Data Generation for Large Action Model Training via Online Exploration and Trajectory Feedback
por: Hoang, Thai, et al.
Publicado: (2025)