Imagen de Portada

Grounding Multimodal Large Language Models in Actions

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Szot, Andrew, Mazoure, Bogdan, Agrawal, Harsh, Hjelm, Devon, Kira, Zsolt, Toshev, Alexander
Formato:	Preprint
Publicado:	2024
Materias:	Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

From Multimodal LLMs to Generalist Embodied Agents: Methods and Lessons
por: Szot, Andrew, et al.
Publicado: (2024)

Large Language Models as Generalizable Policies for Embodied Tasks
por: Szot, Andrew, et al.
Publicado: (2023)

GRACE: A Language Model Framework for Explainable Inverse Reinforcement Learning
por: Sapora, Silvia, et al.
Publicado: (2025)

On the Modeling Capabilities of Large Language Models for Sequential Decision Making
por: Klissarov, Martin, et al.
Publicado: (2024)

Expanding LLM Agent Boundaries with Strategy-Guided Exploration
por: Szot, Andrew, et al.
Publicado: (2026)

The Sandbox Environment for Generalizable Agent Research (SEGAR)
por: Hjelm, R Devon, et al.
Publicado: (2022)

Scaling Synthetic Task Generation for Agents via Exploration
por: Ramrakhya, Ram, et al.
Publicado: (2025)

Reinforcement Learning via Auxiliary Task Distillation
por: Harish, Abhinav Narayan, et al.
Publicado: (2024)

ReLIC: A Recipe for 64k Steps of In-Context Reinforcement Learning for Embodied AI
por: Elawady, Ahmad, et al.
Publicado: (2024)

DSplats: 3D Generation by Denoising Splats-Based Multiview Diffusion Models
por: Miao, Kevin, et al.
Publicado: (2024)

On the benefits of pixel-based hierarchical policies for task generalization
por: Cristea-Platon, Tudor, et al.
Publicado: (2024)

ClustRecNet: A Novel End-to-End Deep Learning Framework for Clustering Algorithm Recommendation
por: Bakhtyari, Mohammadreza, et al.
Publicado: (2025)

CELLM: An Efficient Communication in Large Language Models Training for Federated Learning
por: Vavekanand, Raja, et al.
Publicado: (2024)

Rethinking Weight Decay for Robust Fine-Tuning of Foundation Models
por: Tian, Junjiao, et al.
Publicado: (2024)

Scaling Properties of Continuous Diffusion Spoken Language Models
por: Ramapuram, Jason, et al.
Publicado: (2026)

MAPS: Preserving Vision-Language Representations via Module-Wise Proximity Scheduling for Better Vision-Language-Action Generalization
por: Huang, Chengyue, et al.
Publicado: (2025)

Benchmarking the Generality of Vision-Language-Action Models
por: Guruprasad, Pranav, et al.
Publicado: (2025)

Let's Think in Two Steps: Mitigating Agreement Bias in MLLMs with Self-Grounded Verification
por: Andrade, Moises, et al.
Publicado: (2025)

Poly-View Contrastive Learning
por: Shidani, Amitis, et al.
Publicado: (2024)

Grounding Descriptions in Images informs Zero-Shot Visual Recognition
por: Halbe, Shaunak, et al.
Publicado: (2024)

Pre-trained Language Models Do Not Help Auto-regressive Text-to-Image Generation
por: Zhang, Yuhui, et al.
Publicado: (2023)

SAGE: Sink-Aware Grounded Decoding for Multimodal Hallucination Mitigation
por: Shukla, Tripti, et al.
Publicado: (2026)

Towards Visual Text Grounding of Multimodal Large Language Model
por: Li, Ming, et al.
Publicado: (2025)

Analyzing Memorization in Large Language Models through the Lens of Model Attribution
por: Menta, Tarun Ram, et al.
Publicado: (2025)

Grounding Multimodal Large Language Models with Quantitative Skin Attributes: A Retrieval Study
por: Torop, Max, et al.
Publicado: (2025)

Towards Multimodal Graph Large Language Model
por: Wang, Xin, et al.
Publicado: (2025)

Multilingual Prompt Engineering in Large Language Models: A Survey Across NLP Tasks
por: Vatsal, Shubham, et al.
Publicado: (2025)

Controlling Large Language Model with Latent Actions
por: Jia, Chengxing, et al.
Publicado: (2025)

Groma: Localized Visual Tokenization for Grounding Multimodal Large Language Models
por: Ma, Chuofan, et al.
Publicado: (2024)

Emergent Visual Grounding in Large Multimodal Models Without Grounding Supervision
por: Cao, Shengcao, et al.
Publicado: (2024)

Large Vision-Language Models for Knowledge-Grounded Data Annotation of Memes
por: Deng, Shiling, et al.
Publicado: (2025)

Grounding Large Language Models in Interactive Environments with Online Reinforcement Learning
por: Carta, Thomas, et al.
Publicado: (2023)

Graph-MLLM: Harnessing Multimodal Large Language Models for Multimodal Graph Learning
por: Liu, Jiajin, et al.
Publicado: (2025)

ChemMLLM: Chemical Multimodal Large Language Model
por: Tan, Qian, et al.
Publicado: (2025)

Mimicking or Reasoning: Rethinking Multi-Modal In-Context Learning in Vision-Language Models
por: Huang, Chengyue, et al.
Publicado: (2025)

Directional Gradient Projection for Robust Fine-Tuning of Foundation Models
por: Huang, Chengyue, et al.
Publicado: (2025)

L^2M^3OF: A Large Language Multimodal Model for Metal-Organic Frameworks
por: Cui, Jiyu, et al.
Publicado: (2025)

Neural SPH: Improved Neural Modeling of Lagrangian Fluid Dynamics
por: Toshev, Artur P., et al.
Publicado: (2024)

FRAMES-VQA: Benchmarking Fine-Tuning Robustness across Multi-Modal Shifts in Visual Question Answering
por: Huang, Chengyue, et al.
Publicado: (2025)

Continual Adaptation of Vision Transformers for Federated Learning
por: Halbe, Shaunak, et al.
Publicado: (2023)