Cover Image

Know Where You're Uncertain When Planning with Multimodal Foundation Models: A Formal Framework

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Bhatt, Neel P., Yang, Yunhao, Siva, Rohan, Milan, Daniel, Topcu, Ufuk, Wang, Zhangyang
Format:	Preprint
Published:	2024
Subjects:	Robotics Artificial Intelligence Computer Vision and Pattern Recognition Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

VLN-Zero: Rapid Exploration and Cache-Enabled Neurosymbolic Vision-Language Planning for Zero-Shot Transfer in Robot Navigation
by: Bhatt, Neel P., et al.
Published: (2025)

RepV: Safety-Separable Latent Spaces for Scalable Neurosymbolic Plan Verification
by: Yang, Yunhao, et al.
Published: (2025)

Fine-Tuning Language Models Using Formal Methods Feedback
by: Yang, Yunhao, et al.
Published: (2023)

Joint Verification and Refinement of Language Models for Safety-Constrained Planning
by: Yang, Yunhao, et al.
Published: (2024)

UNCAP: Uncertainty-Guided Neurosymbolic Planning Using Natural Language Communication for Cooperative Autonomous Vehicles
by: Bhatt, Neel P., et al.
Published: (2025)

On The Planning Abilities of OpenAI's o1 Models: Feasibility, Optimality, and Generalizability
by: Wang, Kevin, et al.
Published: (2024)

LAD-VF: LLM-Automatic Differentiation Enables Fine-Tuning-Free Robot Planning from Formal Methods Feedback
by: Yang, Yunhao, et al.
Published: (2025)

Foundation Models for Logistics: Toward Certifiable, Conversational Planning Interfaces
by: Yang, Yunhao, et al.
Published: (2025)

MM3DGS SLAM: Multi-modal 3D Gaussian Splatting for SLAM Using Vision, Depth, and Inertial Measurements
by: Sun, Lisong C., et al.
Published: (2024)

I Know You're Listening: Adaptive Voice for HRI
by: Tuttösí, Paige
Published: (2025)

Multimodal Pretrained Models for Verifiable Sequential Decision-Making: Planning, Grounding, and Perception
by: Yang, Yunhao, et al.
Published: (2023)

Do You Know Where Your Camera Is? View-Invariant Policy Learning with Camera Conditioning
by: Jiang, Tianchong, et al.
Published: (2025)

MultiNash-PF: A Particle Filtering Approach for Computing Multiple Local Generalized Nash Equilibria in Trajectory Games
by: Bhatt, Maulik, et al.
Published: (2024)

Zero-Shot Transfer of Neural ODEs
by: Ingebrand, Tyler, et al.
Published: (2024)

Online Adaptation of Terrain-Aware Dynamics for Planning in Unstructured Environments
by: Ward, William, et al.
Published: (2025)

Online Foundation Model Selection in Robotics
by: Li, Po-han, et al.
Published: (2024)

MoS-VLA: A Vision-Language-Action Model with One-Shot Skill Adaptation
by: Zhao, Ruihan, et al.
Published: (2025)

When Should Agents Coordinate in Differentiable Sequential Decision Problems?
by: Probine, Caleb, et al.
Published: (2026)

You're Pushing My Buttons: Instrumented Learning of Gentle Button Presses
by: Talwar, Raman, et al.
Published: (2026)

iCub Knows Where You Look: Exploiting Social Cues for Interactive Object Detection Learning
by: Lombardi, Maria, et al.
Published: (2022)

Moving On, Even When You're Broken: Fail-Active Trajectory Generation via Diffusion Policies Conditioned on Embodiment and Task
by: Briscoe-Martinez, Gilberto G., et al.
Published: (2026)

IG-MCTS: Human-in-the-Loop Cooperative Navigation under Incomplete Information
by: Chen, Shenghui, et al.
Published: (2025)

A Reinforcement Learning Approach to Quiet and Safe UAM Traffic Management
by: Murthy, Surya, et al.
Published: (2025)

Robust Multi-Agent Reinforcement Learning for Small UAS Separation Assurance under GPS Degradation and Spoofing
by: Zongo, Alex, et al.
Published: (2026)

Tell Me Where You Are: Multimodal LLMs Meet Place Recognition
by: Lyu, Zonglin, et al.
Published: (2024)

Neurosymbolic LoRA: Why and When to Tune Weights vs. Rewrite Prompts
by: Wang, Kevin, et al.
Published: (2026)

Zero to Autonomy in Real-Time: Online Adaptation of Dynamics in Unstructured Environments
by: Ward, William, et al.
Published: (2025)

Reasoning, Memorization, and Fine-Tuning Language Models for Non-Cooperative Games
by: Yang, Yunhao, et al.
Published: (2024)

RoboSeek: You Need to Interact with Your Objects
by: Peng, Yibo, et al.
Published: (2025)

Scalable Networked Feature Selection with Randomized Algorithm for Robot Navigation
by: Pandey, Vivek, et al.
Published: (2024)

On-Line Learning for Planning and Control of Underactuated Robots with Uncertain Dynamics
by: Turrisi, Giulio, et al.
Published: (2025)

Why Change Your Controller When You Can Change Your Planner: Drag-Aware Trajectory Generation for Quadrotor Systems
by: Zhang, Hanli, et al.
Published: (2024)

A Novel MDP Decomposition Framework for Scalable UAV Mission Planning in Complex and Uncertain Environments
by: Quamar, Md Muzakkir, et al.
Published: (2025)

An Adaptive Inspection Planning Approach Towards Routine Monitoring in Uncertain Environments
by: Viswanathan, Vignesh Kottayam, et al.
Published: (2025)

Vector Field-Guided Learning Predictive Control for Motion Planning of Mobile Robots with Uncertain Dynamics
by: Lu, Yang, et al.
Published: (2024)

Adaptive Probabilistic Planning for the Uncertain and Dynamic Orienteering Problem
by: Qian, Qiuchen, et al.
Published: (2024)

Bayesian Inverse Games with High-Dimensional Multi-Modal Observations
by: Jain, Yash, et al.
Published: (2026)

Risk-Guided Diffusion: Toward Deploying Robot Foundation Models in Space, Where Failure Is Not An Option
by: Thakker, Rohan, et al.
Published: (2025)

I Know Your Feelings Before You Do: Predicting Future Affective Reactions in Human-Computer Dialogue
by: Li, Yuanchao, et al.
Published: (2023)

Heterogeneous Predictor-based Risk-Aware Planning with Conformal Prediction in Dense, Uncertain Environments
by: Yang, Jeongyong, et al.
Published: (2025)