Cover Image

EmbodiedEval: Evaluate Multimodal LLMs as Embodied Agents

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Cheng, Zhili, Tu, Yuge, Li, Ran, Dai, Shiqi, Hu, Jinyi, Hu, Shengding, Li, Jiahao, Shi, Yang, Yu, Tianyu, Chen, Weize, Shi, Lei, Sun, Maosong
Format:	Preprint
Published:	2025
Subjects:	Computer Vision and Pattern Recognition Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

LEGENT: Open Platform for Embodied Agents
by: Cheng, Zhili, et al.
Published: (2024)

UltraEval: A Lightweight Platform for Flexible and Comprehensive Evaluation for LLMs
by: He, Chaoqun, et al.
Published: (2024)

States Hidden in Hidden States: LLMs Emerge Discrete State Representations Implicitly
by: Chen, Junhao, et al.
Published: (2024)

A2Eval: Agentic and Automated Evaluation for Embodied Brain
by: Zhang, Shuai, et al.
Published: (2026)

Embodied Agent Interface: Benchmarking LLMs for Embodied Decision Making
by: Li, Manling, et al.
Published: (2024)

EmpathyAgent: Can Embodied Agents Conduct Empathetic Actions?
by: Chen, Xinyan, et al.
Published: (2025)

Static and Plugged: Make Embodied Evaluation Simple
by: Xiao, Jiahao, et al.
Published: (2025)

Euclid: Supercharging Multimodal LLMs with Synthetic High-Fidelity Visual Descriptions
by: Zhang, Jiarui, et al.
Published: (2024)

VF-Eval: Evaluating Multimodal LLMs for Generating Feedback on AIGC Videos
by: Song, Tingyu, et al.
Published: (2025)

Unleashing Embodied Task Planning Ability in LLMs via Reinforcement Learning
by: Fei, Zhaoye, et al.
Published: (2025)

HY-Embodied-0.5: Embodied Foundation Models for Real-World Agents
by: X, Tencent Robotics, et al.
Published: (2026)

ACDiT: Interpolating Autoregressive Conditional Modeling and Diffusion Transformer
by: Hu, Jinyi, et al.
Published: (2024)

EmbodiedBench: Comprehensive Benchmarking Multi-modal Large Language Models for Vision-Driven Embodied Agents
by: Yang, Rui, et al.
Published: (2025)

DecisionNCE: Embodied Multimodal Representations via Implicit Preference Learning
by: Li, Jianxiong, et al.
Published: (2024)

OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scientific Problems
by: He, Chaoqun, et al.
Published: (2024)

Embodied Understanding of Driving Scenarios
by: Zhou, Yunsong, et al.
Published: (2024)

Robobench: A Comprehensive Evaluation Benchmark for Multimodal Large Language Models as Embodied Brain
by: Luo, Yulin, et al.
Published: (2025)

BadRobot: Jailbreaking Embodied LLMs in the Physical World
by: Zhang, Hangtao, et al.
Published: (2024)

Embody4D: A Generalist 4D World Model for Embodied AI
by: Tu, Peiyan, et al.
Published: (2026)

An Embodied Generalist Agent in 3D World
by: Huang, Jiangyong, et al.
Published: (2023)

IS-Bench: Evaluating Interactive Safety of VLM-Driven Embodied Agents in Daily Household Tasks
by: Lu, Xiaoya, et al.
Published: (2025)

Exploring Perceptual Limitation of Multimodal Large Language Models
by: Zhang, Jiarui, et al.
Published: (2024)

Body Discovery of Embodied AI
by: Sun, Zhe, et al.
Published: (2025)

Embodied Multi-Modal Agent trained by an LLM from a Parallel TextWorld
by: Yang, Yijun, et al.
Published: (2023)

Anim-Director: A Large Multimodal Model Powered Agent for Controllable Animation Video Generation
by: Li, Yunxin, et al.
Published: (2024)

Internet of Agents: Weaving a Web of Heterogeneous Agents for Collaborative Intelligence
by: Chen, Weize, et al.
Published: (2024)

HyCodePolicy: Hybrid Language Controllers for Multimodal Monitoring and Decision in Embodied Agents
by: Liu, Yibin, et al.
Published: (2025)

M4SER: Multimodal, Multirepresentation, Multitask, and Multistrategy Learning for Speech Emotion Recognition
by: He, Jiajun, et al.
Published: (2025)

TP-Eval: Tap Multimodal LLMs' Potential in Evaluation by Customizing Prompts
by: Xie, Yuxuan, et al.
Published: (2024)

LEGO-Eval: Towards Fine-Grained Evaluation on Synthesizing 3D Embodied Environments with Tool Augmentation
by: Hwangbo, Gyeom, et al.
Published: (2025)

EmBARDiment: an Embodied AI Agent for Productivity in XR
by: Bovo, Riccardo, et al.
Published: (2024)

CPMobius: Iterative Coach-Player Reasoning for Data-Free Reinforcement Learning
by: Li, Ran, et al.
Published: (2026)

Conditional Multi-Stage Failure Recovery for Embodied Agents
by: Farag, Youmna, et al.
Published: (2025)

Embodied-Reasoner: Synergizing Visual Search, Reasoning, and Action for Embodied Interactive Tasks
by: Zhang, Wenqi, et al.
Published: (2025)

Coherence-Driven Multimodal Safety Dialogue with Active Learning for Embodied Agents
by: Hassan, Sabit, et al.
Published: (2024)

PertEval: Unveiling Real Knowledge Capacity of LLMs with Knowledge-Invariant Perturbations
by: Li, Jiatong, et al.
Published: (2024)

LMMs-Eval: Reality Check on the Evaluation of Large Multimodal Models
by: Zhang, Kaichen, et al.
Published: (2024)

Dissecting Embodied Abilities in Multimodal Language Models through Skill-level Evaluation and Diagnosis
by: Qi, Yu, et al.
Published: (2025)

MiMo-Embodied: X-Embodied Foundation Model Technical Report
by: Hao, Xiaoshuai, et al.
Published: (2025)

Embodied Domain Adaptation for Object Detection
by: Shi, Xiangyu, et al.
Published: (2025)