Image de couverture de livre

COMMA: A Communicative Multimodal Multi-Agent Benchmark

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Ossowski, Timothy, Maqbool, Danyal, Chen, Jixuan, Cai, Zefan, Bradshaw, Tyler, Hu, Junjie
Format:	Preprint
Publié:	2024
Sujets:	Artificial Intelligence
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

CodeClinic: Evaluating Automation of Coding Skills for Clinical Reasoning Agents
par: Ossowski, Timothy, et autres
Publié: (2026)

OLIVE: Object Level In-Context Visual Embeddings
par: Ossowski, Timothy, et autres
Publié: (2024)

Opportunistic Promptable Segmentation: Leveraging Routine Radiological Annotations to Guide 3D CT Lesion Segmentation
par: Church, Samuel, et autres
Publié: (2026)

Prompting Large Vision-Language Models for Compositional Reasoning
par: Ossowski, Timothy, et autres
Publié: (2024)

OctoMed: Data Recipes for State-of-the-Art Multimodal Medical Reasoning
par: Ossowski, Timothy, et autres
Publié: (2025)

BenchTrace: A Benchmark for Testing Reflection Ability and Controlled Evolution in LLM Agents
par: Huang, Jiahao, et autres
Publié: (2026)

MENTOR: Efficient Multimodal-Conditioned Tuning for Autoregressive Vision Generation Models
par: Zhao, Haozhe, et autres
Publié: (2025)

MedMASLab: A Unified Orchestration Framework for Benchmarking Multimodal Medical Multi-Agent Systems
par: Qian, Yunhang, et autres
Publié: (2026)

LLM Agent for Fire Dynamics Simulations
par: Xu, Leidong, et autres
Publié: (2024)

OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments
par: Xie, Tianbao, et autres
Publié: (2024)

PETAR: Localized Findings Generation with Mask-Aware Vision-Language Modeling for PET Automated Reporting
par: Maqbool, Danyal, et autres
Publié: (2025)

Tailored-LLaMA: Optimizing Few-Shot Learning in Pruned LLaMA Models with Task-Specific Prompts
par: Aftab, Danyal, et autres
Publié: (2024)

CRAB: Cross-environment Agent Benchmark for Multimodal Language Model Agents
par: Xu, Tianqi, et autres
Publié: (2024)

BRIGHT+: Upgrading the BRIGHT Benchmark with MARCUS, a Multi-Agent RAG Clean-Up Suite
par: Chen, Liyang, et autres
Publié: (2025)

Evaluating Collaborative and Autonomous Agents in Data-Stream-Supported Coordination of Mobile Crowdsourcing
par: Bruns, Ralf, et autres
Publié: (2024)

On-Time Delivery in Crowdshipping Systems: An Agent-Based Approach Using Streaming Data
par: Dötterl, Jeremias, et autres
Publié: (2024)

DeliveryBench: Can Agents Earn Profit in Real World?
par: Mao, Lingjun, et autres
Publié: (2025)

DynaTrust: Defending Multi-Agent Systems Against Sleeper Agents via Dynamic Trust Graphs
par: Li, Yu, et autres
Publié: (2026)

CausalAgent: A Conversational Multi-Agent System for End-to-End Causal Inference
par: Zhu, Jiawei, et autres
Publié: (2026)

Understanding Individual Agent Importance in Multi-Agent System via Counterfactual Reasoning
par: Chen, Jianming, et autres
Publié: (2024)

AgentRx: A Benchmark Study of LLM Agents for Multimodal Clinical Prediction Tasks
par: Jorf, Baraa Al, et autres
Publié: (2026)

MLA-Trust: Benchmarking Trustworthiness of Multimodal LLM Agents in GUI Environments
par: Yang, Xiao, et autres
Publié: (2025)

OPT-BENCH: Evaluating the Iterative Self-Optimization of LLM Agents in Large-Scale Search Spaces
par: Li, Xiaozhe, et autres
Publié: (2026)

OSUniverse: Benchmark for Multimodal GUI-navigation AI Agents
par: Davydova, Mariya, et autres
Publié: (2025)

HeadInfer: Memory-Efficient LLM Inference by Head-wise Offloading
par: Luo, Cheng, et autres
Publié: (2025)

Smart Recommendations for Renting Bikes in Bike Sharing Systems
par: Billhardt, Holger, et autres
Publié: (2024)

ELHPlan: Efficient Long-Horizon Task Planning for Multi-Agent Collaboration
par: Ling, Shaobin, et autres
Publié: (2025)

RiOSWorld: Benchmarking the Risk of Multimodal Computer-Use Agents
par: Yang, Jingyi, et autres
Publié: (2025)

MM-IQ: Benchmarking Human-Like Abstraction and Reasoning in Multimodal Models
par: Cai, Huanqia, et autres
Publié: (2025)

SLEIGHT-Bench: A Benchmark of Evasion Attacks Against Agent Monitors
par: Najt, Elle, et autres
Publié: (2026)

BrowseComp-$V^3$: A Visual, Vertical, and Verifiable Benchmark for Multimodal Browsing Agents
par: Zhang, Huanyao, et autres
Publié: (2026)

CAFES: A Collaborative Multi-Agent Framework for Multi-Granular Multimodal Essay Scoring
par: Su, Jiamin, et autres
Publié: (2025)

A Unified Multi-Agent Framework for Universal Multimodal Understanding and Generation
par: Li, Jiulin, et autres
Publié: (2025)

MiroEval: Benchmarking Multimodal Deep Research Agents in Process and Outcome
par: Ye, Fangda, et autres
Publié: (2026)

SciToolAgent: A Knowledge Graph-Driven Scientific Agent for Multi-Tool Integration
par: Ding, Keyan, et autres
Publié: (2025)

MMSearch-Plus: Benchmarking Provenance-Aware Search for Multimodal Browsing Agents
par: Tao, Xijia, et autres
Publié: (2025)

EgoBench: An Interactive Egocentric Multimodal Benchmark for Tool-Using Agents
par: Liu, Yunqi, et autres
Publié: (2026)

NEWSAGENT: Benchmarking Multimodal Agents as Journalists with Real-World Newswriting Tasks
par: Chien, Yen-Che, et autres
Publié: (2025)

MemVerse: Multimodal Memory for Lifelong Learning Agents
par: Liu, Junming, et autres
Publié: (2025)

MMInA: Benchmarking Multihop Multimodal Internet Agents
par: Tian, Shulin, et autres
Publié: (2024)