Image de couverture de livre

AgentCoMa: A Compositional Benchmark Mixing Commonsense and Mathematical Reasoning in Real-World Scenarios

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Alazraki, Lisa, Chen, Lihu, Brassard, Ana, Stacey, Joe, Rahmani, Hossein A., Rei, Marek
Format:	Preprint
Publié:	2025
Sujets:	Computation and Language
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Meta-Reasoning Improves Tool Use in Large Language Models
par: Alazraki, Lisa, et autres
Publié: (2024)

Improving the OOD Performance of Closed-Source LLMs on NLI Through Strategic Data Selection
par: Stacey, Joe, et autres
Publié: (2025)

Culturally Grounded Physical Commonsense Reasoning in Italian and English: A Submission to the MRL 2025 Shared Task
par: De Santis, Marco, et autres
Publié: (2025)

Distilling Robustness into Natural Language Inference Models with Domain-Targeted Augmentation
par: Stacey, Joe, et autres
Publié: (2023)

Enhancing LLM Robustness to Perturbed Instructions: An Empirical Study
par: Agrawal, Aryan, et autres
Publié: (2025)

ACORN: Aspect-wise Commonsense Reasoning Explanation Evaluation
par: Brassard, Ana, et autres
Publié: (2024)

SCoRE: Benchmarking Long-Chain Reasoning in Commonsense Scenarios
par: Zhan, Weidong, et autres
Publié: (2025)

Reverse Engineering Human Preferences with Reinforcement Learning
par: Alazraki, Lisa, et autres
Publié: (2025)

No Need for Explanations: LLMs can implicitly learn from mistakes in-context
par: Alazraki, Lisa, et autres
Publié: (2025)

DV-World: Benchmarking Data Visualization Agents in Real-World Scenarios
par: Meng, Jinxiang, et autres
Publié: (2026)

Atomic Inference for NLI with Generated Facts as Atoms
par: Stacey, Joe, et autres
Publié: (2023)

RuleArena: A Benchmark for Rule-Guided Reasoning with LLMs in Real-World Scenarios
par: Zhou, Ruiwen, et autres
Publié: (2024)

TIME: A Multi-level Benchmark for Temporal Reasoning of LLMs in Real-World Scenarios
par: Wei, Shaohang, et autres
Publié: (2025)

StateAct: Enhancing LLM Base Agents via Self-prompting and State-tracking
par: Rozanov, Nikolai, et autres
Publié: (2024)

Scaling Small Agents Through Strategy Auctions
par: Alazraki, Lisa, et autres
Publié: (2026)

LLM-based Agentic Reasoning Frameworks: A Survey from Methods to Scenarios
par: Zhao, Bingxi, et autres
Publié: (2025)

The Mystery of Compositional Generalization in Graph-based Generative Commonsense Reasoning
par: Fu, Xiyan, et autres
Publié: (2024)

LOGICAL-COMMONSENSEQA: A Benchmark for Logical Commonsense Reasoning
par: Junias, Obed, et autres
Publié: (2026)

Thai Winograd Schemas: A Benchmark for Thai Commonsense Reasoning
par: Artkaew, Phakphum
Publié: (2024)

Benchmarking Chinese Commonsense Reasoning with a Multi-hop Reasoning Perspective
par: You, Wangjie, et autres
Publié: (2025)

ReasonTabQA: A Comprehensive Benchmark for Table Question Answering from Real World Industrial Scenarios
par: Pan, Changzai, et autres
Publié: (2026)

The Odyssey of Commonsense Causality: From Foundational Benchmarks to Cutting-Edge Reasoning
par: Cui, Shaobo, et autres
Publié: (2024)

Benchmarking Chinese Commonsense Reasoning of LLMs: From Chinese-Specifics to Reasoning-Memorization Correlations
par: Sun, Jiaxing, et autres
Publié: (2024)

Plausibly Problematic Questions in Multiple-Choice Benchmarks for Commonsense Reasoning
par: Palta, Shramay, et autres
Publié: (2024)

Commonsense Reasoning in Arab Culture
par: Sadallah, Abdelrahman, et autres
Publié: (2025)

RESPONSE: Benchmarking the Ability of Language Models to Undertake Commonsense Reasoning in Crisis Situation
par: Diallo, Aissatou, et autres
Publié: (2025)

Tool-Assisted Agent on SQL Inspection and Refinement in Real-World Scenarios
par: Wang, Zhongyuan, et autres
Publié: (2024)

GRASP: A Grid-Based Benchmark for Evaluating Commonsense Spatial Reasoning
par: Tang, Zhisheng, et autres
Publié: (2024)

Cross-Cultural Transfer of Commonsense Reasoning in LLMs: Evidence from the Arab World
par: Almheiri, Saeed, et autres
Publié: (2025)

Focus on Your Question! Interpreting and Mitigating Toxic CoT Problems in Commonsense Reasoning
par: Li, Jiachun, et autres
Publié: (2024)

DetectRL: Benchmarking LLM-Generated Text Detection in Real-World Scenarios
par: Wu, Junchao, et autres
Publié: (2024)

RoMath: A Mathematical Reasoning Benchmark in Romanian
par: Cosma, Adrian, et autres
Publié: (2024)

What is the Role of Small Models in the LLM Era: A Survey
par: Chen, Lihu, et autres
Publié: (2024)

Planning, Creation, Usage: Benchmarking LLMs for Comprehensive Tool Utilization in Real-World Complex Scenarios
par: Huang, Shijue, et autres
Publié: (2024)

TheAgentCompany: Benchmarking LLM Agents on Consequential Real World Tasks
par: Xu, Frank F., et autres
Publié: (2024)

PhoStream: Benchmarking Real-World Streaming for Omnimodal Assistants in Mobile Scenarios
par: Lu, Xudong, et autres
Publié: (2026)

ARK-V1: An LLM-Agent for Knowledge Graph Question Answering Requiring Commonsense Reasoning
par: Klein, Jan-Felix, et autres
Publié: (2025)

Incorporating Error Level Noise Embedding for Improving LLM-Assisted Robustness in Persian Speech Recognition
par: Rahmani, Zahra, et autres
Publié: (2025)

Commonsense Knowledge with Negation: A Resource to Enhance Negation Understanding
par: Wang, Zijie, et autres
Publié: (2026)

HellaSwag-Pro: A Large-Scale Bilingual Benchmark for Evaluating the Robustness of LLMs in Commonsense Reasoning
par: Li, Xiaoyuan, et autres
Publié: (2025)