Image de couverture de livre

GeoChallenge: A Multi-Answer Multiple-Choice Benchmark for Geometric Reasoning with Diagrams

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Zhang, Yushun, Fu, Weiping, Yang, Zesheng, Zhao, Bo, Zhang, Lingling, Zhang, Jian, Fu, Yumeng, Huang, Jiaxing, Liu, Jun
Format:	Preprint
Publié:	2026
Sujets:	Computation and Language Artificial Intelligence
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

GeoLaux: A Benchmark for Evaluating MLLMs' Geometry Performance on Long-Step Problems Requiring Auxiliary Lines
par: Fu, Yumeng, et autres
Publié: (2025)

Sandwich Reasoning: An Answer-Reasoning-Answer Approach for Low-Latency Query Correction
par: Zhang, Chen, et autres
Publié: (2026)

Improving Score Reliability of Multiple Choice Benchmarks with Consistency Evaluation and Altered Answer Choices
par: Cavalin, Paulo, et autres
Publié: (2025)

Dual-Cluster Memory Agent: Resolving Multi-Paradigm Ambiguity in Optimization Problem Solving
par: Zhang, Xinyu, et autres
Publié: (2026)

QGEval: Benchmarking Multi-dimensional Evaluation for Question Generation
par: Fu, Weiping, et autres
Publié: (2024)

ChartAct: A Benchmark for Dynamic Chart Understanding
par: Huang, Muye, et autres
Publié: (2026)

Answer, Assemble, Ace: Understanding How LMs Answer Multiple Choice Questions
par: Wiegreffe, Sarah, et autres
Publié: (2024)

Plausibly Problematic Questions in Multiple-Choice Benchmarks for Commonsense Reasoning
par: Palta, Shramay, et autres
Publié: (2024)

GeoSense: Evaluating Identification and Application of Geometric Principles in Multimodal Reasoning
par: Xu, Liangyu, et autres
Publié: (2025)

The Non-Determinism of Small LLMs: Evidence of Low Answer Consistency in Repetition Trials of Standard Multiple-Choice Benchmarks
par: Pinhanez, Claudio, et autres
Publié: (2025)

Answer Matching Outperforms Multiple Choice for Language Model Evaluation
par: Chandak, Nikhil, et autres
Publié: (2025)

Polyglots or Multitudes? Multilingual LLM Answers to Value-laden Multiple-Choice Questions
par: Labat, Léo, et autres
Publié: (2026)

When Safety Fails Before the Answer: Benchmarking Harmful Behavior Detection in Reasoning Chains
par: Kakkar, Ishita, et autres
Publié: (2026)

Chengyu-Bench: Benchmarking Large Language Models for Chinese Idiom Understanding and Use
par: Fu, Yicheng, et autres
Publié: (2025)

ErrEval: Error-Aware Evaluation for Question Generation through Explicit Diagnostics
par: Fu, Weiping, et autres
Publié: (2026)

MSCoRe: A Benchmark for Multi-Stage Collaborative Reasoning in LLM Agents
par: Lei, Yuzhen, et autres
Publié: (2025)

Benchmarking Chinese Commonsense Reasoning of LLMs: From Chinese-Specifics to Reasoning-Memorization Correlations
par: Sun, Jiaxing, et autres
Publié: (2024)

GeoGPT4V: Towards Geometric Multi-modal Large Language Models with Geometric Image Generation
par: Cai, Shihao, et autres
Publié: (2024)

Artifacts or Abduction: How Do LLMs Answer Multiple-Choice Questions Without the Question?
par: Balepur, Nishant, et autres
Publié: (2024)

LatentRouter: Can We Choose the Right Multimodal Model Before Seeing Its Answer?
par: Cheng, Xueqi, et autres
Publié: (2026)

UBench: Benchmarking Uncertainty in Large Language Models with Multiple Choice Questions
par: Wang, Xunzhi, et autres
Publié: (2024)

BioHopR: A Benchmark for Multi-Hop, Multi-Answer Reasoning in Biomedical Domain
par: Kim, Yunsoo, et autres
Publié: (2025)

WiCkeD: A Simple Method to Make Multiple Choice Benchmarks More Challenging
par: Elhady, Ahmed, et autres
Publié: (2025)

MMReason: An Open-Ended Multi-Modal Multi-Step Reasoning Benchmark for MLLMs Toward AGI
par: Yao, Huanjin, et autres
Publié: (2025)

How Sensitive Are Safety Benchmarks to Judge Configuration Choices?
par: Zhang, Xinran
Publié: (2026)

ReDiffuse: Rotation Equivariant Diffusion Model for Multi-focus Image Fusion
par: Li, Bo, et autres
Publié: (2026)

Multiple Choice Questions: Reasoning Makes Large Language Models (LLMs) More Self-Confident, Especially When They are Wrong
par: Fu, Tairan, et autres
Publié: (2025)

Right Answer, Wrong Score: Uncovering the Inconsistencies of LLM Evaluation in Multiple-Choice Question Answering
par: Molfese, Francesco Maria, et autres
Publié: (2025)

Anchored Answers: Unravelling Positional Bias in GPT-2's Multiple-Choice Questions
par: Li, Ruizhe, et autres
Publié: (2024)

Domaino1s: Guiding LLM Reasoning for Explainable Answers in High-Stakes Domains
par: Chu, Xu, et autres
Publié: (2025)

GeoPQA: Bridging the Visual Perception Gap in MLLMs for Geometric Reasoning
par: Chen, Guizhen, et autres
Publié: (2025)

A Claim Decomposition Benchmark for Long-form Answer Verification
par: Zhang, Zhihao, et autres
Publié: (2024)

A Dataset of Open-Domain Question Answering with Multiple-Span Answers
par: Luo, Zhiyi, et autres
Publié: (2024)

MME-CC: A Challenging Multi-Modal Evaluation Benchmark of Cognitive Capacity
par: Zhang, Kaiyuan, et autres
Publié: (2025)

Answer-Centric or Reasoning-Driven? Uncovering the Latent Memory Anchor in LLMs
par: Wu, Yang, et autres
Publié: (2025)

Do Large Language Models Plan Answer Positions? Position Bias in Multiple-Choice Question Generation
par: Tang, Xuemei, et autres
Publié: (2026)

Reasoning Models are Test Exploiters: Rethinking Multiple-Choice
par: Raman, Narun, et autres
Publié: (2025)

RLEP: Reinforcement Learning with Experience Replay for LLM Reasoning
par: Zhang, Hongzhi, et autres
Publié: (2025)

TrustGeoGen: Formal-Verified Data Engine for Trustworthy Multi-modal Geometric Problem Solving
par: Fu, Daocheng, et autres
Publié: (2025)

HiEAG: Evidence-Augmented Generation for Out-of-Context Misinformation Detection
par: Wu, Junjie, et autres
Publié: (2025)