Image de couverture de livre

Revisiting a Pain in the Neck: A Semantic Reasoning Benchmark for Language Models

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Liu, Yang, Li, Hongming, Qin, Melissa Xiaohui, Liu, Qiankun, Huang, Chao
Format:	Preprint
Publié:	2026
Sujets:	Computation and Language
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Revisiting a Pain in the Neck: Semantic Phrase Processing Benchmark for Language Models
par: Liu, Yang, et autres
Publié: (2024)

Entropy-Based Data Selection for Language Models
par: Li, Hongming, et autres
Publié: (2026)

PJB: A Reasoning-Aware Benchmark for Person-Job Retrieval
par: Wang, Guangzhi, et autres
Publié: (2026)

MixRea: Benchmarking Explicit-Implicit Reasoning in Large Language Models
par: Cai, Yuanqing, et autres
Publié: (2026)

AstroMind: A High-Fidelity Benchmark for Spacecraft Behavior Reasoning Based on Large Language Models
par: Liu, Hao, et autres
Publié: (2026)

DiagnosisArena: Benchmarking Diagnostic Reasoning for Large Language Models
par: Zhu, Yakun, et autres
Publié: (2025)

GraCoRe: Benchmarking Graph Comprehension and Complex Reasoning in Large Language Models
par: Yuan, Zike, et autres
Publié: (2024)

Revisiting Model Interpolation for Efficient Reasoning
par: Wu, Taiqiang, et autres
Publié: (2025)

EquiBench: Benchmarking Large Language Models' Reasoning about Program Semantics via Equivalence Checking
par: Wei, Anjiang, et autres
Publié: (2025)

TReB: A Comprehensive Benchmark for Evaluating Table Reasoning Capabilities of Large Language Models
par: Li, Ce, et autres
Publié: (2025)

LightReasoner: Can Small Language Models Teach Large Language Models Reasoning?
par: Wang, Jingyuan, et autres
Publié: (2025)

Com$^2$: A Causal-Guided Benchmark for Exploring Complex Commonsense Reasoning in Large Language Models
par: Xiong, Kai, et autres
Publié: (2025)

SocREval: Large Language Models with the Socratic Method for Reference-Free Reasoning Evaluation
par: He, Hangfeng, et autres
Publié: (2023)

Evaluating Large Language Models for Financial Reasoning: A CFA-Based Benchmark Study
par: Yao, Xuan, et autres
Publié: (2025)

Conceptual and Unbiased Reasoning in Language Models
par: Zhou, Ben, et autres
Publié: (2024)

Large Language Models Are Cross-Lingual Knowledge-Free Reasoners
par: Hu, Peng, et autres
Publié: (2024)

Abstraction-of-Thought Makes Language Models Better Reasoners
par: Hong, Ruixin, et autres
Publié: (2024)

HyperGVL: Benchmarking and Improving Large Vision-Language Models in Hypergraph Understanding and Reasoning
par: Wei, Yanbin, et autres
Publié: (2026)

BaziQA-Benchmark: Evaluating Symbolic and Temporally Compositional Reasoning in Large Language Models
par: Chen, Jiangxi, et autres
Publié: (2026)

AbsPyramid: Benchmarking the Abstraction Ability of Language Models with a Unified Entailment Graph
par: Wang, Zhaowei, et autres
Publié: (2023)

LogicGame: Benchmarking Rule-Based Reasoning Abilities of Large Language Models
par: Gui, Jiayi, et autres
Publié: (2024)

CLAMBER: A Benchmark of Identifying and Clarifying Ambiguous Information Needs in Large Language Models
par: Zhang, Tong, et autres
Publié: (2024)

Inference-Time Decontamination: Reusing Leaked Benchmarks for Large Language Model Evaluation
par: Zhu, Qin, et autres
Publié: (2024)

Revisiting Knowledge Distillation for Autoregressive Language Models
par: Zhong, Qihuang, et autres
Publié: (2024)

Semantic Self-Consistency: Enhancing Language Model Reasoning via Semantic Weighting
par: Knappe, Tim, et autres
Publié: (2024)

Meta-Reasoning: Semantics-Symbol Deconstruction for Large Language Models
par: Wang, Yiming, et autres
Publié: (2023)

ECR-Chain: Advancing Generative Language Models to Better Emotion-Cause Reasoners through Reasoning Chains
par: Huang, Zhaopei, et autres
Publié: (2024)

EconLogicQA: A Question-Answering Benchmark for Evaluating Large Language Models in Economic Sequential Reasoning
par: Quan, Yinzhu, et autres
Publié: (2024)

A Closer Look at the Self-Verification Abilities of Large Language Models in Logical Reasoning
par: Hong, Ruixin, et autres
Publié: (2023)

Implicit Reasoning in Large Language Models: A Comprehensive Survey
par: Li, Jindong, et autres
Publié: (2025)

MONICA: Real-Time Monitoring and Calibration of Chain-of-Thought Sycophancy in Large Reasoning Models
par: Hu, Jingyu, et autres
Publié: (2025)

MR-GSM8K: A Meta-Reasoning Benchmark for Large Language Model Evaluation
par: Zeng, Zhongshen, et autres
Publié: (2023)

UGMathBench: A Diverse and Dynamic Benchmark for Undergraduate-Level Mathematical Reasoning with Large Language Models
par: Xu, Xin, et autres
Publié: (2025)

StableToolBench: Towards Stable Large-Scale Benchmarking on Tool Learning of Large Language Models
par: Guo, Zhicheng, et autres
Publié: (2024)

SocialMaze: A Benchmark for Evaluating Social Reasoning in Large Language Models
par: Xu, Zixiang, et autres
Publié: (2025)

SpeechR: A Benchmark for Speech Reasoning in Large Audio-Language Models
par: Yang, Wanqi, et autres
Publié: (2025)

EffiReason-Bench: A Unified Benchmark for Evaluating and Advancing Efficient Reasoning in Large Language Models
par: Huang, Junquan, et autres
Publié: (2025)

ReliableMath: Benchmark of Reliable Mathematical Reasoning on Large Language Models
par: Xue, Boyang, et autres
Publié: (2025)

Benchmarking Vision-Language Models on Chinese Ancient Documents: From OCR to Knowledge Reasoning
par: Yu, Haiyang, et autres
Publié: (2025)

Revisiting the Reliability of Language Models in Instruction-Following
par: Dong, Jianshuo, et autres
Publié: (2025)