Buchumschlag

Revisiting a Pain in the Neck: A Semantic Reasoning Benchmark for Language Models

Fuente: arXiv

Gespeichert in:

Bibliographische Detailangaben
Hauptverfasser:	Liu, Yang, Li, Hongming, Qin, Melissa Xiaohui, Liu, Qiankun, Huang, Chao
Format:	Preprint
Veröffentlicht:	2026
Schlagworte:	Computation and Language
Online-Zugang:	Acceder al recurso
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!

Ähnliche Einträge

Revisiting a Pain in the Neck: Semantic Phrase Processing Benchmark for Language Models
von: Liu, Yang, et al.
Veröffentlicht: (2024)

Entropy-Based Data Selection for Language Models
von: Li, Hongming, et al.
Veröffentlicht: (2026)

PJB: A Reasoning-Aware Benchmark for Person-Job Retrieval
von: Wang, Guangzhi, et al.
Veröffentlicht: (2026)

MixRea: Benchmarking Explicit-Implicit Reasoning in Large Language Models
von: Cai, Yuanqing, et al.
Veröffentlicht: (2026)

AstroMind: A High-Fidelity Benchmark for Spacecraft Behavior Reasoning Based on Large Language Models
von: Liu, Hao, et al.
Veröffentlicht: (2026)

DiagnosisArena: Benchmarking Diagnostic Reasoning for Large Language Models
von: Zhu, Yakun, et al.
Veröffentlicht: (2025)

GraCoRe: Benchmarking Graph Comprehension and Complex Reasoning in Large Language Models
von: Yuan, Zike, et al.
Veröffentlicht: (2024)

Revisiting Model Interpolation for Efficient Reasoning
von: Wu, Taiqiang, et al.
Veröffentlicht: (2025)

EquiBench: Benchmarking Large Language Models' Reasoning about Program Semantics via Equivalence Checking
von: Wei, Anjiang, et al.
Veröffentlicht: (2025)

TReB: A Comprehensive Benchmark for Evaluating Table Reasoning Capabilities of Large Language Models
von: Li, Ce, et al.
Veröffentlicht: (2025)

LightReasoner: Can Small Language Models Teach Large Language Models Reasoning?
von: Wang, Jingyuan, et al.
Veröffentlicht: (2025)

Com$^2$: A Causal-Guided Benchmark for Exploring Complex Commonsense Reasoning in Large Language Models
von: Xiong, Kai, et al.
Veröffentlicht: (2025)

SocREval: Large Language Models with the Socratic Method for Reference-Free Reasoning Evaluation
von: He, Hangfeng, et al.
Veröffentlicht: (2023)

Evaluating Large Language Models for Financial Reasoning: A CFA-Based Benchmark Study
von: Yao, Xuan, et al.
Veröffentlicht: (2025)

Conceptual and Unbiased Reasoning in Language Models
von: Zhou, Ben, et al.
Veröffentlicht: (2024)

Large Language Models Are Cross-Lingual Knowledge-Free Reasoners
von: Hu, Peng, et al.
Veröffentlicht: (2024)

Abstraction-of-Thought Makes Language Models Better Reasoners
von: Hong, Ruixin, et al.
Veröffentlicht: (2024)

HyperGVL: Benchmarking and Improving Large Vision-Language Models in Hypergraph Understanding and Reasoning
von: Wei, Yanbin, et al.
Veröffentlicht: (2026)

BaziQA-Benchmark: Evaluating Symbolic and Temporally Compositional Reasoning in Large Language Models
von: Chen, Jiangxi, et al.
Veröffentlicht: (2026)

AbsPyramid: Benchmarking the Abstraction Ability of Language Models with a Unified Entailment Graph
von: Wang, Zhaowei, et al.
Veröffentlicht: (2023)

LogicGame: Benchmarking Rule-Based Reasoning Abilities of Large Language Models
von: Gui, Jiayi, et al.
Veröffentlicht: (2024)

CLAMBER: A Benchmark of Identifying and Clarifying Ambiguous Information Needs in Large Language Models
von: Zhang, Tong, et al.
Veröffentlicht: (2024)

Inference-Time Decontamination: Reusing Leaked Benchmarks for Large Language Model Evaluation
von: Zhu, Qin, et al.
Veröffentlicht: (2024)

Revisiting Knowledge Distillation for Autoregressive Language Models
von: Zhong, Qihuang, et al.
Veröffentlicht: (2024)

Semantic Self-Consistency: Enhancing Language Model Reasoning via Semantic Weighting
von: Knappe, Tim, et al.
Veröffentlicht: (2024)

Meta-Reasoning: Semantics-Symbol Deconstruction for Large Language Models
von: Wang, Yiming, et al.
Veröffentlicht: (2023)

ECR-Chain: Advancing Generative Language Models to Better Emotion-Cause Reasoners through Reasoning Chains
von: Huang, Zhaopei, et al.
Veröffentlicht: (2024)

EconLogicQA: A Question-Answering Benchmark for Evaluating Large Language Models in Economic Sequential Reasoning
von: Quan, Yinzhu, et al.
Veröffentlicht: (2024)

A Closer Look at the Self-Verification Abilities of Large Language Models in Logical Reasoning
von: Hong, Ruixin, et al.
Veröffentlicht: (2023)

Implicit Reasoning in Large Language Models: A Comprehensive Survey
von: Li, Jindong, et al.
Veröffentlicht: (2025)

MONICA: Real-Time Monitoring and Calibration of Chain-of-Thought Sycophancy in Large Reasoning Models
von: Hu, Jingyu, et al.
Veröffentlicht: (2025)

MR-GSM8K: A Meta-Reasoning Benchmark for Large Language Model Evaluation
von: Zeng, Zhongshen, et al.
Veröffentlicht: (2023)

UGMathBench: A Diverse and Dynamic Benchmark for Undergraduate-Level Mathematical Reasoning with Large Language Models
von: Xu, Xin, et al.
Veröffentlicht: (2025)

StableToolBench: Towards Stable Large-Scale Benchmarking on Tool Learning of Large Language Models
von: Guo, Zhicheng, et al.
Veröffentlicht: (2024)

SocialMaze: A Benchmark for Evaluating Social Reasoning in Large Language Models
von: Xu, Zixiang, et al.
Veröffentlicht: (2025)

SpeechR: A Benchmark for Speech Reasoning in Large Audio-Language Models
von: Yang, Wanqi, et al.
Veröffentlicht: (2025)

EffiReason-Bench: A Unified Benchmark for Evaluating and Advancing Efficient Reasoning in Large Language Models
von: Huang, Junquan, et al.
Veröffentlicht: (2025)

ReliableMath: Benchmark of Reliable Mathematical Reasoning on Large Language Models
von: Xue, Boyang, et al.
Veröffentlicht: (2025)

Benchmarking Vision-Language Models on Chinese Ancient Documents: From OCR to Knowledge Reasoning
von: Yu, Haiyang, et al.
Veröffentlicht: (2025)

Revisiting the Reliability of Language Models in Instruction-Following
von: Dong, Jianshuo, et al.
Veröffentlicht: (2025)