LinAlg-Bench: A Forensic Benchmark Revealing Structural Failure Modes in LLM Mathematical Reasoning
Fuente:
arXiv
Guardado en:
| Autores principales: | Agarwal, Shradha, Rajbhar, Deepak, J, Tariq |
|---|---|
| Formato: | Preprint |
| Publicado: |
2026
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
Ejemplares similares
AlgBench: To What Extent Do Large Reasoning Models Understand Algorithms?
por: Sun, Henan, et al.
Publicado: (2026)
por: Sun, Henan, et al.
Publicado: (2026)
Mathematical Proof as a Litmus Test: Revealing Failure Modes of Advanced Large Reasoning Models
por: Guo, Dadi, et al.
Publicado: (2025)
por: Guo, Dadi, et al.
Publicado: (2025)
CombiBench: Benchmarking LLM Capability for Combinatorial Mathematics
por: Liu, Junqi, et al.
Publicado: (2025)
por: Liu, Junqi, et al.
Publicado: (2025)
LinTree: Improving LLM Reasoning with Explicitly Structured Search Histories
por: Kang, Liwei, et al.
Publicado: (2026)
por: Kang, Liwei, et al.
Publicado: (2026)
Riemann-Bench: A Benchmark for Moonshot Mathematics
por: Garre, Suhaas, et al.
Publicado: (2026)
por: Garre, Suhaas, et al.
Publicado: (2026)
AlgOS: Algorithm Operating System
por: Salt, Llewyn, et al.
Publicado: (2025)
por: Salt, Llewyn, et al.
Publicado: (2025)
ConstraintBench: Benchmarking LLM Constraint Reasoning on Direct Optimization
por: Tso, Joseph, et al.
Publicado: (2026)
por: Tso, Joseph, et al.
Publicado: (2026)
Revealing Interpretable Failure Modes of VLMs
por: Chaudhary, Isha, et al.
Publicado: (2026)
por: Chaudhary, Isha, et al.
Publicado: (2026)
Style Outweighs Substance: Failure Modes of LLM Judges in Alignment Benchmarking
por: Feuer, Benjamin, et al.
Publicado: (2024)
por: Feuer, Benjamin, et al.
Publicado: (2024)
Large Language Models and Mathematical Reasoning Failures
por: Boye, Johan, et al.
Publicado: (2025)
por: Boye, Johan, et al.
Publicado: (2025)
HeroBench: A Benchmark for Long-Horizon Planning and Structured Reasoning in Virtual Worlds
por: Anokhin, Petr, et al.
Publicado: (2025)
por: Anokhin, Petr, et al.
Publicado: (2025)
HiBench: Benchmarking LLMs Capability on Hierarchical Structure Reasoning
por: Jiang, Zhuohang, et al.
Publicado: (2025)
por: Jiang, Zhuohang, et al.
Publicado: (2025)
UGMathBench: A Diverse and Dynamic Benchmark for Undergraduate-Level Mathematical Reasoning with Large Language Models
por: Xu, Xin, et al.
Publicado: (2025)
por: Xu, Xin, et al.
Publicado: (2025)
SMH-Bench: Benchmarking LLM Agents for Environment-Grounded Reasoning and Action in Smart Homes
por: Li, Kuan, et al.
Publicado: (2026)
por: Li, Kuan, et al.
Publicado: (2026)
BenchHub: A Unified Benchmark Suite for Holistic and Customizable LLM Evaluation
por: Kim, Eunsu, et al.
Publicado: (2025)
por: Kim, Eunsu, et al.
Publicado: (2025)
T2S-Bench & Structure-of-Thought: Benchmarking and Prompting Comprehensive Text-to-Structure Reasoning
por: Wang, Qinsi, et al.
Publicado: (2026)
por: Wang, Qinsi, et al.
Publicado: (2026)
CAM-Bench: A Benchmark for Computational and Applied Mathematics in Lean
por: Long, Wentao, et al.
Publicado: (2026)
por: Long, Wentao, et al.
Publicado: (2026)
Unmasking Reasoning Processes: A Process-aware Benchmark for Evaluating Structural Mathematical Reasoning in LLMs
por: Zheng, Xiang, et al.
Publicado: (2026)
por: Zheng, Xiang, et al.
Publicado: (2026)
MorphoBench: A Benchmark with Difficulty Adaptive to Model Reasoning
por: Wang, Xukai, et al.
Publicado: (2025)
por: Wang, Xukai, et al.
Publicado: (2025)
KG-LLM-Bench: A Scalable Benchmark for Evaluating LLM Reasoning on Textualized Knowledge Graphs
por: Markowitz, Elan, et al.
Publicado: (2025)
por: Markowitz, Elan, et al.
Publicado: (2025)
Conversational Speech Reveals Structural Robustness Failures in SpeechLLM Backbones
por: Teleki, Maria, et al.
Publicado: (2025)
por: Teleki, Maria, et al.
Publicado: (2025)
IndiMathBench: Autoformalizing Mathematical Reasoning Problems with a Human Touch
por: Biyani, Param, et al.
Publicado: (2025)
por: Biyani, Param, et al.
Publicado: (2025)
MMR-Bench: A Comprehensive Benchmark for Multimodal LLM Routing
por: Ma, Haoxuan, et al.
Publicado: (2026)
por: Ma, Haoxuan, et al.
Publicado: (2026)
The Confidence Shortcut: A Reasoning Failure Mode of Masked Diffusion Models
por: Kim, Dueun, et al.
Publicado: (2026)
por: Kim, Dueun, et al.
Publicado: (2026)
NC-Bench: An LLM Benchmark for Evaluating Conversational Competence
por: Moore, Robert J., et al.
Publicado: (2026)
por: Moore, Robert J., et al.
Publicado: (2026)
Failure Modes in LLM Systems: A System-Level Taxonomy for Reliable AI Applications
por: Vinay, Vaishali
Publicado: (2025)
por: Vinay, Vaishali
Publicado: (2025)
ProcessBench: Identifying Process Errors in Mathematical Reasoning
por: Zheng, Chujie, et al.
Publicado: (2024)
por: Zheng, Chujie, et al.
Publicado: (2024)
GlobalDentBench: A Multinational Benchmark for Evaluating LLM Clinical Reasoning in Dentistry with Expert Calibration
por: Zhao, Junjie, et al.
Publicado: (2026)
por: Zhao, Junjie, et al.
Publicado: (2026)
FeynmanBench: Benchmarking Multimodal LLMs on Diagrammatic Physics Reasoning
por: Wang, Zeyu, et al.
Publicado: (2026)
por: Wang, Zeyu, et al.
Publicado: (2026)
AttuneBench: A Conversation-Based Benchmark for LLM Emotional Intelligence
por: Lubrano, Kate M., et al.
Publicado: (2026)
por: Lubrano, Kate M., et al.
Publicado: (2026)
LLMRouterBench: A Massive Benchmark and Unified Framework for LLM Routing
por: Li, Hao, et al.
Publicado: (2026)
por: Li, Hao, et al.
Publicado: (2026)
FrontierMath: A Benchmark for Evaluating Advanced Mathematical Reasoning in AI
por: Glazer, Elliot, et al.
Publicado: (2024)
por: Glazer, Elliot, et al.
Publicado: (2024)
RoMath: A Mathematical Reasoning Benchmark in Romanian
por: Cosma, Adrian, et al.
Publicado: (2024)
por: Cosma, Adrian, et al.
Publicado: (2024)
Real-Time Deadlines Reveal Temporal Awareness Failures in LLM Strategic Dialogues
por: Sehgal, Neil K. R., et al.
Publicado: (2026)
por: Sehgal, Neil K. R., et al.
Publicado: (2026)
ReactBench: A Benchmark for Topological Reasoning in MLLMs on Chemical Reaction Diagrams
por: Xu, Qiang, et al.
Publicado: (2026)
por: Xu, Qiang, et al.
Publicado: (2026)
FAM-Bench: A Multimodal Benchmark for Condition-Aware Food-as-Medicine Reasoning
por: Mao, Mingyang, et al.
Publicado: (2026)
por: Mao, Mingyang, et al.
Publicado: (2026)
VerifyBench: A Systematic Benchmark for Evaluating Reasoning Verifiers Across Domains
por: Li, Xuzhao, et al.
Publicado: (2025)
por: Li, Xuzhao, et al.
Publicado: (2025)
AISafetyBenchExplorer: A Metric-Aware Catalogue of AI Safety Benchmarks Reveals Fragmented Measurement and Weak Benchmark Governance
por: Solanke, Abiodun A.
Publicado: (2026)
por: Solanke, Abiodun A.
Publicado: (2026)
CXReasonBench: A Benchmark for Evaluating Structured Diagnostic Reasoning in Chest X-rays
por: Lee, Hyungyung, et al.
Publicado: (2025)
por: Lee, Hyungyung, et al.
Publicado: (2025)
OckBench: Measuring the Efficiency of LLM Reasoning
por: Du, Zheng, et al.
Publicado: (2025)
por: Du, Zheng, et al.
Publicado: (2025)
Ejemplares similares
-
AlgBench: To What Extent Do Large Reasoning Models Understand Algorithms?
por: Sun, Henan, et al.
Publicado: (2026) -
Mathematical Proof as a Litmus Test: Revealing Failure Modes of Advanced Large Reasoning Models
por: Guo, Dadi, et al.
Publicado: (2025) -
CombiBench: Benchmarking LLM Capability for Combinatorial Mathematics
por: Liu, Junqi, et al.
Publicado: (2025) -
LinTree: Improving LLM Reasoning with Explicitly Structured Search Histories
por: Kang, Liwei, et al.
Publicado: (2026) -
Riemann-Bench: A Benchmark for Moonshot Mathematics
por: Garre, Suhaas, et al.
Publicado: (2026)