Imagen de Portada

Benchmarking LLMs' Mathematical Reasoning with Unseen Random Variables Questions

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Hong, Zijin, Wu, Hao, Dong, Su, Dong, Junnan, Xiao, Yilin, Zhang, Yujing, Wang, Zhu, Huang, Feiran, Li, Linyi, Yang, Hongxia, Huang, Xiao
Formato:	Preprint
Publicado:	2025
Materias:	Computation and Language Artificial Intelligence
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Next-Generation Database Interfaces: A Survey of LLM-based Text-to-SQL
por: Hong, Zijin, et al.
Publicado: (2024)

CLR-Bench: Evaluating Large Language Models in College-level Reasoning
por: Dong, Junnan, et al.
Publicado: (2024)

Structure Guided Large Language Model for SQL Generation
por: Zhang, Qinggang, et al.
Publicado: (2024)

Knowledge-to-SQL: Enhancing SQL Generation with Data Expert LLM
por: Hong, Zijin, et al.
Publicado: (2024)

GraphRAG-Bench: Challenging Domain-Specific Reasoning for Evaluating Graph Retrieval-Augmented Generation
por: Xiao, Yilin, et al.
Publicado: (2025)

Knapsack Optimization-based Schema Linking for LLM-based Text-to-SQL Generation
por: Yuan, Zheng, et al.
Publicado: (2025)

Cost-efficient Knowledge-based Question Answering with Large Language Models
por: Dong, Junnan, et al.
Publicado: (2024)

LAG: Logic-Augmented Generation from a Cartesian Perspective
por: Xiao, Yilin, et al.
Publicado: (2025)

A Survey of Graph Retrieval-Augmented Generation for Customized Large Language Models
por: Zhang, Qinggang, et al.
Publicado: (2025)

ErrorLLM: Modeling SQL Errors for Text-to-SQL Refinement
por: Hong, Zijin, et al.
Publicado: (2026)

MathHay: An Automated Benchmark for Long-Context Mathematical Reasoning in LLMs
por: Wang, Lei, et al.
Publicado: (2024)

Benchmarking Retrieval-Augmented Multimodal Generation for Document Question Answering
por: Dong, Kuicai, et al.
Publicado: (2025)

Modality-Aware Integration with Large Language Models for Knowledge-based Visual Question Answering
por: Dong, Junnan, et al.
Publicado: (2024)

MCEval: A Dynamic Framework for Fair Multilingual Cultural Evaluation of LLMs
por: Huang, Shulin, et al.
Publicado: (2025)

Towards Better Question Generation in QA-based Event Extraction
por: Hong, Zijin, et al.
Publicado: (2024)

Use Graph When It Needs: Efficiently and Adaptively Integrating Retrieval-Augmented Generation with Graphs
por: Dong, Su, et al.
Publicado: (2026)

HERMES: Towards Efficient and Verifiable Mathematical Reasoning in LLMs
por: Ospanov, Azim, et al.
Publicado: (2025)

KnowGPT: Knowledge Graph based Prompting for Large Language Models
por: Zhang, Qinggang, et al.
Publicado: (2023)

ChartMind: A Comprehensive Benchmark for Complex Real-world Multimodal Chart Question Answering
por: Wei, Jingxuan, et al.
Publicado: (2025)

LinearRAG: Linear Graph Retrieval Augmented Generation on Large-scale Corpora
por: Zhuang, Luyao, et al.
Publicado: (2025)

An Investigation of Robustness of LLMs in Mathematical Reasoning: Benchmarking with Mathematically-Equivalent Transformation of Advanced Mathematical Problems
por: Hao, Yuren, et al.
Publicado: (2025)

When to use Graphs in RAG: A Comprehensive Analysis for Graph Retrieval-Augmented Generation
por: Xiang, Zhishang, et al.
Publicado: (2025)

Unconstrained Model Merging for Enhanced LLM Reasoning
por: Zhang, Yiming, et al.
Publicado: (2024)

Evaluating LLMs' Mathematical Reasoning in Financial Document Question Answering
por: Srivastava, Pragya, et al.
Publicado: (2024)

RepLiQA: A Question-Answering Dataset for Benchmarking LLMs on Unseen Reference Content
por: Monteiro, Joao, et al.
Publicado: (2024)

Reliable Reasoning Path: Distilling Effective Guidance for LLM Reasoning with Knowledge Graphs
por: Xiao, Yilin, et al.
Publicado: (2025)

GenDec: A robust generative Question-decomposition method for Multi-hop reasoning
por: Wu, Jian, et al.
Publicado: (2024)

Entity Alignment with Noisy Annotations from Large Language Models
por: Chen, Shengyuan, et al.
Publicado: (2024)

Quantization Meets Reasoning: Exploring LLM Low-Bit Quantization Degradation for Mathematical Reasoning
por: Li, Zhen, et al.
Publicado: (2025)

HNCSE: Advancing Sentence Embeddings via Hybrid Contrastive Learning with Hard Negatives
por: Liu, Wenxiao, et al.
Publicado: (2024)

ChartReasoner: Code-Driven Modality Bridging for Long-Chain Reasoning in Chart Question Answering
por: Jia, Caijun, et al.
Publicado: (2025)

TableEval: A Real-World Benchmark for Complex, Multilingual, and Multi-Structured Table Question Answering
por: Zhu, Junnan, et al.
Publicado: (2025)

LogicPoison: Logical Attacks on Graph Retrieval-Augmented Generation
por: Xiao, Yilin, et al.
Publicado: (2026)

CMMU: A Benchmark for Chinese Multi-modal Multi-type Question Understanding and Reasoning
por: He, Zheqi, et al.
Publicado: (2024)

Are Your LLMs Capable of Stable Reasoning?
por: Liu, Junnan, et al.
Publicado: (2024)

Each Graph is a New Language: Graph Learning with LLMs
por: Zhou, Huachi, et al.
Publicado: (2025)

Are LLMs Capable of Data-based Statistical and Causal Reasoning? Benchmarking Advanced Quantitative Reasoning with Data
por: Liu, Xiao, et al.
Publicado: (2024)

Reasoning as State Transition: A Representational Analysis of Reasoning Evolution in Large Language Models
por: Zhang, Siyuan, et al.
Publicado: (2026)

STAIR: Improving Safety Alignment with Introspective Reasoning
por: Zhang, Yichi, et al.
Publicado: (2025)

MedEthicsQA: A Comprehensive Question Answering Benchmark for Medical Ethics Evaluation of LLMs
por: Wei, Jianhui, et al.
Publicado: (2025)