Copertina

FormalMATH: Benchmarking Formal Mathematical Reasoning of Large Language Models

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Yu, Zhouliang, Peng, Ruotian, Ding, Keyi, Li, Yizhe, Peng, Zhongyuan, Liu, Minghao, Zhang, Yifan, Yuan, Zheng, Xin, Huajian, Huang, Wenhao, Wen, Yandong, Zhang, Ge, Liu, Weiyang
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Artificial Intelligence Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

SimKO: Simple Pass@K Policy Optimization
di: Peng, Ruotian, et al.
Pubblicazione: (2025)

CriticLean: Critic-Guided Reinforcement Learning for Mathematical Formalization
di: Peng, Zhongyuan, et al.
Pubblicazione: (2025)

PEFT-Arena: Understanding Parameter-Efficient Finetuning from a Stability-Plasticity Perspective
di: Huang, Yangyi, et al.
Pubblicazione: (2026)

InfinityMATH: A Scalable Instruction Tuning Dataset in Programmatic Mathematical Reasoning
di: Zhang, Bo-Wen, et al.
Pubblicazione: (2024)

MathlibLemma: Folklore Lemma Generation and Benchmark for Formal Mathematics
di: Liu, Xinyu, et al.
Pubblicazione: (2026)

MathlibPR: Pull Request Merge-Readiness Benchmark for Formal Mathematical Libraries
di: Xie, Zixuan, et al.
Pubblicazione: (2026)

Model Merging with Functional Dual Anchors
di: Shi, Kexuan, et al.
Pubblicazione: (2025)

Omni-MATH: A Universal Olympiad Level Mathematic Benchmark For Large Language Models
di: Gao, Bofei, et al.
Pubblicazione: (2024)

Patch Matters: Training-free Fine-grained Image Caption Enhancement via Local Perception
di: Peng, Ruotian, et al.
Pubblicazione: (2025)

Safe: Enhancing Mathematical Reasoning in Large Language Models via Retrospective Step-aware Formal Verification
di: Liu, Chengwu, et al.
Pubblicazione: (2025)

Measuring Multimodal Mathematical Reasoning with MATH-Vision Dataset
di: Wang, Ke, et al.
Pubblicazione: (2024)

FMC: Formalization of Natural Language Mathematical Competition Problems
di: Xie, Jiaxuan, et al.
Pubblicazione: (2025)

MSC-180: A Benchmark for Automated Formal Theorem Proving from Mathematical Subject Classification
di: Li, Sirui, et al.
Pubblicazione: (2025)

M2F: Automated Formalization of Mathematical Literature at Scale
di: Wang, Zichen, et al.
Pubblicazione: (2026)

Advocate for Complete Benchmarks for Formal Reasoning with Formal/Informal Statements and Formal/Informal Proofs
di: Yousefzadeh, Roozbeh, et al.
Pubblicazione: (2025)

DeepSeek-Prover-V2: Advancing Formal Mathematical Reasoning via Reinforcement Learning for Subgoal Decomposition
di: Ren, Z. Z., et al.
Pubblicazione: (2025)

MATH-Perturb: Benchmarking LLMs' Math Reasoning Abilities against Hard Perturbations
di: Huang, Kaixuan, et al.
Pubblicazione: (2025)

VAR-MATH: Probing True Mathematical Reasoning in LLMS via Symbolic Multi-Instance Benchmarks
di: Yao, Jian, et al.
Pubblicazione: (2025)

Conjecturing: An Overlooked Step in Formal Mathematical Reasoning
di: Sivakumar, Jasivan Alex, et al.
Pubblicazione: (2025)

Formal Conjectures: An Open and Evolving Benchmark for Verified Discovery in Mathematics
di: Firsching, Moritz, et al.
Pubblicazione: (2026)

Feint Behaviors and Strategies: Formalization, Implementation and Evaluation
di: Liu, Junyu, et al.
Pubblicazione: (2024)

Generating Symbolic World Models via Test-time Scaling of Large Language Models
di: Yu, Zhouliang, et al.
Pubblicazione: (2025)

APE-Bench: Evaluating Automated Proof Engineering for Formal Math Libraries
di: Xin, Huajian, et al.
Pubblicazione: (2025)

FormalML: A Benchmark for Evaluating Formal Subgoal Completion in Machine Learning Theory
di: Yang, Xiao-Wen, et al.
Pubblicazione: (2025)

Beyond Gold Standards: Epistemic Ensemble of LLM Judges for Formal Mathematical Reasoning
di: Zhang, Lan, et al.
Pubblicazione: (2025)

Formal Mathematical Reasoning: A New Frontier in AI
di: Yang, Kaiyu, et al.
Pubblicazione: (2024)

Artificial Intelligence, Formal Methods, and Mathematical Reasoning (NSF)
Pubblicazione: (2024)

Formalizing Mathematics at Scale
di: Rammal, Ahmad, et al.
Pubblicazione: (2026)

U-MATH: A University-Level Benchmark for Evaluating Mathematical Skills in LLMs
di: Chernyshev, Konstantin, et al.
Pubblicazione: (2024)

Numina-Lean-Agent: An Open and General Agentic Reasoning System for Formal Mathematics
di: Liu, Junqi, et al.
Pubblicazione: (2026)

Leanabell-Prover: Posttraining Scaling in Formal Reasoning
di: Zhang, Jingyuan, et al.
Pubblicazione: (2025)

KisMATH: Do LLMs Have Knowledge of Implicit Structures in Mathematical Reasoning?
di: Saha, Soumadeep, et al.
Pubblicazione: (2025)

Mathematical Opportunities in Digital Twins (MATH-DT)
di: Antil, Harbir
Pubblicazione: (2024)

Let's Reason Formally: Natural-Formal Hybrid Reasoning Enhances LLM's Math Capability
di: Wang, Ruida, et al.
Pubblicazione: (2025)

Rethinking Wireless Communications through Formal Mathematical AI Reasoning
di: Zhao, Changyuan, et al.
Pubblicazione: (2026)

KOR-Bench: Benchmarking Language Models on Knowledge-Orthogonal Reasoning Tasks
di: Ma, Kaijing, et al.
Pubblicazione: (2024)

MV-MATH: Evaluating Multimodal Math Reasoning in Multi-Visual Contexts
di: Wang, Peijie, et al.
Pubblicazione: (2025)

NeuroCore™: Mathematical Formalization
di: Nicoletti, Davide Luca
Pubblicazione: (2026)

MATH-PT: A Math Reasoning Benchmark for European and Brazilian Portuguese
di: Teixeira, Tiago, et al.
Pubblicazione: (2026)

Formalizing Feint Actions, and Example Studies in Two-Player Games
di: Liu, Junyu, et al.
Pubblicazione: (2024)