Cover Image

Mathematics and Coding are Universal AI Benchmarks

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Chojecki, Przemyslaw
Format:	Preprint
Published:	2025
Subjects:	Artificial Intelligence Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Self-Improving AI Agents through Self-Play
by: Chojecki, Przemyslaw
Published: (2025)

The Geometry of Benchmarks: A New Path Toward AGI
by: Chojecki, Przemyslaw
Published: (2025)

Psychometric Tests for AI Agents and Their Moduli Space
by: Chojecki, Przemyslaw
Published: (2025)

An Operational Kardashev-Style Scale for Autonomous AI - Towards AGI and Superintelligence
by: Chojecki, Przemyslaw
Published: (2025)

Model Science: getting serious about verification, explanation and control of AI systems
by: Biecek, Przemyslaw, et al.
Published: (2025)

On the Mathematical Impossibility of Safe Universal Approximators
by: Yao, Jasper
Published: (2025)

HARDMath: A Benchmark Dataset for Challenging Problems in Applied Mathematics
by: Fan, Jingxuan, et al.
Published: (2024)

FormalMATH: Benchmarking Formal Mathematical Reasoning of Large Language Models
by: Yu, Zhouliang, et al.
Published: (2025)

An Investigation of Robustness of LLMs in Mathematical Reasoning: Benchmarking with Mathematically-Equivalent Transformation of Advanced Mathematical Problems
by: Hao, Yuren, et al.
Published: (2025)

FormInv: A Measurement Protocol for Semantic Invariance in Mathematical Reasoning Benchmarks
by: Thomas, Nishal, et al.
Published: (2026)

The Little Book of Generative AI Foundations: An Intuitive Mathematical Primer
by: Chen, Tianhua
Published: (2026)

The Nature of Mathematical Modeling and Probabilistic Optimization Engineering in Generative AI
by: Li, Fulu
Published: (2024)

Beyond Backpropagation: Exploring Innovative Algorithms for Energy-Efficient Deep Neural Network Training
by: Spyra, Przemysław
Published: (2025)

HARDMath2: A Benchmark for Applied Mathematics Built by Students as Part of a Graduate Class
by: Roggeveen, James V., et al.
Published: (2025)

VAR-MATH: Probing True Mathematical Reasoning in LLMS via Symbolic Multi-Instance Benchmarks
by: Yao, Jian, et al.
Published: (2025)

Exploring Local Explanations of Nonlinear Models Using Animated Linear Projections
by: Spyrison, Nicholas, et al.
Published: (2022)

Attributions All the Way Down? The Metagame of Interpretability
by: Baniecki, Hubert, et al.
Published: (2026)

Parity, Sensitivity, and Transformers
by: Kozachinskiy, Alexander, et al.
Published: (2026)

I-RAVEN-X: Benchmarking Generalization and Robustness of Analogical and Mathematical Reasoning in Large Language and Reasoning Models
by: Camposampiero, Giacomo, et al.
Published: (2025)

AIDE: AI-Driven Exploration in the Space of Code
by: Jiang, Zhengyao, et al.
Published: (2025)

The Agentic Researcher: A Practical Guide to AI-Assisted Research in Mathematics and Machine Learning
by: Zimmer, Max, et al.
Published: (2026)

SBSC: Step-By-Step Coding for Improving Mathematical Olympiad Performance
by: Singh, Kunal, et al.
Published: (2025)

AI Agents as Universal Task Solvers
by: Achille, Alessandro, et al.
Published: (2025)

Universal AI maximizes Variational Empowerment
by: Hayashi, Yusuke, et al.
Published: (2025)

BAID: A Benchmark for Bias Assessment of AI Detectors
by: Basu, Priyam, et al.
Published: (2025)

Towards AI Transparency and Accountability: A Global Framework for Exchanging Information on AI Systems
by: Buckley, Warren, et al.
Published: (2023)

KnowCoder: Coding Structured Knowledge into LLMs for Universal Information Extraction
by: Li, Zixuan, et al.
Published: (2024)

Democratizing AI scientists using ToolUniverse
by: Gao, Shanghua, et al.
Published: (2025)

REBEL: Hidden Knowledge Recovery via Evolutionary-Based Evaluation Loop
by: Rybak, Patryk, et al.
Published: (2026)

Position: Explain to Question not to Justify
by: Biecek, Przemyslaw, et al.
Published: (2024)

Benchmarking is Broken -- Don't Let AI be its Own Judge
by: Cheng, Zerui, et al.
Published: (2025)

A Benchmark of Causal vs. Correlation AI for Predictive Maintenance
by: Dhande, Shaunak, et al.
Published: (2025)

miniCodeProps: a Minimal Benchmark for Proving Code Properties
by: Lohn, Evan, et al.
Published: (2024)

DotaMath: Decomposition of Thought with Code Assistance and Self-correction for Mathematical Reasoning
by: Li, Chengpeng, et al.
Published: (2024)

Delulu: A Verified Multi-Lingual Benchmark for Code Hallucination Detection in Fill-in-the-Middle Tasks
by: Erfanian, Mahdi, et al.
Published: (2026)

Solving a Research Problem in Mathematical Statistics with AI Assistance
by: Dobriban, Edgar
Published: (2025)

BEExAI: Benchmark to Evaluate Explainable AI
by: Sithakoul, Samuel, et al.
Published: (2024)

Mathematical Models of Computation in Superposition
by: Hänni, Kaarel, et al.
Published: (2024)

MathlibLemma: Folklore Lemma Generation and Benchmark for Formal Mathematics
by: Liu, Xinyu, et al.
Published: (2026)

BetterBench: Assessing AI Benchmarks, Uncovering Issues, and Establishing Best Practices
by: Reuel, Anka, et al.
Published: (2024)