Imagen de Portada

Evaluating Frontier LLMs on PhD-Level Mathematical Reasoning: A Benchmark on a Textbook in Theoretical Computer Science about Randomized Algorithms

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Cao, Yang, Chen, Yubin, Guo, Xuyang, Song, Zhao, Yue, Song, Zhang, Jiahao, Zhao, Jiale
Formato:	Preprint
Publicado:	2025
Materias:	Artificial Intelligence
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

T2VWorldBench: A Benchmark for Evaluating World Knowledge in Text-to-Video Generation
por: Chen, Yubin, et al.
Publicado: (2025)

Benchmarking PhD-Level Coding in 3D Geometric Computer Vision
por: Li, Wenyi, et al.
Publicado: (2026)

T2VTextBench: A Human Evaluation Benchmark for Textual Control in Video Generation Models
por: Guo, Xuyang, et al.
Publicado: (2025)

T2VPhysBench: A First-Principles Benchmark for Physical Consistency in Text-to-Video Generation
por: Guo, Xuyang, et al.
Publicado: (2025)

The Ph.D. in Library Science
por: Richmond, Phyllis A.
Publicado: (1970)

Opinions of Library Science PhD's About Requirements for the PhD Degree in Library Science
por: Slavens, Thomas P.
Publicado: (1969)

Too Easily Fooled? Prompt Injection Breaks LLMs on Frustratingly Simple Multiple-Choice Questions
por: Guo, Xuyang, et al.
Publicado: (2025)

Quantifying and Documenting Inequity in PhD-granting Mathematical Sciences Departments in the United States
por: Buckmire, Ron, et al.
Publicado: (2023)

Why do women pursue a PhD in Computer Science?
por: Ábrahám, Erika, et al.
Publicado: (2025)

The impact of Ph.D., funding, and continued publications by Sports Sciences PhDs, 1-year post PhD-Defence
por: Vicenç HERNANDEZ-GONZALEZ
Publicado: (2022)

Which Coauthor Should I Nominate in My 99 ICLR Submissions? A Mathematical Analysis of the ICLR 2026 Reciprocal Reviewer Nomination Policy
por: Song, Zhao, et al.
Publicado: (2025)

Fundamental Limits of Crystalline Equivariant Graph Neural Networks: A Circuit Complexity Perspective
por: Cao, Yang, et al.
Publicado: (2025)

Thinking Isn't an Illusion: Overcoming the Limitations of Reasoning Models via Tool Augmentations
por: Song, Zhao, et al.
Publicado: (2025)

Towards High-Order Mean Flow Generative Models: Feasibility, Expressivity, and Provably Efficient Criteria
por: Cao, Yang, et al.
Publicado: (2025)

PhD Platform
Publicado: (2026)

Surviving your PhD: Challenges and best practices in PhD wellbeing
por: Kis, Andrea
Publicado: (2026)

Can You Count to Nine? A Human Evaluation Benchmark for Counting Limits in Modern Text-to-Video Models
por: Guo, Xuyang, et al.
Publicado: (2025)

Survey of Library Science Ph.D. Graduates of Three Universities.
por: Hunt, Mary Alice, et al.
Publicado: (1979)

Research Competence for Ph.D. Students in Library and Information Science.
por: Powell, Ronald R.
Publicado: (1995)

PhD thesis Code
por: Ilich, Adrian
Publicado: (2026)

Projet PhD 9
por: De Matos
Publicado: (2026)

Dataset for PhD Thesis
por: Gruber, Roman
Publicado: (2025)

The Experience of Examining the PhD
Publicado: (2025)

Girishkumar Kumaran, PhD
por: Girishkumar Kumaran
Publicado: (2024)

Designing and Evaluating the Pedagogy of an Online Review Genre Writing Course for PhD Candidates
por: Xiuwen Zhai, et al.
Publicado: (2026)

FrontierMath: A Benchmark for Evaluating Advanced Mathematical Reasoning in AI
por: Glazer, Elliot, et al.
Publicado: (2024)

Beyond Classical Attention: Quantum Attention for Scalable Computation
por: Guo, Xuyang, et al.
Publicado: (2023)

When a Paper Has 1000 Authors: Rethinking Citation Metrics in the Era of LLMs
por: Guo, Weihang, et al.
Publicado: (2025)

Benchmarking LLMs' Mathematical Reasoning with Unseen Random Variables Questions
por: Hong, Zijin, et al.
Publicado: (2025)

Mahmoud PhD Steps & results
por: Badry, Mahmoud
Publicado: (2026)

Katherine M. Hyland, PhD
Publicado: (2024)

Linda M. Woolf, Ph.D.
por: Valerie A. Canady
Publicado: (2025)

HERNAN GARCES, IGP, PhD
por: Michel Hermelin
Publicado: (2006)

Data from PhD thesis
por: Strahl, Julia
Publicado: (2011)

Citation Analysis of Ph.D. Theses at Faculty of Science, University of Ibadan, Nigeria
por: Salami, Malik Oyewale, et al.
Publicado: (2018)

Your Vision-Language Model Can't Even Count to 20: Exposing the Failures of VLMs in Compositional Counting
por: Guo, Xuyang, et al.
Publicado: (2025)

Discrete Mathematics & Theoretical Computer Science
Publicado: (2004)

Structured and Fast Optimization: The Kronecker SGD Algorithm
por: Song, Zhao, et al.
Publicado: (2023)

Formal Mathematical Reasoning: A New Frontier in AI
por: Yang, Kaiyu, et al.
Publicado: (2024)

Cytoskeleton Spotlight: Yuan Ren, PhD
por: Yuan Ren
Publicado: (2025)