Cover Image

CLEVER: A Curated Benchmark for Formally Verified Code Generation

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Thakur, Amitayush, Lee, Jasper, Tsoukalas, George, Sistla, Meghana, Zhao, Matthew, Zetzsche, Stefan, Durrett, Greg, Yue, Yisong, Chaudhuri, Swarat
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Artificial Intelligence Logic in Computer Science Programming Languages Software Engineering
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

ProofWala: A Framework for Multilingual Proof Data Synthesis and Theorem-Proving
by: Thakur, Amitayush, et al.
Published: (2025)

An In-Context Learning Agent for Formal Theorem-Proving
by: Thakur, Amitayush, et al.
Published: (2023)

PutnamBench: Evaluating Neural Theorem-Provers on the Putnam Mathematical Competition
by: Tsoukalas, George, et al.
Published: (2024)

Proving the Coding Interview: A Benchmark for Formally Verified Code Generation
by: Dougherty, Quinn, et al.
Published: (2025)

Dafny as Verification-Aware Intermediate Language for Code Generation
by: Li, Yue Chen, et al.
Published: (2025)

Learning Interestingness in Automated Mathematical Theory Formation
by: Tsoukalas, George, et al.
Published: (2025)

Towards Verified Code Reasoning by LLMs
by: Sistla, Meghana, et al.
Published: (2025)

VERINA: Benchmarking Verifiable Code Generation
by: Ye, Zhe, et al.
Published: (2025)

Separation Logic for Verifying Physical Collisions of CNC Programs
by: Lee, Yeonseok
Published: (2026)

Weighted Context-Free-Language Ordered Binary Decision Diagrams
by: Sistla, Meghana, et al.
Published: (2023)

CFLOBDDs: Context-Free-Language Ordered Binary Decision Diagrams
by: Sistla, Meghana, et al.
Published: (2022)

Preguss: It Analyzes, It Specifies, It Verifies
by: Wang, Zhongyi, et al.
Published: (2025)

Formal Analysis of the Sigmoid Function and Formal Proof of the Universal Approximation Theorem
by: Bryant, Dustin, et al.
Published: (2025)

A DPLL(T) Framework for Verifying Deep Neural Networks
by: Duong, Hai, et al.
Published: (2023)

Combining LLM Code Generation with Formal Specifications and Reactive Program Synthesis
by: Murphy, William, et al.
Published: (2024)

Correct-by-Construction G-Code Generation: A Neuro-Symbolic Approach via Separation Logic
by: Lee, Yeonseok
Published: (2026)

Verifying DNN-based Semantic Communication Against Generative Adversarial Noise
by: Le, Thanh, et al.
Published: (2026)

FormulaCode: Evaluating Agentic Optimization on Large Codebases
by: Sehgal, Atharva, et al.
Published: (2026)

Specification and Verification for Climate Modeling: Formalization Leading to Impactful Tooling
by: Altuntas, Alper, et al.
Published: (2025)

Vision: An Extensible Methodology for Formal Software Verification in Microservice Systems
by: Wojtak, Connor, et al.
Published: (2025)

Formalizing UML State Machines for Automated Verification -- A Survey
by: André, Étienne, et al.
Published: (2024)

Smart Contracts Formal Verification: A Systematic Literature Review
by: Davila, Rene, et al.
Published: (2025)

Proceedings of the 7th Workshop on Models for Formal Analysis of Real Systems
by: ter Beek, Maurice H., et al.
Published: (2026)

Quantifying Software Correctness by Combining Architecture Modeling and Formal Program Analysis
by: Lanzinger, Florian, et al.
Published: (2024)

Applying Formal Methods Tools to an Electronic Warfare Codebase (Experience report)
by: Li, Letitia W., et al.
Published: (2026)

ESBMC: A Survey of Its Evolution, Integration, and Future Directions in Formal Software Verification
by: Dantas, Pierre, et al.
Published: (2026)

A Tale of 1001 LoC: Potential Runtime Error-Guided Specification Synthesis for Verifying Large-Scale Programs
by: Wang, Zhongyi, et al.
Published: (2025)

VeriSoftBench: Repository-Scale Formal Verification Benchmarks for Lean
by: Xin, Yutong, et al.
Published: (2026)

Do CFLOBDDs Actually Make Use of Linear Structure?
by: Sistla, Meghana Aparna, et al.
Published: (2026)

Formal Verification of PLCs as a Service: A CERN-GSI Safety-Critical Case Study (extended version)
by: Lopez-Miguel, Ignacio D., et al.
Published: (2025)

Formal Modelling and Analysis of a Self-Adaptive Robotic System
by: Päßler, Juliane, et al.
Published: (2023)

ATLAS: Automated Toolkit for Large-Scale Verified Code Synthesis
by: Baksys, Mantas, et al.
Published: (2025)

Formal Model Guided Conformance Testing for Blockchains
by: Drobnjakovic, Filip, et al.
Published: (2025)

muRelBench: MicroBenchmarks for Zonotope Domains
by: Ballou, Kenny, et al.
Published: (2024)

AutoDeduct: A Tool for Automated Deductive Verification of C Code
by: Amilon, Jesper, et al.
Published: (2025)

LeanBET: Formally-verified surface area calculations in Lean
by: Ugwuanyi, Ejike D., et al.
Published: (2026)

Proceedings Sixth Workshop on Models for Formal Analysis of Real Systems
by: Lang, Frédéric, et al.
Published: (2024)

Proceedings 9th edition of Working Formal Methods Symposium
by: Arusoaie, Andrei, et al.
Published: (2025)

Modular Assurance of Complex Systems Using Contract-Based Design Principles
by: McGeorge, Dag, et al.
Published: (2024)

Formal Mathematical Reasoning: A New Frontier in AI
by: Yang, Kaiyu, et al.
Published: (2024)