LiveFMBench: Unveiling the Power and Limits of Agentic Workflows in Specification Generation

Documenti analoghi

• DOMAINEVAL: An Auto-Constructed Benchmark for Multi-Domain Code Generation
  di: Zhu, Qiming, et al.
  Pubblicazione: (2024)
• CRUXEval-X: A Benchmark for Multilingual Code Reasoning, Understanding and Execution
  di: Xu, Ruiyang, et al.
  Pubblicazione: (2024)
• Across Programming Language Silos: A Study on Cross-Lingual Retrieval-augmented Code Generation
  di: Zhu, Qiming, et al.
  Pubblicazione: (2025)
• Enchanting Program Specification Synthesis by Large Language Models using Static Analysis and Program Verification
  di: Wen, Cheng, et al.
  Pubblicazione: (2024)
• From Informal to Formal -- Incorporating and Evaluating LLMs on Natural Language Requirements to Verifiable Formal Proofs
  di: Cao, Jialun, et al.
  Pubblicazione: (2025)