Imagen de Portada

An Agentic Evaluation Framework for AI-Generated Scientific Code in PETSc

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Zhang, Hong, Smith, Barry, Balay, Satish, Chen, Le, Keceli, Murat, McInnes, Lois Curfman, Zhang, Junchao
Formato:	Preprint
Publicado:	2026
Materias:	Artificial Intelligence
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

AI Assistants to Enhance and Exploit the PETSc Knowledge Base
por: Smith, Barry, et al.
Publicado: (2025)

Toward a Cohesive AI and Simulation Software Ecosystem for Scientific Innovation
por: Heroux, Michael A., et al.
Publicado: (2024)

PETSc/TAO Developments for GPU-Based Early Exascale Systems
por: Mills, Richard Tran, et al.
Publicado: (2024)

ChemGraph: An Agentic Framework for Computational Chemistry Workflows
por: Pham, Thang D., et al.
Publicado: (2025)

Reconciling Inflation with Hubble Anisotropies
por: McInnes, Brett
Publicado: (2025)

Evidence that the Rate of Evolution of a Black Hole Interior Has a Holographic Dual
por: McInnes, Brett
Publicado: (2023)

Intrinsic Torsion, Extrinsic Torsion, and the Hubble Parameter
por: McInnes, Brett
Publicado: (2024)

Superradiance in the Bulk Protects Quantum State Evolution of Rapidly Rotating Matter on the Boundary
por: McInnes, Brett
Publicado: (2024)

ChemGraph-XANES: An Agentic Framework for XANES Simulation and Analysis
por: Grizzi, Vitor F., et al.
Publicado: (2026)

Agentic Code Reasoning
por: Ugare, Shubham, et al.
Publicado: (2026)

Stellar engines and Dyson bubbles can be stable
por: McInnes, Colin R
Publicado: (2026)

Ringworlds and Dyson spheres can be stable
por: McInnes, Colin R
Publicado: (2025)

TusoAI: Agentic Optimization for Scientific Methods
por: Turcan, Alistair, et al.
Publicado: (2025)

Brain-Inspired AI with Hyperbolic Geometry
por: Joseph, Alexander, et al.
Publicado: (2024)

Improving Mapper's Robustness by Varying Resolution According to Lens-Space Density
por: Ruscitti, Kaleb D., et al.
Publicado: (2024)

Merged ChemProt-DrugProt for Relation Extraction from Biomedical Literature
por: Nguyen, Mai H., et al.
Publicado: (2024)

EAIRA: Establishing a Methodology for Evaluating AI Models as Scientific Research Assistants
por: Cappello, Franck, et al.
Publicado: (2025)

Holistic Evaluation of State-of-the-Art LLMs for Code Generation
por: Zhang, Le, et al.
Publicado: (2025)

SciHorizon-DataEVA: An Agentic System for AI-Readiness Evaluation of Heterogeneous Scientific Data
por: Liu, Dianyu, et al.
Publicado: (2026)

Persistent Multiscale Density-based Clustering
por: Bot, Daniël, et al.
Publicado: (2025)

GCM Simulations of Eastern Australian Cutoff Lows
por: Jack J. Katzfey and Kathleen L. McInnes
Publicado: (1996)

SR-Scientist: Scientific Equation Discovery With Agentic AI
por: Xia, Shijie, et al.
Publicado: (2025)

The AI Scientific Community: Agentic Virtual Lab Swarms
por: Braga-Neto, Ulisses
Publicado: (2026)

Agentic AI Scientists Are Not Built For Autonomous Scientific Discovery
por: Bisht, Harshit, et al.
Publicado: (2026)

Agentic Design Patterns: A System-Theoretic Framework
por: Dao, Minh-Dung, et al.
Publicado: (2026)

BibAgent: An Agentic Framework for Traceable Miscitation Detection in Scientific Literature
por: Li, Peiran, et al.
Publicado: (2026)

SciNav: A General Agent Framework for Scientific Coding Tasks
por: Zhang, Tianshu, et al.
Publicado: (2026)

PRiSM: An Agentic Multimodal Benchmark for Scientific Reasoning via Python-Grounded Evaluation
por: Imani, Shima, et al.
Publicado: (2025)

TRACE: A Conversational Framework for Sustainable Tourism Recommendation with Agentic Counterfactual Explanations
por: Banerjee, Ashmi, et al.
Publicado: (2026)

Collab-REC: An LLM-based Agentic Framework for Balancing Recommendations in Tourism
por: Banerjee, Ashmi, et al.
Publicado: (2025)

BloClaw: An Omniscient, Multi-Modal Agentic Workspace for Next-Generation Scientific Discovery
por: Qin, Yao, et al.
Publicado: (2026)

Memorize or Generalize? Evaluating LLM Code Generation with Code Rewriting
por: Zhang, Lizhe, et al.
Publicado: (2025)

InteractScience: Programmatic and Visually-Grounded Evaluation of Interactive Scientific Demonstration Code Generation
por: Chen, Qiaosheng, et al.
Publicado: (2025)

The Auton Agentic AI Framework
por: Cao, Sheng, et al.
Publicado: (2026)

Vibe Coding vs. Agentic Coding: Fundamentals and Practical Implications of Agentic AI
por: Sapkota, Ranjan, et al.
Publicado: (2025)

FlyAOC: Evaluating Agentic Ontology Curation of Drosophila Scientific Knowledge Bases
por: Zhang, Xingjian, et al.
Publicado: (2026)

CodeDistiller: Automatically Generating Code Libraries for Scientific Coding Agents
por: Jansen, Peter, et al.
Publicado: (2025)

Evaluating Agentic AI in the Wild: Failure Modes, Drift Patterns, and a Production Evaluation Framework
por: Pandey, Mukund
Publicado: (2026)

InternAgent-1.5: A Unified Agentic Framework for Long-Horizon Autonomous Scientific Discovery
por: Feng, Shiyang, et al.
Publicado: (2026)

An Agentic AI Framework for Training General Practitioner Student Skills
por: De Marez, Victor, et al.
Publicado: (2025)