Cover Image

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Davis, Joshua H., Nichols, Daniel, Khillan, Ishan, Bhatele, Abhinav
Format:	Preprint
Published:	2025
Subjects:	Distributed, Parallel, and Cluster Computing
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

HPC-Coder-V2: Studying Code LLMs Across Low-Resource Parallel Languages
by: Chaturvedi, Aman, et al.
Published: (2024)

HPC-Coder: Modeling Parallel Programs using Large Language Models
by: Nichols, Daniel, et al.
Published: (2023)

Can Large Language Models Write Parallel Code?
by: Nichols, Daniel, et al.
Published: (2024)

KEET: Explaining Performance of GPU Kernels Using LLM Agents
by: Davis, Joshua H., et al.
Published: (2026)

UniPar: A Unified LLM-Based Framework for Parallel and Accelerated Code Translation in HPC
by: Bitan, Tomer, et al.
Published: (2025)

Taking GPU Programming Models to Task for Performance Portability
by: Davis, Joshua H., et al.
Published: (2024)

Sarus Suite: Cloud-native Containers for HPC
by: Madonna, Alberto, et al.
Published: (2026)

Performance-Aligned LLMs for Generating Fast Code
by: Nichols, Daniel, et al.
Published: (2024)

Integrating Performance Tools in Model Reasoning for GPU Kernel Optimization
by: Nichols, Daniel, et al.
Published: (2025)

Automated Programmatic Performance Analysis of Parallel Programs
by: Cankur, Onur, et al.
Published: (2024)

Characterizing Production GPU Workloads using System-wide Telemetry Data
by: Cankur, Onur, et al.
Published: (2025)

LLMs as Packagers of HPC Software
by: Melone, Caetano, et al.
Published: (2025)

Preliminary report: Initial evaluation of StdPar implementations on AMD GPUs for HPC
by: Lin, Wei-Chen, et al.
Published: (2024)

ML-based Modeling to Predict I/O Performance on Different Storage Sub-systems
by: Xu, Yiheng, et al.
Published: (2023)

Analytics of Longitudinal System Monitoring Data for Performance Prediction
by: Costello, Ian J., et al.
Published: (2020)

Integrating and Characterizing HPC Task Runtime Systems for hybrid AI-HPC workloads
by: Merzky, Andre, et al.
Published: (2025)

TaPS: A Performance Evaluation Suite for Task-based Execution Frameworks
by: Pauloski, J. Gregory, et al.
Published: (2024)

Usability Evaluation of Cloud for HPC Applications
by: Sochat, Vanessa, et al.
Published: (2025)

Pipit: Scripting the analysis of parallel execution traces
by: Bhatele, Abhinav, et al.
Published: (2023)

Towards Experiment Execution in Support of Community Benchmark Workflows for HPC
by: von Laszewski, Gregor, et al.
Published: (2025)

A Performance Analysis of Task Scheduling for UQ Workflows on HPC Systems
by: Loi, Chung Ming, et al.
Published: (2025)

Optimizing Agentic Language Model Inference via Speculative Tool Calls
by: Nichols, Daniel, et al.
Published: (2025)

LLM & HPC:Benchmarking DeepSeek's Performance in High-Performance Computing Tasks
by: Nader, Noujoud, et al.
Published: (2025)

IOAgent: Democratizing Trustworthy HPC I/O Performance Diagnosis Capability via LLMs
by: Egersdoerfer, Chris, et al.
Published: (2026)

A Contention-Free Model for Converged Kubernetes on HPC
by: Sochat, Vanessa, et al.
Published: (2024)

HPC with Enhanced User Separation
by: Prout, Andrew, et al.
Published: (2024)

Kub: Enabling Elastic HPC Workloads on Containerized Environments
by: Medeiros, Daniel, et al.
Published: (2024)

Hybrid Quantum-HPC Solutions for Max-Cut: Bridging Classical and Quantum Algorithms
by: Patwardhan, Ishan, et al.
Published: (2024)

Evaluating Malleable Job Scheduling in HPC Clusters using Real-World Workloads
by: Zojer, Patrick, et al.
Published: (2026)

Understanding Layered Portability from HPC to Cloud in Containerized Environments
by: Medeiros, Daniel, et al.
Published: (2024)

Analysis of the carbon footprint of HPC
by: Benhari, Abdessalam, et al.
Published: (2025)

On the Challenges of Energy-Efficiency Analysis in HPC Systems: Evaluating Synthetic Benchmarks and Gromacs
by: Machado, Rafael Ravedutti Lucio, et al.
Published: (2025)

On the Convergence of Malleability and the HPC PowerStack: Exploiting Dynamism in Over-Provisioned and Power-Constrained HPC Systems
by: Arima, Eishi, et al.
Published: (2024)

Parallelizing Drug Discovery: HPC Pipelines for Alzheimer's Molecular Docking and Simulation
by: Alliata, Paul Ruiz, et al.
Published: (2025)

Energy-aware operation of HPC systems in Germany
by: Suarez, Estela, et al.
Published: (2024)

MRSch: Multi-Resource Scheduling for HPC
by: Li, Boyang, et al.
Published: (2024)

ARC-V: Vertical Resource Adaptivity for HPC Workloads in Containerized Environments
by: Medeiros, Daniel, et al.
Published: (2025)

Pandemics In Silico: Scaling an Agent-Based Simulation on Realistic Social Contact Networks
by: Kitson, Joy, et al.
Published: (2024)

UNR: Unified Notifiable RMA Library for HPC
by: Feng, Guangnan, et al.
Published: (2024)

An Elastic Job Scheduler for HPC Applications on the Cloud
by: Bhosale, Aditya, et al.
Published: (2025)