Saved in:
| Main Authors: | , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2512.11634 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866911316055162880 |
|---|---|
| author | Palme, Elia Dorsch, Juan Pablo Khosravi, Ali Pizzi, Giovanni Pagnamenta, Francesco Ceriani, Andrea Koutsaniti, Eirini Sarmiento, Rafael Bonesana, Ivano Dabin, Alejandro |
| author_facet | Palme, Elia Dorsch, Juan Pablo Khosravi, Ali Pizzi, Giovanni Pagnamenta, Francesco Ceriani, Andrea Koutsaniti, Eirini Sarmiento, Rafael Bonesana, Ivano Dabin, Alejandro |
| contents | Introducing FirecREST v2, the next generation of our open-source RESTful API for programmatic access to HPC resources. FirecREST v2 delivers a 100x performance improvement over its predecessor. This paper explores the lessons learned from redesigning FirecREST from the ground up, with a focus on integrating enhanced security and high throughput as core requirements.
We provide a detailed account of our systematic performance testing methodology, highlighting common bottlenecks in proxy-based APIs with intensive I/O operations. Key design and architectural changes that enabled these performance gains are presented. Finally, we demonstrate the impact of these improvements, supported by independent peer validation, and discuss opportunities for further improvements. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2512_11634 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | FirecREST v2: lessons learned from redesigning an API for scalable HPC resource access Palme, Elia Dorsch, Juan Pablo Khosravi, Ali Pizzi, Giovanni Pagnamenta, Francesco Ceriani, Andrea Koutsaniti, Eirini Sarmiento, Rafael Bonesana, Ivano Dabin, Alejandro Distributed, Parallel, and Cluster Computing Introducing FirecREST v2, the next generation of our open-source RESTful API for programmatic access to HPC resources. FirecREST v2 delivers a 100x performance improvement over its predecessor. This paper explores the lessons learned from redesigning FirecREST from the ground up, with a focus on integrating enhanced security and high throughput as core requirements. We provide a detailed account of our systematic performance testing methodology, highlighting common bottlenecks in proxy-based APIs with intensive I/O operations. Key design and architectural changes that enabled these performance gains are presented. Finally, we demonstrate the impact of these improvements, supported by independent peer validation, and discuss opportunities for further improvements. |
| title | FirecREST v2: lessons learned from redesigning an API for scalable HPC resource access |
| topic | Distributed, Parallel, and Cluster Computing |
| url | https://arxiv.org/abs/2512.11634 |