400Gbps benchmark of XRootD HTTP-TPC
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2023
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866912413309206528 |
|---|---|
| author | Arora, Aashay Guiang, Jonathan Davila, Diego Würthwein, Frank Balcas, Justas Newman, Harvey |
| author_facet | Arora, Aashay Guiang, Jonathan Davila, Diego Würthwein, Frank Balcas, Justas Newman, Harvey |
| contents | Due to the increased demand of network traffic expected during the HL-LHC era, the T2 sites in the USA will be required to have 400Gbps of available bandwidth to their storage solution. With the above in mind we are pursuing a scale test of XRootD software when used to perform Third Party Copy transfers using the HTTP protocol. Our main objective is to understand the possible limitations in the software stack to achieve the target transfer rate; to that end we have set up a testbed of multiple XRootD servers in both UCSD and Caltech which are connected through a dedicated link capable of 400 Gbps end-to-end. Building upon our experience deploying containerized XRootD servers, we use Kubernetes to easily deploy and test different configurations of our testbed. In this work, we will present our experience doing these tests and the lessons learned. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2312_12589 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | 400Gbps benchmark of XRootD HTTP-TPC Arora, Aashay Guiang, Jonathan Davila, Diego Würthwein, Frank Balcas, Justas Newman, Harvey Networking and Internet Architecture Due to the increased demand of network traffic expected during the HL-LHC era, the T2 sites in the USA will be required to have 400Gbps of available bandwidth to their storage solution. With the above in mind we are pursuing a scale test of XRootD software when used to perform Third Party Copy transfers using the HTTP protocol. Our main objective is to understand the possible limitations in the software stack to achieve the target transfer rate; to that end we have set up a testbed of multiple XRootD servers in both UCSD and Caltech which are connected through a dedicated link capable of 400 Gbps end-to-end. Building upon our experience deploying containerized XRootD servers, we use Kubernetes to easily deploy and test different configurations of our testbed. In this work, we will present our experience doing these tests and the lessons learned. |
| title | 400Gbps benchmark of XRootD HTTP-TPC |
| topic | Networking and Internet Architecture |
| url | https://arxiv.org/abs/2312.12589 |