A GPU-accelerated Molecular Docking Workflow with Kubernetes and Apache Airflow
Fuente:
arXiv
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866913545158918144 |
|---|---|
| author | Medeiros, Daniel Schieffer, Gabin Wahlgren, Jacob Peng, Ivy |
| author_facet | Medeiros, Daniel Schieffer, Gabin Wahlgren, Jacob Peng, Ivy |
| contents | Complex workflows play a critical role in accelerating scientific discovery. In many scientific domains, efficient workflow management can lead to faster scientific output and broader user groups. Workflows that can leverage resources across the boundary between cloud and HPC are a strong driver for the convergence of HPC and cloud. This study investigates the transition and deployment of a GPU-accelerated molecular docking workflow that was designed for HPC systems onto a cloud-native environment with Kubernetes and Apache Airflow. The case study focuses on state-of-of-the-art molecular docking software for drug discovery. We provide a DAG-based implementation in Apache Airflow and technical details for GPU-accelerated deployment. We evaluated the workflow using the SWEETLEAD bioinformatics dataset and executed it in a Cloud environment with heterogeneous computing resources. Our workflow can effectively overlap different stages when mapped onto different computing resources. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_10634 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | A GPU-accelerated Molecular Docking Workflow with Kubernetes and Apache Airflow Medeiros, Daniel Schieffer, Gabin Wahlgren, Jacob Peng, Ivy Distributed, Parallel, and Cluster Computing Complex workflows play a critical role in accelerating scientific discovery. In many scientific domains, efficient workflow management can lead to faster scientific output and broader user groups. Workflows that can leverage resources across the boundary between cloud and HPC are a strong driver for the convergence of HPC and cloud. This study investigates the transition and deployment of a GPU-accelerated molecular docking workflow that was designed for HPC systems onto a cloud-native environment with Kubernetes and Apache Airflow. The case study focuses on state-of-of-the-art molecular docking software for drug discovery. We provide a DAG-based implementation in Apache Airflow and technical details for GPU-accelerated deployment. We evaluated the workflow using the SWEETLEAD bioinformatics dataset and executed it in a Cloud environment with heterogeneous computing resources. Our workflow can effectively overlap different stages when mapped onto different computing resources. |
| title | A GPU-accelerated Molecular Docking Workflow with Kubernetes and Apache Airflow |
| topic | Distributed, Parallel, and Cluster Computing |
| url | https://arxiv.org/abs/2410.10634 |