Serverless Approach to Running Resource-Intensive STAR Aligner
Fuente:
arXiv
Guardado en:
| Autores principales: | , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866916676341071872 |
|---|---|
| author | Kica, Piotr Orzechowski, Michał Malawski, Maciej |
| author_facet | Kica, Piotr Orzechowski, Michał Malawski, Maciej |
| contents | The application of serverless computing for alignment of RNA-sequences can improve many existing bioinformatics workflows by reducing operational costs and execution times. This work analyzes the applicability of serverless services for running the STAR aligner, which is known for its accuracy and large memory requirement. This presents a challenge, as serverless services were designed for light and short tasks. Nevertheless, we successfully deploy a STAR-based pipeline on AWS ECS service, propose multiple optimizations, and perform experiment with 17 TBs of data. Results are compared against standard virtual machine (VM) based solution showing that serverless is a valid alternative for small-scale batch processing. However, in large-scale where efficiency matters the most, VMs are still recommended. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2504_05078 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Serverless Approach to Running Resource-Intensive STAR Aligner Kica, Piotr Orzechowski, Michał Malawski, Maciej Distributed, Parallel, and Cluster Computing The application of serverless computing for alignment of RNA-sequences can improve many existing bioinformatics workflows by reducing operational costs and execution times. This work analyzes the applicability of serverless services for running the STAR aligner, which is known for its accuracy and large memory requirement. This presents a challenge, as serverless services were designed for light and short tasks. Nevertheless, we successfully deploy a STAR-based pipeline on AWS ECS service, propose multiple optimizations, and perform experiment with 17 TBs of data. Results are compared against standard virtual machine (VM) based solution showing that serverless is a valid alternative for small-scale batch processing. However, in large-scale where efficiency matters the most, VMs are still recommended. |
| title | Serverless Approach to Running Resource-Intensive STAR Aligner |
| topic | Distributed, Parallel, and Cluster Computing |
| url | https://arxiv.org/abs/2504.05078 |