An Improved Metric and Benchmark for Assessing the Performance of Virtual Screening Models
Fuente:
arXiv
Salvato in:
| Autori principali: | , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866917614750531584 |
|---|---|
| author | Brocidiacono, Michael Popov, Konstantin I. Tropsha, Alexander |
| author_facet | Brocidiacono, Michael Popov, Konstantin I. Tropsha, Alexander |
| contents | Structure-based virtual screening (SBVS) is a key workflow in computational drug discovery. SBVS models are assessed by measuring the enrichment of known active molecules over decoys in retrospective screens. However, the standard formula for enrichment cannot estimate model performance on very large libraries. Additionally, current screening benchmarks cannot easily be used with machine learning (ML) models due to data leakage. We propose an improved formula for calculating VS enrichment and introduce the BayesBind benchmarking set composed of protein targets that are structurally dissimilar to those in the BigBind training set. We assess current models on this benchmark and find that none perform appreciably better than a KNN baseline. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2403_10478 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | An Improved Metric and Benchmark for Assessing the Performance of Virtual Screening Models Brocidiacono, Michael Popov, Konstantin I. Tropsha, Alexander Quantitative Methods Structure-based virtual screening (SBVS) is a key workflow in computational drug discovery. SBVS models are assessed by measuring the enrichment of known active molecules over decoys in retrospective screens. However, the standard formula for enrichment cannot estimate model performance on very large libraries. Additionally, current screening benchmarks cannot easily be used with machine learning (ML) models due to data leakage. We propose an improved formula for calculating VS enrichment and introduce the BayesBind benchmarking set composed of protein targets that are structurally dissimilar to those in the BigBind training set. We assess current models on this benchmark and find that none perform appreciably better than a KNN baseline. |
| title | An Improved Metric and Benchmark for Assessing the Performance of Virtual Screening Models |
| topic | Quantitative Methods |
| url | https://arxiv.org/abs/2403.10478 |