MotifBench: A standardized protein design benchmark for motif-scaffolding problems
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866913698063319040 |
|---|---|
| author | Zheng, Zhuoqi Zhang, Bo Didi, Kieran Yang, Kevin K. Yim, Jason Watson, Joseph L. Chen, Hai-Feng Trippe, Brian L. |
| author_facet | Zheng, Zhuoqi Zhang, Bo Didi, Kieran Yang, Kevin K. Yim, Jason Watson, Joseph L. Chen, Hai-Feng Trippe, Brian L. |
| contents | The motif-scaffolding problem is a central task in computational protein design: Given the coordinates of atoms in a geometry chosen to confer a desired biochemical function (a motif), the task is to identify diverse protein structures (scaffolds) that include the motif and maintain its geometry. Significant recent progress on motif-scaffolding has been made due to computational evaluation with reliable protein structure prediction and fixed-backbone sequence design methods. However, significant variability in evaluation strategies across publications has hindered comparability of results, challenged reproducibility, and impeded robust progress. In response we introduce MotifBench, comprising (1) a precisely specified pipeline and evaluation metrics, (2) a collection of 30 benchmark problems, and (3) an implementation of this benchmark and leaderboard at github.com/blt2114/MotifBench. The MotifBench test cases are more difficult compared to earlier benchmarks, and include protein design problems for which solutions are known but on which, to the best of our knowledge, state-of-the-art methods fail to identify any solution. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2502_12479 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | MotifBench: A standardized protein design benchmark for motif-scaffolding problems Zheng, Zhuoqi Zhang, Bo Didi, Kieran Yang, Kevin K. Yim, Jason Watson, Joseph L. Chen, Hai-Feng Trippe, Brian L. Machine Learning Biomolecules The motif-scaffolding problem is a central task in computational protein design: Given the coordinates of atoms in a geometry chosen to confer a desired biochemical function (a motif), the task is to identify diverse protein structures (scaffolds) that include the motif and maintain its geometry. Significant recent progress on motif-scaffolding has been made due to computational evaluation with reliable protein structure prediction and fixed-backbone sequence design methods. However, significant variability in evaluation strategies across publications has hindered comparability of results, challenged reproducibility, and impeded robust progress. In response we introduce MotifBench, comprising (1) a precisely specified pipeline and evaluation metrics, (2) a collection of 30 benchmark problems, and (3) an implementation of this benchmark and leaderboard at github.com/blt2114/MotifBench. The MotifBench test cases are more difficult compared to earlier benchmarks, and include protein design problems for which solutions are known but on which, to the best of our knowledge, state-of-the-art methods fail to identify any solution. |
| title | MotifBench: A standardized protein design benchmark for motif-scaffolding problems |
| topic | Machine Learning Biomolecules |
| url | https://arxiv.org/abs/2502.12479 |