PRESTO: Progressive Pretraining Enhances Synthetic Chemistry Outcomes
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866914841241845760 |
|---|---|
| author | Cao, He Shao, Yanjun Liu, Zhiyuan Liu, Zijing Tang, Xiangru Yao, Yuan Li, Yu |
| author_facet | Cao, He Shao, Yanjun Liu, Zhiyuan Liu, Zijing Tang, Xiangru Yao, Yuan Li, Yu |
| contents | Multimodal Large Language Models (MLLMs) have seen growing adoption across various scientific disciplines. These advancements encourage the investigation of molecule-text modeling within synthetic chemistry, a field dedicated to designing and conducting chemical reactions to synthesize new compounds with desired properties and applications. Current approaches, however, often neglect the critical role of multiple molecule graph interaction in understanding chemical reactions, leading to suboptimal performance in synthetic chemistry tasks. This study introduces PRESTO(Progressive Pretraining Enhances Synthetic Chemistry Outcomes), a new framework that bridges the molecule-text modality gap by integrating a comprehensive benchmark of pretraining strategies and dataset configurations. It progressively improves multimodal LLMs through cross-modal alignment and multi-graph understanding. Our extensive experiments demonstrate that PRESTO offers competitive results in downstream synthetic chemistry tasks. The code can be found at https://github.com/IDEA-XL/PRESTO. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2406_13193 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | PRESTO: Progressive Pretraining Enhances Synthetic Chemistry Outcomes Cao, He Shao, Yanjun Liu, Zhiyuan Liu, Zijing Tang, Xiangru Yao, Yuan Li, Yu Machine Learning Artificial Intelligence Computation and Language Chemical Physics Multimodal Large Language Models (MLLMs) have seen growing adoption across various scientific disciplines. These advancements encourage the investigation of molecule-text modeling within synthetic chemistry, a field dedicated to designing and conducting chemical reactions to synthesize new compounds with desired properties and applications. Current approaches, however, often neglect the critical role of multiple molecule graph interaction in understanding chemical reactions, leading to suboptimal performance in synthetic chemistry tasks. This study introduces PRESTO(Progressive Pretraining Enhances Synthetic Chemistry Outcomes), a new framework that bridges the molecule-text modality gap by integrating a comprehensive benchmark of pretraining strategies and dataset configurations. It progressively improves multimodal LLMs through cross-modal alignment and multi-graph understanding. Our extensive experiments demonstrate that PRESTO offers competitive results in downstream synthetic chemistry tasks. The code can be found at https://github.com/IDEA-XL/PRESTO. |
| title | PRESTO: Progressive Pretraining Enhances Synthetic Chemistry Outcomes |
| topic | Machine Learning Artificial Intelligence Computation and Language Chemical Physics |
| url | https://arxiv.org/abs/2406.13193 |