Saved in:
| Main Authors: | , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2502.16865 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910842250854400 |
|---|---|
| author | Shah, Ayush Kumar Dey, Abhisek Luo, Leo Amador, Bryan Philippy, Patrick Zhong, Ming Ouyang, Siru Friday, David Mark Bianchi, David Jackson, Nick Zanibbi, Richard Han, Jiawei |
| author_facet | Shah, Ayush Kumar Dey, Abhisek Luo, Leo Amador, Bryan Philippy, Patrick Zhong, Ming Ouyang, Siru Friday, David Mark Bianchi, David Jackson, Nick Zanibbi, Richard Han, Jiawei |
| contents | We present a multimodal search tool that facilitates retrieval of chemical reactions, molecular structures, and associated text from scientific literature. Queries may combine molecular diagrams, textual descriptions, and reaction data, allowing users to connect different representations of chemical information. To support this, the indexing process includes chemical diagram extraction and parsing, extraction of reaction data from text in tabular form, and cross-modal linking of diagrams and their mentions in text. We describe the system's architecture, key functionalities, and retrieval process, along with expert assessments of the system. This demo highlights the workflow and technical components of the search system. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2502_16865 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Multimodal Search in Chemical Documents and Reactions Shah, Ayush Kumar Dey, Abhisek Luo, Leo Amador, Bryan Philippy, Patrick Zhong, Ming Ouyang, Siru Friday, David Mark Bianchi, David Jackson, Nick Zanibbi, Richard Han, Jiawei Information Retrieval We present a multimodal search tool that facilitates retrieval of chemical reactions, molecular structures, and associated text from scientific literature. Queries may combine molecular diagrams, textual descriptions, and reaction data, allowing users to connect different representations of chemical information. To support this, the indexing process includes chemical diagram extraction and parsing, extraction of reaction data from text in tabular form, and cross-modal linking of diagrams and their mentions in text. We describe the system's architecture, key functionalities, and retrieval process, along with expert assessments of the system. This demo highlights the workflow and technical components of the search system. |
| title | Multimodal Search in Chemical Documents and Reactions |
| topic | Information Retrieval |
| url | https://arxiv.org/abs/2502.16865 |