YAC: Bridging Natural Language and Interactive Visual Exploration with Generative AI for Biomedical Data Discovery
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909054625906688 |
|---|---|
| author | Lange, Devin Gao, Shanghua Sui, Pengwei Misner, Priya Brandt, Astrid van den Money, Austen Akhmetov, Nikolay Choy, Lisa Zitnik, Marinka Gehlenborg, Nils |
| author_facet | Lange, Devin Gao, Shanghua Sui, Pengwei Misner, Priya Brandt, Astrid van den Money, Austen Akhmetov, Nikolay Choy, Lisa Zitnik, Marinka Gehlenborg, Nils |
| contents | Incorporating natural language input has the potential to improve the capabilities of biomedical data discovery interfaces. However, user interface elements and visualizations are still powerful tools for interacting with data. In our prototype system, YAC, Yet Another Chatbot, we integrate natural language and interactive visualizations. YAC uses a tool-calling multi-agent system to generate declarative output, which is interpreted to render linked interactive visualizations and apply data filters. We also include adjustment widgets, which allow users to directly modify the structured output. Structured text is also generated to clarify user intent, notify users of system boundaries, and explain aspects of the data with live data element links. We conducted a user study with domain experts to surface areas where YAC can be improved. Furthermore we reflect on the capabilities and design of this system with an analysis of its technical dimensions. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2509_19182 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | YAC: Bridging Natural Language and Interactive Visual Exploration with Generative AI for Biomedical Data Discovery Lange, Devin Gao, Shanghua Sui, Pengwei Misner, Priya Brandt, Astrid van den Money, Austen Akhmetov, Nikolay Choy, Lisa Zitnik, Marinka Gehlenborg, Nils Human-Computer Interaction Artificial Intelligence Incorporating natural language input has the potential to improve the capabilities of biomedical data discovery interfaces. However, user interface elements and visualizations are still powerful tools for interacting with data. In our prototype system, YAC, Yet Another Chatbot, we integrate natural language and interactive visualizations. YAC uses a tool-calling multi-agent system to generate declarative output, which is interpreted to render linked interactive visualizations and apply data filters. We also include adjustment widgets, which allow users to directly modify the structured output. Structured text is also generated to clarify user intent, notify users of system boundaries, and explain aspects of the data with live data element links. We conducted a user study with domain experts to surface areas where YAC can be improved. Furthermore we reflect on the capabilities and design of this system with an analysis of its technical dimensions. |
| title | YAC: Bridging Natural Language and Interactive Visual Exploration with Generative AI for Biomedical Data Discovery |
| topic | Human-Computer Interaction Artificial Intelligence |
| url | https://arxiv.org/abs/2509.19182 |