Saved in:
| Main Authors: | , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2504.03603 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866911163582775296 |
|---|---|
| author | Liu, Xianyuan Zhang, Jiayang Zhou, Shuo van der Plas, Thijs L. Vijayaraghavan, Avish Grishina, Anastasiia Zhuang, Mengdie Schofield, Daniel Tomlinson, Christopher Wang, Yuhan Li, Ruizhe van Zeeland, Louisa Tabakhi, Sina Demeocq, Cyndie Li, Xiang Das, Arunav Timmerman, Orlando Baldwin-McDonald, Thomas Wu, Jinge Bai, Peizhen Sahili, Zahraa Al Alwazzan, Omnia Do, Thao N. Suvon, Mohammod N. I. Wang, Angeline Cipolina-Kun, Lucia Moretti, Luigi A. Farndale, Lucas Jain, Nitisha Efremova, Natalia Ge, Yan Varela, Marta Lam, Hak-Keung Celiktutan, Oya Evans, Ben R. Coca-Castro, Alejandro Wu, Honghan Abdallah, Zahraa S. Chen, Chen Danchev, Valentin Tkachenko, Nataliya Lu, Lei Zhu, Tingting Slabaugh, Gregory G. Moore, Roger K. Cheung, William K. Charlton, Peter H. Lu, Haiping |
| author_facet | Liu, Xianyuan Zhang, Jiayang Zhou, Shuo van der Plas, Thijs L. Vijayaraghavan, Avish Grishina, Anastasiia Zhuang, Mengdie Schofield, Daniel Tomlinson, Christopher Wang, Yuhan Li, Ruizhe van Zeeland, Louisa Tabakhi, Sina Demeocq, Cyndie Li, Xiang Das, Arunav Timmerman, Orlando Baldwin-McDonald, Thomas Wu, Jinge Bai, Peizhen Sahili, Zahraa Al Alwazzan, Omnia Do, Thao N. Suvon, Mohammod N. I. Wang, Angeline Cipolina-Kun, Lucia Moretti, Luigi A. Farndale, Lucas Jain, Nitisha Efremova, Natalia Ge, Yan Varela, Marta Lam, Hak-Keung Celiktutan, Oya Evans, Ben R. Coca-Castro, Alejandro Wu, Honghan Abdallah, Zahraa S. Chen, Chen Danchev, Valentin Tkachenko, Nataliya Lu, Lei Zhu, Tingting Slabaugh, Gregory G. Moore, Roger K. Cheung, William K. Charlton, Peter H. Lu, Haiping |
| contents | Multimodal artificial intelligence (AI) integrates diverse types of data via machine learning to improve understanding, prediction, and decision-making across disciplines such as healthcare, science, and engineering. However, most multimodal AI advances focus on models for vision and language data, while their deployability remains a key challenge. We advocate a deployment-centric workflow that incorporates deployment constraints early to reduce the likelihood of undeployable solutions, complementing data-centric and model-centric approaches. We also emphasise deeper integration across multiple levels of multimodality and multidisciplinary collaboration to significantly broaden the research scope beyond vision and language. To facilitate this approach, we identify common multimodal-AI-specific challenges shared across disciplines and examine three real-world use cases: pandemic response, self-driving car design, and climate change adaptation, drawing expertise from healthcare, social science, engineering, science, sustainability, and finance. By fostering multidisciplinary dialogue and open research practices, our community can accelerate deployment-centric development for broad societal impact. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2504_03603 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Towards deployment-centric multimodal AI beyond vision and language Liu, Xianyuan Zhang, Jiayang Zhou, Shuo van der Plas, Thijs L. Vijayaraghavan, Avish Grishina, Anastasiia Zhuang, Mengdie Schofield, Daniel Tomlinson, Christopher Wang, Yuhan Li, Ruizhe van Zeeland, Louisa Tabakhi, Sina Demeocq, Cyndie Li, Xiang Das, Arunav Timmerman, Orlando Baldwin-McDonald, Thomas Wu, Jinge Bai, Peizhen Sahili, Zahraa Al Alwazzan, Omnia Do, Thao N. Suvon, Mohammod N. I. Wang, Angeline Cipolina-Kun, Lucia Moretti, Luigi A. Farndale, Lucas Jain, Nitisha Efremova, Natalia Ge, Yan Varela, Marta Lam, Hak-Keung Celiktutan, Oya Evans, Ben R. Coca-Castro, Alejandro Wu, Honghan Abdallah, Zahraa S. Chen, Chen Danchev, Valentin Tkachenko, Nataliya Lu, Lei Zhu, Tingting Slabaugh, Gregory G. Moore, Roger K. Cheung, William K. Charlton, Peter H. Lu, Haiping Artificial Intelligence Machine Learning Multimodal artificial intelligence (AI) integrates diverse types of data via machine learning to improve understanding, prediction, and decision-making across disciplines such as healthcare, science, and engineering. However, most multimodal AI advances focus on models for vision and language data, while their deployability remains a key challenge. We advocate a deployment-centric workflow that incorporates deployment constraints early to reduce the likelihood of undeployable solutions, complementing data-centric and model-centric approaches. We also emphasise deeper integration across multiple levels of multimodality and multidisciplinary collaboration to significantly broaden the research scope beyond vision and language. To facilitate this approach, we identify common multimodal-AI-specific challenges shared across disciplines and examine three real-world use cases: pandemic response, self-driving car design, and climate change adaptation, drawing expertise from healthcare, social science, engineering, science, sustainability, and finance. By fostering multidisciplinary dialogue and open research practices, our community can accelerate deployment-centric development for broad societal impact. |
| title | Towards deployment-centric multimodal AI beyond vision and language |
| topic | Artificial Intelligence Machine Learning |
| url | https://arxiv.org/abs/2504.03603 |