Multi-modal Summarization in Model-Based Engineering: Automotive Software Development Case Study
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910861569818624 |
|---|---|
| author | Petrovic, Nenad Zhang, Yurui Maaroufi, Moaad Chao, Kuo-Yi Mazur, Lukasz Pan, Fengjunjie Zolfaghari, Vahid Knoll, Alois |
| author_facet | Petrovic, Nenad Zhang, Yurui Maaroufi, Moaad Chao, Kuo-Yi Mazur, Lukasz Pan, Fengjunjie Zolfaghari, Vahid Knoll, Alois |
| contents | Multimodal summarization integrating information from diverse data modalities presents a promising solution to aid the understanding of information within various processes. However, the application and advantages of multimodal summarization have not received much attention in model-based engineering (MBE), where it has become a cornerstone in the design and development of complex systems, leveraging formal models to improve understanding, validation and automation throughout the engineering lifecycle. UML and EMF diagrams in model-based engineering contain a large amount of multimodal information and intricate relational data. Hence, our study explores the application of multimodal large language models within the domain of model-based engineering to evaluate their capacity for understanding and identifying relationships, features, and functionalities embedded in UML and EMF diagrams. We aim to demonstrate the transformative potential benefits and limitations of multimodal summarization in improving productivity and accuracy in MBE practices. The proposed approach is evaluated within the context of automotive software development, while many promising state-of-art models were taken into account. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2503_04506 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Multi-modal Summarization in Model-Based Engineering: Automotive Software Development Case Study Petrovic, Nenad Zhang, Yurui Maaroufi, Moaad Chao, Kuo-Yi Mazur, Lukasz Pan, Fengjunjie Zolfaghari, Vahid Knoll, Alois Software Engineering Artificial Intelligence Multimodal summarization integrating information from diverse data modalities presents a promising solution to aid the understanding of information within various processes. However, the application and advantages of multimodal summarization have not received much attention in model-based engineering (MBE), where it has become a cornerstone in the design and development of complex systems, leveraging formal models to improve understanding, validation and automation throughout the engineering lifecycle. UML and EMF diagrams in model-based engineering contain a large amount of multimodal information and intricate relational data. Hence, our study explores the application of multimodal large language models within the domain of model-based engineering to evaluate their capacity for understanding and identifying relationships, features, and functionalities embedded in UML and EMF diagrams. We aim to demonstrate the transformative potential benefits and limitations of multimodal summarization in improving productivity and accuracy in MBE practices. The proposed approach is evaluated within the context of automotive software development, while many promising state-of-art models were taken into account. |
| title | Multi-modal Summarization in Model-Based Engineering: Automotive Software Development Case Study |
| topic | Software Engineering Artificial Intelligence |
| url | https://arxiv.org/abs/2503.04506 |