LVLM-Interpret: An Interpretability Tool for Large Vision-Language Models
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866909230467907584 |
|---|---|
| author | Stan, Gabriela Ben Melech Aflalo, Estelle Rohekar, Raanan Yehezkel Bhiwandiwalla, Anahita Tseng, Shao-Yen Olson, Matthew Lyle Gurwicz, Yaniv Wu, Chenfei Duan, Nan Lal, Vasudev |
| author_facet | Stan, Gabriela Ben Melech Aflalo, Estelle Rohekar, Raanan Yehezkel Bhiwandiwalla, Anahita Tseng, Shao-Yen Olson, Matthew Lyle Gurwicz, Yaniv Wu, Chenfei Duan, Nan Lal, Vasudev |
| contents | In the rapidly evolving landscape of artificial intelligence, multi-modal large language models are emerging as a significant area of interest. These models, which combine various forms of data input, are becoming increasingly popular. However, understanding their internal mechanisms remains a complex task. Numerous advancements have been made in the field of explainability tools and mechanisms, yet there is still much to explore. In this work, we present a novel interactive application aimed towards understanding the internal mechanisms of large vision-language models. Our interface is designed to enhance the interpretability of the image patches, which are instrumental in generating an answer, and assess the efficacy of the language model in grounding its output in the image. With our application, a user can systematically investigate the model and uncover system limitations, paving the way for enhancements in system capabilities. Finally, we present a case study of how our application can aid in understanding failure mechanisms in a popular large multi-modal model: LLaVA. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2404_03118 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | LVLM-Interpret: An Interpretability Tool for Large Vision-Language Models Stan, Gabriela Ben Melech Aflalo, Estelle Rohekar, Raanan Yehezkel Bhiwandiwalla, Anahita Tseng, Shao-Yen Olson, Matthew Lyle Gurwicz, Yaniv Wu, Chenfei Duan, Nan Lal, Vasudev Computer Vision and Pattern Recognition In the rapidly evolving landscape of artificial intelligence, multi-modal large language models are emerging as a significant area of interest. These models, which combine various forms of data input, are becoming increasingly popular. However, understanding their internal mechanisms remains a complex task. Numerous advancements have been made in the field of explainability tools and mechanisms, yet there is still much to explore. In this work, we present a novel interactive application aimed towards understanding the internal mechanisms of large vision-language models. Our interface is designed to enhance the interpretability of the image patches, which are instrumental in generating an answer, and assess the efficacy of the language model in grounding its output in the image. With our application, a user can systematically investigate the model and uncover system limitations, paving the way for enhancements in system capabilities. Finally, we present a case study of how our application can aid in understanding failure mechanisms in a popular large multi-modal model: LLaVA. |
| title | LVLM-Interpret: An Interpretability Tool for Large Vision-Language Models |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2404.03118 |