Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2603.07335 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914378464362496 |
|---|---|
| author | Lim, Hyesu Choi, Jinho Kim, Taekyung Heo, Byeongho Choo, Jaegul Han, Dongyoon |
| author_facet | Lim, Hyesu Choi, Jinho Kim, Taekyung Heo, Byeongho Choo, Jaegul Han, Dongyoon |
| contents | High-performing vision language models still produce incorrect answers, yet their failure modes are often difficult to explain. To make model internals more accessible and enable systematic debugging, we introduce VisualScratchpad, an interactive interface for visual concept analysis during inference. We apply sparse autoencoders to the vision encoder and link the resulting visual concepts to text tokens via text-to-image attention, allowing us to examine which visual concepts are both captured by the vision encoder and utilized by the language model. VisualScratchpad also provides a token-latent heatmap view that suggests a sufficient set of latents for effective concept ablation in causal analysis. Through case studies, we reveal three underexplored failure modes: limited cross-modal alignment, misleading visual concepts, and unused hidden cues. Project page: https://hyesulim.github.io/visual_scratchpad_projectpage/ |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2603_07335 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | VisualScratchpad: Inference-time Visual Concepts Analysis in Vision Language Models Lim, Hyesu Choi, Jinho Kim, Taekyung Heo, Byeongho Choo, Jaegul Han, Dongyoon Artificial Intelligence High-performing vision language models still produce incorrect answers, yet their failure modes are often difficult to explain. To make model internals more accessible and enable systematic debugging, we introduce VisualScratchpad, an interactive interface for visual concept analysis during inference. We apply sparse autoencoders to the vision encoder and link the resulting visual concepts to text tokens via text-to-image attention, allowing us to examine which visual concepts are both captured by the vision encoder and utilized by the language model. VisualScratchpad also provides a token-latent heatmap view that suggests a sufficient set of latents for effective concept ablation in causal analysis. Through case studies, we reveal three underexplored failure modes: limited cross-modal alignment, misleading visual concepts, and unused hidden cues. Project page: https://hyesulim.github.io/visual_scratchpad_projectpage/ |
| title | VisualScratchpad: Inference-time Visual Concepts Analysis in Vision Language Models |
| topic | Artificial Intelligence |
| url | https://arxiv.org/abs/2603.07335 |