Automated Detection of Visual Attribute Reliance with a Self-Reflective Agent
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866914163391987712 |
|---|---|
| author | Li, Christy Camuñas, Josep Lopez Touchet, Jake Thomas Andreas, Jacob Lapedriza, Agata Torralba, Antonio Shaham, Tamar Rott |
| author_facet | Li, Christy Camuñas, Josep Lopez Touchet, Jake Thomas Andreas, Jacob Lapedriza, Agata Torralba, Antonio Shaham, Tamar Rott |
| contents | When a vision model performs image recognition, which visual attributes drive its predictions? Detecting unintended reliance on specific visual features is critical for ensuring model robustness, preventing overfitting, and avoiding spurious correlations. We introduce an automated framework for detecting such dependencies in trained vision models. At the core of our method is a self-reflective agent that systematically generates and tests hypotheses about visual attributes that a model may rely on. This process is iterative: the agent refines its hypotheses based on experimental outcomes and uses a self-evaluation protocol to assess whether its findings accurately explain model behavior. When inconsistencies arise, the agent self-reflects over its findings and triggers a new cycle of experimentation. We evaluate our approach on a novel benchmark of 130 models designed to exhibit diverse visual attribute dependencies across 18 categories. Our results show that the agent's performance consistently improves with self-reflection, with a significant performance increase over non-reflective baselines. We further demonstrate that the agent identifies real-world visual attribute dependencies in state-of-the-art models, including CLIP's vision encoder and the YOLOv8 object detector. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2510_21704 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Automated Detection of Visual Attribute Reliance with a Self-Reflective Agent Li, Christy Camuñas, Josep Lopez Touchet, Jake Thomas Andreas, Jacob Lapedriza, Agata Torralba, Antonio Shaham, Tamar Rott Computer Vision and Pattern Recognition When a vision model performs image recognition, which visual attributes drive its predictions? Detecting unintended reliance on specific visual features is critical for ensuring model robustness, preventing overfitting, and avoiding spurious correlations. We introduce an automated framework for detecting such dependencies in trained vision models. At the core of our method is a self-reflective agent that systematically generates and tests hypotheses about visual attributes that a model may rely on. This process is iterative: the agent refines its hypotheses based on experimental outcomes and uses a self-evaluation protocol to assess whether its findings accurately explain model behavior. When inconsistencies arise, the agent self-reflects over its findings and triggers a new cycle of experimentation. We evaluate our approach on a novel benchmark of 130 models designed to exhibit diverse visual attribute dependencies across 18 categories. Our results show that the agent's performance consistently improves with self-reflection, with a significant performance increase over non-reflective baselines. We further demonstrate that the agent identifies real-world visual attribute dependencies in state-of-the-art models, including CLIP's vision encoder and the YOLOv8 object detector. |
| title | Automated Detection of Visual Attribute Reliance with a Self-Reflective Agent |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2510.21704 |