XBIDetective: Leveraging Vision Language Models for Identifying Cross-Browser Visual Inconsistencies
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866912772508352512 |
|---|---|
| author | Grewal, Balreet Graham, James Muizelaar, Jeff Odvarko, Jan Honza Mujahid, Suhaib Castelluccio, Marco Bezemer, Cor-Paul |
| author_facet | Grewal, Balreet Graham, James Muizelaar, Jeff Odvarko, Jan Honza Mujahid, Suhaib Castelluccio, Marco Bezemer, Cor-Paul |
| contents | Browser rendering bugs can be challenging to detect for browser developers, as they may be triggered by very specific conditions that are exhibited on only a very small subset of websites. Cross-browser inconsistencies (XBIs), variations in how a website is interpreted and displayed on different browsers, can be helpful guides to detect such rendering bugs. Although visual and Document Object Model (DOM)-based analysis techniques exist for detecting XBIs, they often struggle with dynamic and interactive elements. In this study, we discuss our industry experience with using vision language models (VLMs) to identify XBIs. We present the XBIDetective tool which automatically captures screenshots of a website in Mozilla Firefox and Google Chrome, and analyzes them with a VLM for XBIs. We evaluate XBIDetective's performance with an off-the-shelf and a fine-tuned VLM on 1,052 websites. We show that XBIDetective can identify cross-browser discrepancies with 79% accuracy and detect dynamic elements and advertisements with 84% and 85% accuracy, respectively, when using the fine-tuned VLM. We discuss important lessons learned, and we present several potential practical use cases for XBIDetective, including automated regression testing, large-scale monitoring of websites, and rapid triaging of XBI bug reports. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2512_15804 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | XBIDetective: Leveraging Vision Language Models for Identifying Cross-Browser Visual Inconsistencies Grewal, Balreet Graham, James Muizelaar, Jeff Odvarko, Jan Honza Mujahid, Suhaib Castelluccio, Marco Bezemer, Cor-Paul Software Engineering Browser rendering bugs can be challenging to detect for browser developers, as they may be triggered by very specific conditions that are exhibited on only a very small subset of websites. Cross-browser inconsistencies (XBIs), variations in how a website is interpreted and displayed on different browsers, can be helpful guides to detect such rendering bugs. Although visual and Document Object Model (DOM)-based analysis techniques exist for detecting XBIs, they often struggle with dynamic and interactive elements. In this study, we discuss our industry experience with using vision language models (VLMs) to identify XBIs. We present the XBIDetective tool which automatically captures screenshots of a website in Mozilla Firefox and Google Chrome, and analyzes them with a VLM for XBIs. We evaluate XBIDetective's performance with an off-the-shelf and a fine-tuned VLM on 1,052 websites. We show that XBIDetective can identify cross-browser discrepancies with 79% accuracy and detect dynamic elements and advertisements with 84% and 85% accuracy, respectively, when using the fine-tuned VLM. We discuss important lessons learned, and we present several potential practical use cases for XBIDetective, including automated regression testing, large-scale monitoring of websites, and rapid triaging of XBI bug reports. |
| title | XBIDetective: Leveraging Vision Language Models for Identifying Cross-Browser Visual Inconsistencies |
| topic | Software Engineering |
| url | https://arxiv.org/abs/2512.15804 |