Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2506.05405 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866918452748353536 |
|---|---|
| author | Lin, Shiwei Wang, Chenxu Ding, Xiaozhen Wang, Yi Du, Boyuan Song, Lei Wang, Chenggang Liu, Huaping |
| author_facet | Lin, Shiwei Wang, Chenxu Ding, Xiaozhen Wang, Yi Du, Boyuan Song, Lei Wang, Chenggang Liu, Huaping |
| contents | In robot scientific laboratories, visual anomaly detection is important for the timely identification and resolution of potential faults or deviations. It has become a key factor in ensuring the stability and safety of experimental processes. To address this challenge, this paper proposes a VLM-based visual reasoning approach that supports different levels of supervision through four progressively informative prompt configurations. To systematically evaluate its effectiveness, we construct a visual benchmark tailored for process anomaly detection in scientific workflows. Experiments on two representative vision-language models show that detection accuracy improves as more contextual information is provided, confirming the effectiveness and adaptability of the proposed reasoning approach for process anomaly detection in scientific workflows. Furthermore, real-world validations at selected experimental steps confirm that first-person visual observation can effectively identify process-level anomalies. This work provides both a data-driven foundation and an evaluation framework for vision anomaly detection in scientific experiment workflows. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2506_05405 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | A VLM-based Method for Visual Anomaly Detection in Robotic Scientific Laboratories Lin, Shiwei Wang, Chenxu Ding, Xiaozhen Wang, Yi Du, Boyuan Song, Lei Wang, Chenggang Liu, Huaping Computer Vision and Pattern Recognition In robot scientific laboratories, visual anomaly detection is important for the timely identification and resolution of potential faults or deviations. It has become a key factor in ensuring the stability and safety of experimental processes. To address this challenge, this paper proposes a VLM-based visual reasoning approach that supports different levels of supervision through four progressively informative prompt configurations. To systematically evaluate its effectiveness, we construct a visual benchmark tailored for process anomaly detection in scientific workflows. Experiments on two representative vision-language models show that detection accuracy improves as more contextual information is provided, confirming the effectiveness and adaptability of the proposed reasoning approach for process anomaly detection in scientific workflows. Furthermore, real-world validations at selected experimental steps confirm that first-person visual observation can effectively identify process-level anomalies. This work provides both a data-driven foundation and an evaluation framework for vision anomaly detection in scientific experiment workflows. |
| title | A VLM-based Method for Visual Anomaly Detection in Robotic Scientific Laboratories |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2506.05405 |