Saved in:
Bibliographic Details
Main Authors: Kossira, Katja, Zhu, Yunxuan, Seiler, Jürgen, Kaup, André
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2602.21777
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910032829874176
author Kossira, Katja
Zhu, Yunxuan
Seiler, Jürgen
Kaup, André
author_facet Kossira, Katja
Zhu, Yunxuan
Seiler, Jürgen
Kaup, André
contents Specular reflections pose a significant challenge for object segmentation, as their sharp intensity transitions often mislead both conventional algorithms and deep learning based methods. However, as the specular reflection must lie on the surface of the object, this fact can be exploited to improve the segmentation masks. By identifying the largest region containing the reflection as the object, we derive a more accurate object mask without requiring specialized training data or model adaption. We evaluate our method on both synthetic and real world images and compare it against established and state-of-the-art techniques including Otsu thresholding, YOLO, and SAM2. Compared to the best performing baseline SAM2, our approach achieves up to 26.7% improvement in IoU, 22.3% in DSC, and 9.7% in pixel accuracy. Qualitative evaluations on real world images further confirm the robustness and generalizability of the proposed approach.
format Preprint
id arxiv_https___arxiv_org_abs_2602_21777
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Towards Object Segmentation Mask Selection Using Specular Reflections
Kossira, Katja
Zhu, Yunxuan
Seiler, Jürgen
Kaup, André
Image and Video Processing
Specular reflections pose a significant challenge for object segmentation, as their sharp intensity transitions often mislead both conventional algorithms and deep learning based methods. However, as the specular reflection must lie on the surface of the object, this fact can be exploited to improve the segmentation masks. By identifying the largest region containing the reflection as the object, we derive a more accurate object mask without requiring specialized training data or model adaption. We evaluate our method on both synthetic and real world images and compare it against established and state-of-the-art techniques including Otsu thresholding, YOLO, and SAM2. Compared to the best performing baseline SAM2, our approach achieves up to 26.7% improvement in IoU, 22.3% in DSC, and 9.7% in pixel accuracy. Qualitative evaluations on real world images further confirm the robustness and generalizability of the proposed approach.
title Towards Object Segmentation Mask Selection Using Specular Reflections
topic Image and Video Processing
url https://arxiv.org/abs/2602.21777