Transparency Distortion Robustness for SOTA Image Segmentation Tasks
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866911883367284736 |
|---|---|
| author | Knauthe, Volker Rak, Arne Wirth, Tristan Pöllabauer, Thomas Metzler, Simon Kuijper, Arjan Fellner, Dieter W. |
| author_facet | Knauthe, Volker Rak, Arne Wirth, Tristan Pöllabauer, Thomas Metzler, Simon Kuijper, Arjan Fellner, Dieter W. |
| contents | Semantic Image Segmentation facilitates a multitude of real-world applications ranging from autonomous driving over industrial process supervision to vision aids for human beings. These models are usually trained in a supervised fashion using example inputs. Distribution Shifts between these examples and the inputs in operation may cause erroneous segmentations. The robustness of semantic segmentation models against distribution shifts caused by differing camera or lighting setups, lens distortions, adversarial inputs and image corruptions has been topic of recent research. However, robustness against spatially varying radial distortion effects that can be caused by uneven glass structures (e.g. windows) or the chaotic refraction in heated air has not been addressed by the research community yet. We propose a method to synthetically augment existing datasets with spatially varying distortions. Our experiments show, that these distortion effects degrade the performance of state-of-the-art segmentation models. Pretraining and enlarged model capacities proof to be suitable strategies for mitigating performance degradation to some degree, while fine-tuning on distorted images only leads to marginal performance improvements. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2405_12864 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Transparency Distortion Robustness for SOTA Image Segmentation Tasks Knauthe, Volker Rak, Arne Wirth, Tristan Pöllabauer, Thomas Metzler, Simon Kuijper, Arjan Fellner, Dieter W. Computer Vision and Pattern Recognition Semantic Image Segmentation facilitates a multitude of real-world applications ranging from autonomous driving over industrial process supervision to vision aids for human beings. These models are usually trained in a supervised fashion using example inputs. Distribution Shifts between these examples and the inputs in operation may cause erroneous segmentations. The robustness of semantic segmentation models against distribution shifts caused by differing camera or lighting setups, lens distortions, adversarial inputs and image corruptions has been topic of recent research. However, robustness against spatially varying radial distortion effects that can be caused by uneven glass structures (e.g. windows) or the chaotic refraction in heated air has not been addressed by the research community yet. We propose a method to synthetically augment existing datasets with spatially varying distortions. Our experiments show, that these distortion effects degrade the performance of state-of-the-art segmentation models. Pretraining and enlarged model capacities proof to be suitable strategies for mitigating performance degradation to some degree, while fine-tuning on distorted images only leads to marginal performance improvements. |
| title | Transparency Distortion Robustness for SOTA Image Segmentation Tasks |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2405.12864 |