FlowCLAS: Enhancing Normalizing Flow Via Contrastive Learning For Anomaly Segmentation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Lee, Chang Won, Leveugle, Selina, Stolpner, Svetlana, Langley, Chris, Grouchy, Paul, Kelly, Jonathan, Waslander, Steven L.
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911483204468736
author Lee, Chang Won
Leveugle, Selina
Stolpner, Svetlana
Langley, Chris
Grouchy, Paul
Kelly, Jonathan
Waslander, Steven L.
author_facet Lee, Chang Won
Leveugle, Selina
Stolpner, Svetlana
Langley, Chris
Grouchy, Paul
Kelly, Jonathan
Waslander, Steven L.
contents Anomaly segmentation is an essential capability for safety-critical robotics applications that must be aware of unexpected events. Normalizing flows (NFs), a class of generative models, are a promising approach for this task due to their ability to model the inlier data distribution efficiently. However, their performance falters in dynamic scenes, where complex, multi-modal data distributions cause them to struggle with identifying out-of-distribution samples, leaving a performance gap to leading discriminative methods. To address this limitation, we introduce FlowCLAS, a hybrid framework that enhances the traditional maximum likelihood objective of NFs with a discriminative, contrastive loss. Leveraging Outlier Exposure, this objective explicitly enforces a separation between normal and anomalous features in the latent space, retaining the probabilistic foundation of NFs while embedding the discriminative power they lack. The strength of this approach is demonstrated by FlowCLAS establishing new state-of-the-art (SOTA) performance across multiple challenging anomaly segmentation benchmarks for robotics, including Fishyscapes Lost & Found, Road Anomaly, SegmentMeIfYouCan-ObstacleTrack, and ALLO. Our experiments also show that this contrastive approach is more effective than other outlier-based training strategies for NFs, successfully bridging the performance gap to leading discriminative methods. Project page: https://trailab.github.io/FlowCLAS
format Preprint
id arxiv_https___arxiv_org_abs_2411_19888
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle FlowCLAS: Enhancing Normalizing Flow Via Contrastive Learning For Anomaly Segmentation
Lee, Chang Won
Leveugle, Selina
Stolpner, Svetlana
Langley, Chris
Grouchy, Paul
Kelly, Jonathan
Waslander, Steven L.
Computer Vision and Pattern Recognition
Machine Learning
Anomaly segmentation is an essential capability for safety-critical robotics applications that must be aware of unexpected events. Normalizing flows (NFs), a class of generative models, are a promising approach for this task due to their ability to model the inlier data distribution efficiently. However, their performance falters in dynamic scenes, where complex, multi-modal data distributions cause them to struggle with identifying out-of-distribution samples, leaving a performance gap to leading discriminative methods. To address this limitation, we introduce FlowCLAS, a hybrid framework that enhances the traditional maximum likelihood objective of NFs with a discriminative, contrastive loss. Leveraging Outlier Exposure, this objective explicitly enforces a separation between normal and anomalous features in the latent space, retaining the probabilistic foundation of NFs while embedding the discriminative power they lack. The strength of this approach is demonstrated by FlowCLAS establishing new state-of-the-art (SOTA) performance across multiple challenging anomaly segmentation benchmarks for robotics, including Fishyscapes Lost & Found, Road Anomaly, SegmentMeIfYouCan-ObstacleTrack, and ALLO. Our experiments also show that this contrastive approach is more effective than other outlier-based training strategies for NFs, successfully bridging the performance gap to leading discriminative methods. Project page: https://trailab.github.io/FlowCLAS
title FlowCLAS: Enhancing Normalizing Flow Via Contrastive Learning For Anomaly Segmentation
topic Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2411.19888