Language-Assisted Feature Transformation for Anomaly Detection

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Yun, EungGu, Ha, Heonjin, Nam, Yeongwoo, Lee, Bryan Dongik
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866929738884317184
author Yun, EungGu
Ha, Heonjin
Nam, Yeongwoo
Lee, Bryan Dongik
author_facet Yun, EungGu
Ha, Heonjin
Nam, Yeongwoo
Lee, Bryan Dongik
contents This paper introduces LAFT, a novel feature transformation method designed to incorporate user knowledge and preferences into anomaly detection using natural language. Accurately modeling the boundary of normality is crucial for distinguishing abnormal data, but this is often challenging due to limited data or the presence of nuisance attributes. While unsupervised methods that rely solely on data without user guidance are common, they may fail to detect anomalies of specific interest. To address this limitation, we propose Language-Assisted Feature Transformation (LAFT), which leverages the shared image-text embedding space of vision-language models to transform visual features according to user-defined requirements. Combined with anomaly detection methods, LAFT effectively aligns visual features with user preferences, allowing anomalies of interest to be detected. Extensive experiments on both toy and real-world datasets validate the effectiveness of our method.
format Preprint
id arxiv_https___arxiv_org_abs_2503_01184
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Language-Assisted Feature Transformation for Anomaly Detection
Yun, EungGu
Ha, Heonjin
Nam, Yeongwoo
Lee, Bryan Dongik
Machine Learning
Computer Vision and Pattern Recognition
This paper introduces LAFT, a novel feature transformation method designed to incorporate user knowledge and preferences into anomaly detection using natural language. Accurately modeling the boundary of normality is crucial for distinguishing abnormal data, but this is often challenging due to limited data or the presence of nuisance attributes. While unsupervised methods that rely solely on data without user guidance are common, they may fail to detect anomalies of specific interest. To address this limitation, we propose Language-Assisted Feature Transformation (LAFT), which leverages the shared image-text embedding space of vision-language models to transform visual features according to user-defined requirements. Combined with anomaly detection methods, LAFT effectively aligns visual features with user preferences, allowing anomalies of interest to be detected. Extensive experiments on both toy and real-world datasets validate the effectiveness of our method.
title Language-Assisted Feature Transformation for Anomaly Detection
topic Machine Learning
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2503.01184