TAD-Bench: A Comprehensive Benchmark for Embedding-Based Text Anomaly Detection
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909620624162816 |
|---|---|
| author | Cao, Yang Yang, Sikun Li, Chen Xiang, Haolong Qi, Lianyong Liu, Bo Li, Rongsheng Liu, Ming |
| author_facet | Cao, Yang Yang, Sikun Li, Chen Xiang, Haolong Qi, Lianyong Liu, Bo Li, Rongsheng Liu, Ming |
| contents | Text anomaly detection is crucial for identifying spam, misinformation, and offensive language in natural language processing tasks. Despite the growing adoption of embedding-based methods, their effectiveness and generalizability across diverse application scenarios remain under-explored. To address this, we present TAD-Bench, a comprehensive benchmark designed to systematically evaluate embedding-based approaches for text anomaly detection. TAD-Bench integrates multiple datasets spanning different domains, combining state-of-the-art embeddings from large language models with a variety of anomaly detection algorithms. Through extensive experiments, we analyze the interplay between embeddings and detection methods, uncovering their strengths, weaknesses, and applicability to different tasks. These findings offer new perspectives on building more robust, efficient, and generalizable anomaly detection systems for real-world applications. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2501_11960 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | TAD-Bench: A Comprehensive Benchmark for Embedding-Based Text Anomaly Detection Cao, Yang Yang, Sikun Li, Chen Xiang, Haolong Qi, Lianyong Liu, Bo Li, Rongsheng Liu, Ming Computation and Language Artificial Intelligence Text anomaly detection is crucial for identifying spam, misinformation, and offensive language in natural language processing tasks. Despite the growing adoption of embedding-based methods, their effectiveness and generalizability across diverse application scenarios remain under-explored. To address this, we present TAD-Bench, a comprehensive benchmark designed to systematically evaluate embedding-based approaches for text anomaly detection. TAD-Bench integrates multiple datasets spanning different domains, combining state-of-the-art embeddings from large language models with a variety of anomaly detection algorithms. Through extensive experiments, we analyze the interplay between embeddings and detection methods, uncovering their strengths, weaknesses, and applicability to different tasks. These findings offer new perspectives on building more robust, efficient, and generalizable anomaly detection systems for real-world applications. |
| title | TAD-Bench: A Comprehensive Benchmark for Embedding-Based Text Anomaly Detection |
| topic | Computation and Language Artificial Intelligence |
| url | https://arxiv.org/abs/2501.11960 |