Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2504.16075 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866915253496840192 |
|---|---|
| author | Harvey, Joshua S. Rosaler, Joshua Li, Mingshu Desai, Dhruv Mehta, Dhagash |
| author_facet | Harvey, Joshua S. Rosaler, Joshua Li, Mingshu Desai, Dhruv Mehta, Dhagash |
| contents | We describe the use of an unsupervised Random Forest for similarity learning and improved unsupervised anomaly detection. By training a Random Forest to discriminate between real data and synthetic data sampled from a uniform distribution over the real data bounds, a distance measure is obtained that anisometrically transforms the data, expanding distances at the boundary of the data manifold. We show that using distances recovered from this transformation improves the accuracy of unsupervised anomaly detection, compared to other commonly used detectors, demonstrated over a large number of benchmark datasets. As well as improved performance, this method has advantages over other unsupervised anomaly detection methods, including minimal requirements for data preprocessing, native handling of missing data, and potential for visualizations. By relating outlier scores to partitions of the Random Forest, we develop a method for locally explainable anomaly predictions in terms of feature importance. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2504_16075 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Explainable Unsupervised Anomaly Detection with Random Forest Harvey, Joshua S. Rosaler, Joshua Li, Mingshu Desai, Dhruv Mehta, Dhagash Machine Learning We describe the use of an unsupervised Random Forest for similarity learning and improved unsupervised anomaly detection. By training a Random Forest to discriminate between real data and synthetic data sampled from a uniform distribution over the real data bounds, a distance measure is obtained that anisometrically transforms the data, expanding distances at the boundary of the data manifold. We show that using distances recovered from this transformation improves the accuracy of unsupervised anomaly detection, compared to other commonly used detectors, demonstrated over a large number of benchmark datasets. As well as improved performance, this method has advantages over other unsupervised anomaly detection methods, including minimal requirements for data preprocessing, native handling of missing data, and potential for visualizations. By relating outlier scores to partitions of the Random Forest, we develop a method for locally explainable anomaly predictions in terms of feature importance. |
| title | Explainable Unsupervised Anomaly Detection with Random Forest |
| topic | Machine Learning |
| url | https://arxiv.org/abs/2504.16075 |