Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2410.23774 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909815659298816 |
|---|---|
| author | Liu, Hongying Wang, Hao Chu, Haoran Wu, Yibo |
| author_facet | Liu, Hongying Wang, Hao Chu, Haoran Wu, Yibo |
| contents | An unsolved issue in widely used methods such as Support Vector Data Description (SVDD) and Small Sphere and Large Margin SVM (SSLM) for anomaly detection is their nonconvexity, which hampers the analysis of optimal solutions in a manner similar to SVMs and limits their applicability in large-scale scenarios. In this paper, we introduce a novel convex SSLM formulation which has been demonstrated to revert to a convex quadratic programming problem for hyperparameter values of interest. Leveraging the convexity of our method, we derive numerous results that are unattainable with traditional nonconvex approaches. We conduct a thorough analysis of how hyperparameters influence the optimal solution, pointing out scenarios where optimal solutions can be trivially found and identifying instances of ill-posedness. Most notably, we establish connections between our method and traditional approaches, providing a clear determination of when the optimal solution is unique--a task unachievable with traditional nonconvex methods. We also derive the nu-property to elucidate the interactions between hyperparameters and the fractions of support vectors and margin errors in both positive and negative classes. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_23774 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Towards Convexity in Anomaly Detection: A New Formulation of SSLM with Unique Optimal Solutions Liu, Hongying Wang, Hao Chu, Haoran Wu, Yibo Machine Learning An unsolved issue in widely used methods such as Support Vector Data Description (SVDD) and Small Sphere and Large Margin SVM (SSLM) for anomaly detection is their nonconvexity, which hampers the analysis of optimal solutions in a manner similar to SVMs and limits their applicability in large-scale scenarios. In this paper, we introduce a novel convex SSLM formulation which has been demonstrated to revert to a convex quadratic programming problem for hyperparameter values of interest. Leveraging the convexity of our method, we derive numerous results that are unattainable with traditional nonconvex approaches. We conduct a thorough analysis of how hyperparameters influence the optimal solution, pointing out scenarios where optimal solutions can be trivially found and identifying instances of ill-posedness. Most notably, we establish connections between our method and traditional approaches, providing a clear determination of when the optimal solution is unique--a task unachievable with traditional nonconvex methods. We also derive the nu-property to elucidate the interactions between hyperparameters and the fractions of support vectors and margin errors in both positive and negative classes. |
| title | Towards Convexity in Anomaly Detection: A New Formulation of SSLM with Unique Optimal Solutions |
| topic | Machine Learning |
| url | https://arxiv.org/abs/2410.23774 |