Saved in:
Bibliographic Details
Main Authors: Zhang, Zhikun, Duan, Yiting, Wang, Xiangjun, Zhang, Mingyuan
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2407.04248
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908388265295872
author Zhang, Zhikun
Duan, Yiting
Wang, Xiangjun
Zhang, Mingyuan
author_facet Zhang, Zhikun
Duan, Yiting
Wang, Xiangjun
Zhang, Mingyuan
contents This paper proposes a novel fast online methodology for outlier detection called the exception maximization outlier detection method(EMODM), which employs probabilistic models and statistical algorithms to detect abnormal patterns from the outputs of complex systems. The EMODM is based on a two-state Gaussian mixture model and demonstrates strong performance in probability anomaly detection working on real-time raw data rather than using special prior distribution information. We confirm this using the synthetic data from two numerical cases. For the real-world data, we have detected the short circuit pattern of the circuit system using EMODM by the current and voltage output of a three-phase inverter. The EMODM also found an abnormal period due to COVID-19 in the insured unemployment data of 53 regions in the United States from 2000 to 2024. The application of EMODM to these two real-life datasets demonstrated the effectiveness and accuracy of our algorithm.
format Preprint
id arxiv_https___arxiv_org_abs_2407_04248
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Machine Learning for Complex Systems with Abnormal Pattern by Exception Maximization Outlier Detection Method
Zhang, Zhikun
Duan, Yiting
Wang, Xiangjun
Zhang, Mingyuan
Machine Learning
This paper proposes a novel fast online methodology for outlier detection called the exception maximization outlier detection method(EMODM), which employs probabilistic models and statistical algorithms to detect abnormal patterns from the outputs of complex systems. The EMODM is based on a two-state Gaussian mixture model and demonstrates strong performance in probability anomaly detection working on real-time raw data rather than using special prior distribution information. We confirm this using the synthetic data from two numerical cases. For the real-world data, we have detected the short circuit pattern of the circuit system using EMODM by the current and voltage output of a three-phase inverter. The EMODM also found an abnormal period due to COVID-19 in the insured unemployment data of 53 regions in the United States from 2000 to 2024. The application of EMODM to these two real-life datasets demonstrated the effectiveness and accuracy of our algorithm.
title Machine Learning for Complex Systems with Abnormal Pattern by Exception Maximization Outlier Detection Method
topic Machine Learning
url https://arxiv.org/abs/2407.04248