Maximum Mean Discrepancy on Exponential Windows for Online Change Detection

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Kalinke, Florian, Heyden, Marco, Gntuni, Georg, Fouché, Edouard, Böhm, Klemens
Formato: Preprint
Publicado: 2022
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866915147010801664
author Kalinke, Florian
Heyden, Marco
Gntuni, Georg
Fouché, Edouard
Böhm, Klemens
author_facet Kalinke, Florian
Heyden, Marco
Gntuni, Georg
Fouché, Edouard
Böhm, Klemens
contents Detecting changes is of fundamental importance when analyzing data streams and has many applications, e.g., in predictive maintenance, fraud detection, or medicine. A principled approach to detect changes is to compare the distributions of observations within the stream to each other via hypothesis testing. Maximum mean discrepancy (MMD), a (semi-)metric on the space of probability distributions, provides powerful non-parametric two-sample tests on kernel-enriched domains. In particular, MMD is able to detect any disparity between distributions under mild conditions. However, classical MMD estimators suffer from a quadratic runtime complexity, which renders their direct use for change detection in data streams impractical. In this article, we propose a new change detection algorithm, called Maximum Mean Discrepancy on Exponential Windows (MMDEW), that combines the benefits of MMD with an efficient computation based on exponential windows. We prove that MMDEW enjoys polylogarithmic runtime and logarithmic memory complexity and show empirically that it outperforms the state of the art on benchmark data streams.
format Preprint
id arxiv_https___arxiv_org_abs_2205_12706
institution arXiv
publishDate 2022
record_format arxiv
spellingShingle Maximum Mean Discrepancy on Exponential Windows for Online Change Detection
Kalinke, Florian
Heyden, Marco
Gntuni, Georg
Fouché, Edouard
Böhm, Klemens
Machine Learning
I.2.6; H.1.1
Detecting changes is of fundamental importance when analyzing data streams and has many applications, e.g., in predictive maintenance, fraud detection, or medicine. A principled approach to detect changes is to compare the distributions of observations within the stream to each other via hypothesis testing. Maximum mean discrepancy (MMD), a (semi-)metric on the space of probability distributions, provides powerful non-parametric two-sample tests on kernel-enriched domains. In particular, MMD is able to detect any disparity between distributions under mild conditions. However, classical MMD estimators suffer from a quadratic runtime complexity, which renders their direct use for change detection in data streams impractical. In this article, we propose a new change detection algorithm, called Maximum Mean Discrepancy on Exponential Windows (MMDEW), that combines the benefits of MMD with an efficient computation based on exponential windows. We prove that MMDEW enjoys polylogarithmic runtime and logarithmic memory complexity and show empirically that it outperforms the state of the art on benchmark data streams.
title Maximum Mean Discrepancy on Exponential Windows for Online Change Detection
topic Machine Learning
I.2.6; H.1.1
url https://arxiv.org/abs/2205.12706