Learning from the past: predicting critical transitions with machine learning trained on surrogates of historical data

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Ma, Zhiqin, Zeng, Chunhua, Zhang, Yi-Cheng, Bury, Thomas M.
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866909347453337600
author Ma, Zhiqin
Zeng, Chunhua
Zhang, Yi-Cheng
Bury, Thomas M.
author_facet Ma, Zhiqin
Zeng, Chunhua
Zhang, Yi-Cheng
Bury, Thomas M.
contents Complex systems can undergo critical transitions, where slowly changing environmental conditions trigger a sudden shift to a new, potentially catastrophic state. Early warning signals for these events are crucial for decision-making in fields such as ecology, biology and climate science. Generic early warning signals motivated by dynamical systems theory have had mixed success on real noisy data. More recent studies found that deep learning classifiers trained on synthetic data could improve performance. However, neither of these methods take advantage of historical, system-specific data. Here, we introduce an approach that trains machine learning classifiers directly on surrogate data of past transitions, namely surrogate data-based machine learning (SDML). The approach provides early warning signals in empirical and experimental data from geology, climatology, sociology, and cardiology with higher sensitivity and specificity than two widely used generic early warning signals -- variance and lag-1 autocorrelation. Since the approach is trained directly on surrogates of historical data, it is not bound by the restricting assumption of a local bifurcation like previous methods. This system-specific approach can contribute to improved early warning signals to help humans better prepare for or avoid undesirable critical transitions.
format Preprint
id arxiv_https___arxiv_org_abs_2410_09707
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Learning from the past: predicting critical transitions with machine learning trained on surrogates of historical data
Ma, Zhiqin
Zeng, Chunhua
Zhang, Yi-Cheng
Bury, Thomas M.
Data Analysis, Statistics and Probability
Machine Learning
Complex systems can undergo critical transitions, where slowly changing environmental conditions trigger a sudden shift to a new, potentially catastrophic state. Early warning signals for these events are crucial for decision-making in fields such as ecology, biology and climate science. Generic early warning signals motivated by dynamical systems theory have had mixed success on real noisy data. More recent studies found that deep learning classifiers trained on synthetic data could improve performance. However, neither of these methods take advantage of historical, system-specific data. Here, we introduce an approach that trains machine learning classifiers directly on surrogate data of past transitions, namely surrogate data-based machine learning (SDML). The approach provides early warning signals in empirical and experimental data from geology, climatology, sociology, and cardiology with higher sensitivity and specificity than two widely used generic early warning signals -- variance and lag-1 autocorrelation. Since the approach is trained directly on surrogates of historical data, it is not bound by the restricting assumption of a local bifurcation like previous methods. This system-specific approach can contribute to improved early warning signals to help humans better prepare for or avoid undesirable critical transitions.
title Learning from the past: predicting critical transitions with machine learning trained on surrogates of historical data
topic Data Analysis, Statistics and Probability
Machine Learning
url https://arxiv.org/abs/2410.09707