QuakeFormer: A Uniform Approach to Earthquake Ground Motion Prediction Using Masked Transformers

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Feng, Yitian, Zhu, Weiqiang, Lu, Xinzheng
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866913592307089408
author Feng, Yitian
Zhu, Weiqiang
Lu, Xinzheng
author_facet Feng, Yitian
Zhu, Weiqiang
Lu, Xinzheng
contents Ground motion prediction (GMP) models are critical for hazard reduction before, during and after destructive earthquakes. In these three stages, intensity forecasting, early warning and interpolation models are corresponding employed to assess the risk. Considering the high cost in numerical methods and the oversimplification in statistical methods, deep-learning-based approaches aim to provide accurate and near-real-time ground motion prediction. Current approaches are limited by specialized architectures, overlooking the interconnection among these three tasks. What's more, the inadequate modeling of absolute and relative spatial dependencies mischaracterizes epistemic uncertainty into aleatory variability. Here we introduce QuakeFormer, a unified deep learning architecture that combines these three tasks in one framework. We design a multi-station-based Transformer architecture and a flexible masking strategy for training QuakeFormer. This data-driven approach enables the model to learn spatial ground motion dependencies directly from real seismic recordings, incorporating location embeddings that include both absolute and relative spatial coordinates. The results indicate that our model outperforms state-of-the-art ground motion prediction models across all three tasks in our research areas. We also find that pretraining a uniform forecasting and interpolation model enhances the performance on early warning task. QuakeFormer offers a flexible approach to directly learning and modeling ground motion, providing valuable insights and applications for both earthquake science and engineering.
format Preprint
id arxiv_https___arxiv_org_abs_2412_00815
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle QuakeFormer: A Uniform Approach to Earthquake Ground Motion Prediction Using Masked Transformers
Feng, Yitian
Zhu, Weiqiang
Lu, Xinzheng
Geophysics
Ground motion prediction (GMP) models are critical for hazard reduction before, during and after destructive earthquakes. In these three stages, intensity forecasting, early warning and interpolation models are corresponding employed to assess the risk. Considering the high cost in numerical methods and the oversimplification in statistical methods, deep-learning-based approaches aim to provide accurate and near-real-time ground motion prediction. Current approaches are limited by specialized architectures, overlooking the interconnection among these three tasks. What's more, the inadequate modeling of absolute and relative spatial dependencies mischaracterizes epistemic uncertainty into aleatory variability. Here we introduce QuakeFormer, a unified deep learning architecture that combines these three tasks in one framework. We design a multi-station-based Transformer architecture and a flexible masking strategy for training QuakeFormer. This data-driven approach enables the model to learn spatial ground motion dependencies directly from real seismic recordings, incorporating location embeddings that include both absolute and relative spatial coordinates. The results indicate that our model outperforms state-of-the-art ground motion prediction models across all three tasks in our research areas. We also find that pretraining a uniform forecasting and interpolation model enhances the performance on early warning task. QuakeFormer offers a flexible approach to directly learning and modeling ground motion, providing valuable insights and applications for both earthquake science and engineering.
title QuakeFormer: A Uniform Approach to Earthquake Ground Motion Prediction Using Masked Transformers
topic Geophysics
url https://arxiv.org/abs/2412.00815