Online learning of quadratic manifolds from streaming data for nonlinear dimensionality reduction and nonlinear model reduction
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866914936305745920 |
|---|---|
| author | Schwerdtner, Paul Mohan, Prakash Pachalieva, Aleksandra Bessac, Julie O'Malley, Daniel Peherstorfer, Benjamin |
| author_facet | Schwerdtner, Paul Mohan, Prakash Pachalieva, Aleksandra Bessac, Julie O'Malley, Daniel Peherstorfer, Benjamin |
| contents | This work introduces an online greedy method for constructing quadratic manifolds from streaming data, designed to enable in-situ analysis of numerical simulation data on the Petabyte scale. Unlike traditional batch methods, which require all data to be available upfront and take multiple passes over the data, the proposed online greedy method incrementally updates quadratic manifolds in one pass as data points are received, eliminating the need for expensive disk input/output operations as well as storing and loading data points once they have been processed. A range of numerical examples demonstrate that the online greedy method learns accurate quadratic manifold embeddings while being capable of processing data that far exceed common disk input/output capabilities and volumes as well as main-memory sizes. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2409_02703 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Online learning of quadratic manifolds from streaming data for nonlinear dimensionality reduction and nonlinear model reduction Schwerdtner, Paul Mohan, Prakash Pachalieva, Aleksandra Bessac, Julie O'Malley, Daniel Peherstorfer, Benjamin Numerical Analysis 65F55, 62H25, 65F30, 68T09 This work introduces an online greedy method for constructing quadratic manifolds from streaming data, designed to enable in-situ analysis of numerical simulation data on the Petabyte scale. Unlike traditional batch methods, which require all data to be available upfront and take multiple passes over the data, the proposed online greedy method incrementally updates quadratic manifolds in one pass as data points are received, eliminating the need for expensive disk input/output operations as well as storing and loading data points once they have been processed. A range of numerical examples demonstrate that the online greedy method learns accurate quadratic manifold embeddings while being capable of processing data that far exceed common disk input/output capabilities and volumes as well as main-memory sizes. |
| title | Online learning of quadratic manifolds from streaming data for nonlinear dimensionality reduction and nonlinear model reduction |
| topic | Numerical Analysis 65F55, 62H25, 65F30, 68T09 |
| url | https://arxiv.org/abs/2409.02703 |