A Survey of Transformer Enabled Time Series Synthesis

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Sommers, Alexander, Cummins, Logan, Mittal, Sudip, Rahimi, Shahram, Seale, Maria, Jaboure, Joseph, Arnold, Thomas
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913377019756544
author Sommers, Alexander
Cummins, Logan
Mittal, Sudip
Rahimi, Shahram
Seale, Maria
Jaboure, Joseph
Arnold, Thomas
author_facet Sommers, Alexander
Cummins, Logan
Mittal, Sudip
Rahimi, Shahram
Seale, Maria
Jaboure, Joseph
Arnold, Thomas
contents Generative AI has received much attention in the image and language domains, with the transformer neural network continuing to dominate the state of the art. Application of these models to time series generation is less explored, however, and is of great utility to machine learning, privacy preservation, and explainability research. The present survey identifies this gap at the intersection of the transformer, generative AI, and time series data, and reviews works in this sparsely populated subdomain. The reviewed works show great variety in approach, and have not yet converged on a conclusive answer to the problems the domain poses. GANs, diffusion models, state space models, and autoencoders were all encountered alongside or surrounding the transformers which originally motivated the survey. While too open a domain to offer conclusive insights, the works surveyed are quite suggestive, and several recommendations for best practice, and suggestions of valuable future work, are provided.
format Preprint
id arxiv_https___arxiv_org_abs_2406_02322
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle A Survey of Transformer Enabled Time Series Synthesis
Sommers, Alexander
Cummins, Logan
Mittal, Sudip
Rahimi, Shahram
Seale, Maria
Jaboure, Joseph
Arnold, Thomas
Machine Learning
Artificial Intelligence
Generative AI has received much attention in the image and language domains, with the transformer neural network continuing to dominate the state of the art. Application of these models to time series generation is less explored, however, and is of great utility to machine learning, privacy preservation, and explainability research. The present survey identifies this gap at the intersection of the transformer, generative AI, and time series data, and reviews works in this sparsely populated subdomain. The reviewed works show great variety in approach, and have not yet converged on a conclusive answer to the problems the domain poses. GANs, diffusion models, state space models, and autoencoders were all encountered alongside or surrounding the transformers which originally motivated the survey. While too open a domain to offer conclusive insights, the works surveyed are quite suggestive, and several recommendations for best practice, and suggestions of valuable future work, are provided.
title A Survey of Transformer Enabled Time Series Synthesis
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2406.02322