An Empirical Study: Extensive Deep Temporal Point Process

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Lin, Haitao, Tan, Cheng, Wu, Lirong, Gao, Zhangyang, Liu, Zicheng, Li, Stan. Z.
Formato: Preprint
Publicado: 2021
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866916540443525120
author Lin, Haitao
Tan, Cheng
Wu, Lirong
Gao, Zhangyang
Liu, Zicheng
Li, Stan. Z.
author_facet Lin, Haitao
Tan, Cheng
Wu, Lirong
Gao, Zhangyang
Liu, Zicheng
Li, Stan. Z.
contents Temporal point process as the stochastic process on continuous domain of time is commonly used to model the asynchronous event sequence featuring with occurrence timestamps. Thanks to the strong expressivity of deep neural networks, they are emerging as a promising choice for capturing the patterns in asynchronous sequences, in the context of temporal point process. In this paper, we first review recent research emphasis and difficulties in modeling asynchronous event sequences with deep temporal point process, which can be concluded into four fields: encoding of history sequence, formulation of conditional intensity function, relational discovery of events and learning approaches for optimization. We introduce most of recently proposed models by dismantling them into the four parts, and conduct experiments by remodularizing the first three parts with the same learning strategy for a fair empirical evaluation. Besides, we extend the history encoders and conditional intensity function family, and propose a Granger causality discovery framework for exploiting the relations among multi-types of events. Because the Granger causality can be represented by the Granger causality graph, discrete graph structure learning in the framework of Variational Inference is employed to reveal latent structures of the graph. Further experiments show that the proposed framework with latent graph discovery can both capture the relations and achieve an improved fitting and predicting performance.
format Preprint
id arxiv_https___arxiv_org_abs_2110_09823
institution arXiv
publishDate 2021
record_format arxiv
spellingShingle An Empirical Study: Extensive Deep Temporal Point Process
Lin, Haitao
Tan, Cheng
Wu, Lirong
Gao, Zhangyang
Liu, Zicheng
Li, Stan. Z.
Machine Learning
Applications
Methodology
Temporal point process as the stochastic process on continuous domain of time is commonly used to model the asynchronous event sequence featuring with occurrence timestamps. Thanks to the strong expressivity of deep neural networks, they are emerging as a promising choice for capturing the patterns in asynchronous sequences, in the context of temporal point process. In this paper, we first review recent research emphasis and difficulties in modeling asynchronous event sequences with deep temporal point process, which can be concluded into four fields: encoding of history sequence, formulation of conditional intensity function, relational discovery of events and learning approaches for optimization. We introduce most of recently proposed models by dismantling them into the four parts, and conduct experiments by remodularizing the first three parts with the same learning strategy for a fair empirical evaluation. Besides, we extend the history encoders and conditional intensity function family, and propose a Granger causality discovery framework for exploiting the relations among multi-types of events. Because the Granger causality can be represented by the Granger causality graph, discrete graph structure learning in the framework of Variational Inference is employed to reveal latent structures of the graph. Further experiments show that the proposed framework with latent graph discovery can both capture the relations and achieve an improved fitting and predicting performance.
title An Empirical Study: Extensive Deep Temporal Point Process
topic Machine Learning
Applications
Methodology
url https://arxiv.org/abs/2110.09823