Saved in:
Bibliographic Details
Main Authors: Yang, Beibei, Li, Weiling, Fang, Yan
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2401.08068
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916092462497792
author Yang, Beibei
Li, Weiling
Fang, Yan
author_facet Yang, Beibei
Li, Weiling
Fang, Yan
contents Event cameras are neuromorphic sensors that capture asynchronous and sparse event stream when per-pixel brightness changes. The state-of-the-art processing methods for event signals typically aggregate events into a frame or a grid. However, events are dense in time, these works are limited to local information of events due to the stacking. In this paper, we present a novel spatiotemporal representation learning method which can capture the global correlations of all events in the event stream simultaneously by tensor decomposition. In addition, with the events are sparse in space, we propose an Elastic Net-incorporated tensor network (ENTN) model to obtain more spatial and temporal details about event stream. Empirically, the results indicate that our method can represent the spatiotemporal correlation of events with high quality, and can achieve effective results in applications like filtering noise compared with the state-of-the-art methods.
format Preprint
id arxiv_https___arxiv_org_abs_2401_08068
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Representation Learning on Event Stream via an Elastic Net-incorporated Tensor Network
Yang, Beibei
Li, Weiling
Fang, Yan
Computer Vision and Pattern Recognition
Event cameras are neuromorphic sensors that capture asynchronous and sparse event stream when per-pixel brightness changes. The state-of-the-art processing methods for event signals typically aggregate events into a frame or a grid. However, events are dense in time, these works are limited to local information of events due to the stacking. In this paper, we present a novel spatiotemporal representation learning method which can capture the global correlations of all events in the event stream simultaneously by tensor decomposition. In addition, with the events are sparse in space, we propose an Elastic Net-incorporated tensor network (ENTN) model to obtain more spatial and temporal details about event stream. Empirically, the results indicate that our method can represent the spatiotemporal correlation of events with high quality, and can achieve effective results in applications like filtering noise compared with the state-of-the-art methods.
title Representation Learning on Event Stream via an Elastic Net-incorporated Tensor Network
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2401.08068