Contracting Skeletal Kinematics for Human-Related Video Anomaly Detection

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Flaborea, Alessandro, D'Amely, Guido, D'Arrigo, Stefano, Sterpa, Marco Aurelio, Sampieri, Alessio, Galasso, Fabio
Format: Preprint
Publié: 2023
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866929464348246016
author Flaborea, Alessandro
D'Amely, Guido
D'Arrigo, Stefano
Sterpa, Marco Aurelio
Sampieri, Alessio
Galasso, Fabio
author_facet Flaborea, Alessandro
D'Amely, Guido
D'Arrigo, Stefano
Sterpa, Marco Aurelio
Sampieri, Alessio
Galasso, Fabio
contents Detecting the anomaly of human behavior is paramount to timely recognizing endangering situations, such as street fights or elderly falls. However, anomaly detection is complex since anomalous events are rare and because it is an open set recognition task, i.e., what is anomalous at inference has not been observed at training. We propose COSKAD, a novel model that encodes skeletal human motion by a graph convolutional network and learns to COntract SKeletal kinematic embeddings onto a latent hypersphere of minimum volume for Video Anomaly Detection. We propose three latent spaces: the commonly-adopted Euclidean and the novel spherical and hyperbolic. All variants outperform the state-of-the-art on the most recent UBnormal dataset, for which we contribute a human-related version with annotated skeletons. COSKAD sets a new state-of-the-art on the human-related versions of ShanghaiTech Campus and CUHK Avenue, with performance comparable to video-based methods. Source code and dataset will be released upon acceptance.
format Preprint
id arxiv_https___arxiv_org_abs_2301_09489
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Contracting Skeletal Kinematics for Human-Related Video Anomaly Detection
Flaborea, Alessandro
D'Amely, Guido
D'Arrigo, Stefano
Sterpa, Marco Aurelio
Sampieri, Alessio
Galasso, Fabio
Computer Vision and Pattern Recognition
Detecting the anomaly of human behavior is paramount to timely recognizing endangering situations, such as street fights or elderly falls. However, anomaly detection is complex since anomalous events are rare and because it is an open set recognition task, i.e., what is anomalous at inference has not been observed at training. We propose COSKAD, a novel model that encodes skeletal human motion by a graph convolutional network and learns to COntract SKeletal kinematic embeddings onto a latent hypersphere of minimum volume for Video Anomaly Detection. We propose three latent spaces: the commonly-adopted Euclidean and the novel spherical and hyperbolic. All variants outperform the state-of-the-art on the most recent UBnormal dataset, for which we contribute a human-related version with annotated skeletons. COSKAD sets a new state-of-the-art on the human-related versions of ShanghaiTech Campus and CUHK Avenue, with performance comparable to video-based methods. Source code and dataset will be released upon acceptance.
title Contracting Skeletal Kinematics for Human-Related Video Anomaly Detection
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2301.09489