Saved in:
Bibliographic Details
Main Authors: Piérard, Sébastien, Van Droogenbroeck, Marc
Format: Preprint
Published: 2020
Subjects:
Online Access:https://arxiv.org/abs/2002.05654
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917358520500224
author Piérard, Sébastien
Van Droogenbroeck, Marc
author_facet Piérard, Sébastien
Van Droogenbroeck, Marc
contents There exist many background subtraction algorithms to detect motion in videos. To help comparing them, datasets with ground-truth data such as CDNET or LASIESTA have been proposed. These datasets organize videos in categories that represent typical challenges for background subtraction. The evaluation procedure promoted by their authors consists in measuring performance indicators for each video separately and to average them hierarchically, within a category first, then between categories, a procedure which we name "summarization". While the summarization by averaging performance indicators is a valuable effort to standardize the evaluation procedure, it has no theoretical justification and it breaks the intrinsic relationships between summarized indicators. This leads to interpretation inconsistencies. In this paper, we present a theoretical approach to summarize the performances for multiple videos that preserves the relationships between performance indicators. In addition, we give formulas and an algorithm to calculate summarized performances. Finally, we showcase our observations on CDNET 2014.
format Preprint
id arxiv_https___arxiv_org_abs_2002_05654
institution arXiv
publishDate 2020
record_format arxiv
spellingShingle Summarizing the performances of a background subtraction algorithm measured on several videos
Piérard, Sébastien
Van Droogenbroeck, Marc
Computer Vision and Pattern Recognition
There exist many background subtraction algorithms to detect motion in videos. To help comparing them, datasets with ground-truth data such as CDNET or LASIESTA have been proposed. These datasets organize videos in categories that represent typical challenges for background subtraction. The evaluation procedure promoted by their authors consists in measuring performance indicators for each video separately and to average them hierarchically, within a category first, then between categories, a procedure which we name "summarization". While the summarization by averaging performance indicators is a valuable effort to standardize the evaluation procedure, it has no theoretical justification and it breaks the intrinsic relationships between summarized indicators. This leads to interpretation inconsistencies. In this paper, we present a theoretical approach to summarize the performances for multiple videos that preserves the relationships between performance indicators. In addition, we give formulas and an algorithm to calculate summarized performances. Finally, we showcase our observations on CDNET 2014.
title Summarizing the performances of a background subtraction algorithm measured on several videos
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2002.05654