Tracking of Intermittent and Moving Speakers : Dataset and Metrics

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Iatariene, Taous, Guérin, Alexandre, Serizel, Romain
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913890805219328
author Iatariene, Taous
Guérin, Alexandre
Serizel, Romain
author_facet Iatariene, Taous
Guérin, Alexandre
Serizel, Romain
contents This paper presents the problem of tracking intermittent and moving sources, i.e, sources that may change position when they are inactive. This issue is seldom explored, and most current tracking methods rely on spatial observations for track identity management. They are either based on a previous localization step, or designed to perform joint localization and tracking by predicting ordered position estimates. This raises concerns about whether such methods can maintain reliable track identity assignment performance when dealing with discontinuous spatial tracks, which may be caused by a change of direction during silence. We introduce LibriJump, a novel dataset of acoustic scenes in the First Order Ambisonics format focusing on speaker tracking. The dataset contains speakers with changing positions during inactivity periods, thus simulating discontinuous tracks. To measure the identity assignment performance, we propose to use tracking association metrics adapted from the computer vision community. We provide experiments showing the complementarity of association metrics with previously used tracking metrics, given continuous and discontinuous spatial tracks.
format Preprint
id arxiv_https___arxiv_org_abs_2506_11145
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Tracking of Intermittent and Moving Speakers : Dataset and Metrics
Iatariene, Taous
Guérin, Alexandre
Serizel, Romain
Audio and Speech Processing
Sound
Signal Processing
This paper presents the problem of tracking intermittent and moving sources, i.e, sources that may change position when they are inactive. This issue is seldom explored, and most current tracking methods rely on spatial observations for track identity management. They are either based on a previous localization step, or designed to perform joint localization and tracking by predicting ordered position estimates. This raises concerns about whether such methods can maintain reliable track identity assignment performance when dealing with discontinuous spatial tracks, which may be caused by a change of direction during silence. We introduce LibriJump, a novel dataset of acoustic scenes in the First Order Ambisonics format focusing on speaker tracking. The dataset contains speakers with changing positions during inactivity periods, thus simulating discontinuous tracks. To measure the identity assignment performance, we propose to use tracking association metrics adapted from the computer vision community. We provide experiments showing the complementarity of association metrics with previously used tracking metrics, given continuous and discontinuous spatial tracks.
title Tracking of Intermittent and Moving Speakers : Dataset and Metrics
topic Audio and Speech Processing
Sound
Signal Processing
url https://arxiv.org/abs/2506.11145