SoccerNet-v3D: Leveraging Sports Broadcast Replays for 3D Scene Understanding

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Gutiérrez-Pérez, Marc, Agudo, Antonio
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915241186557952
author Gutiérrez-Pérez, Marc
Agudo, Antonio
author_facet Gutiérrez-Pérez, Marc
Agudo, Antonio
contents Sports video analysis is a key domain in computer vision, enabling detailed spatial understanding through multi-view correspondences. In this work, we introduce SoccerNet-v3D and ISSIA-3D, two enhanced and scalable datasets designed for 3D scene understanding in soccer broadcast analysis. These datasets extend SoccerNet-v3 and ISSIA by incorporating field-line-based camera calibration and multi-view synchronization, enabling 3D object localization through triangulation. We propose a monocular 3D ball localization task built upon the triangulation of ground-truth 2D ball annotations, along with several calibration and reprojection metrics to assess annotation quality on demand. Additionally, we present a single-image 3D ball localization method as a baseline, leveraging camera calibration and ball size priors to estimate the ball's position from a monocular viewpoint. To further refine 2D annotations, we introduce a bounding box optimization technique that ensures alignment with the 3D scene representation. Our proposed datasets establish new benchmarks for 3D soccer scene understanding, enhancing both spatial and temporal analysis in sports analytics. Finally, we provide code to facilitate access to our annotations and the generation pipelines for the datasets.
format Preprint
id arxiv_https___arxiv_org_abs_2504_10106
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle SoccerNet-v3D: Leveraging Sports Broadcast Replays for 3D Scene Understanding
Gutiérrez-Pérez, Marc
Agudo, Antonio
Computer Vision and Pattern Recognition
Artificial Intelligence
I.2; I.4; I.5
Sports video analysis is a key domain in computer vision, enabling detailed spatial understanding through multi-view correspondences. In this work, we introduce SoccerNet-v3D and ISSIA-3D, two enhanced and scalable datasets designed for 3D scene understanding in soccer broadcast analysis. These datasets extend SoccerNet-v3 and ISSIA by incorporating field-line-based camera calibration and multi-view synchronization, enabling 3D object localization through triangulation. We propose a monocular 3D ball localization task built upon the triangulation of ground-truth 2D ball annotations, along with several calibration and reprojection metrics to assess annotation quality on demand. Additionally, we present a single-image 3D ball localization method as a baseline, leveraging camera calibration and ball size priors to estimate the ball's position from a monocular viewpoint. To further refine 2D annotations, we introduce a bounding box optimization technique that ensures alignment with the 3D scene representation. Our proposed datasets establish new benchmarks for 3D soccer scene understanding, enhancing both spatial and temporal analysis in sports analytics. Finally, we provide code to facilitate access to our annotations and the generation pipelines for the datasets.
title SoccerNet-v3D: Leveraging Sports Broadcast Replays for 3D Scene Understanding
topic Computer Vision and Pattern Recognition
Artificial Intelligence
I.2; I.4; I.5
url https://arxiv.org/abs/2504.10106