Sports-QA: A Large-Scale Video Question Answering Benchmark for Complex and Professional Sports
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866908747971952640 |
|---|---|
| author | Li, Haopeng Deng, Andong Liu, Jun Rahmani, Hossein Guo, Yulan Schiele, Bernt Bennamoun, Mohammed Ke, Qiuhong |
| author_facet | Li, Haopeng Deng, Andong Liu, Jun Rahmani, Hossein Guo, Yulan Schiele, Bernt Bennamoun, Mohammed Ke, Qiuhong |
| contents | Reasoning over sports videos for question answering is an important task with numerous applications, such as player training and information retrieval. However, this task has not been explored due to the lack of relevant datasets and the challenging nature it presents. Most datasets for video question answering (VideoQA) focus mainly on general and coarse-grained understanding of daily-life videos, which is not applicable to sports scenarios requiring professional action understanding and fine-grained motion analysis. In this paper, we introduce the first dataset, named Sports-QA, specifically designed for the sports VideoQA task. The Sports-QA dataset includes various types of questions, such as descriptions, chronologies, causalities, and counterfactual conditions, covering multiple sports. Furthermore, to address the characteristics of the sports VideoQA task, we propose a new Auto-Focus Transformer (AFT) capable of automatically focusing on particular scales of temporal information for question answering. We conduct extensive experiments on Sports-QA, including baseline studies and the evaluation of different methods. The results demonstrate that our AFT achieves state-of-the-art performance. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2401_01505 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Sports-QA: A Large-Scale Video Question Answering Benchmark for Complex and Professional Sports Li, Haopeng Deng, Andong Liu, Jun Rahmani, Hossein Guo, Yulan Schiele, Bernt Bennamoun, Mohammed Ke, Qiuhong Computer Vision and Pattern Recognition Reasoning over sports videos for question answering is an important task with numerous applications, such as player training and information retrieval. However, this task has not been explored due to the lack of relevant datasets and the challenging nature it presents. Most datasets for video question answering (VideoQA) focus mainly on general and coarse-grained understanding of daily-life videos, which is not applicable to sports scenarios requiring professional action understanding and fine-grained motion analysis. In this paper, we introduce the first dataset, named Sports-QA, specifically designed for the sports VideoQA task. The Sports-QA dataset includes various types of questions, such as descriptions, chronologies, causalities, and counterfactual conditions, covering multiple sports. Furthermore, to address the characteristics of the sports VideoQA task, we propose a new Auto-Focus Transformer (AFT) capable of automatically focusing on particular scales of temporal information for question answering. We conduct extensive experiments on Sports-QA, including baseline studies and the evaluation of different methods. The results demonstrate that our AFT achieves state-of-the-art performance. |
| title | Sports-QA: A Large-Scale Video Question Answering Benchmark for Complex and Professional Sports |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2401.01505 |