Language and Multimodal Models in Sports: A Survey of Datasets and Applications

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Xia, Haotian, Yang, Zhengbang, Zhao, Yun, Wang, Yuqing, Li, Jingxi, Tracy, Rhys, Zhu, Zhuangdi, Wang, Yuan-fang, Chen, Hanjie, Shen, Weining
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866913394368446464
author Xia, Haotian
Yang, Zhengbang
Zhao, Yun
Wang, Yuqing
Li, Jingxi
Tracy, Rhys
Zhu, Zhuangdi
Wang, Yuan-fang
Chen, Hanjie
Shen, Weining
author_facet Xia, Haotian
Yang, Zhengbang
Zhao, Yun
Wang, Yuqing
Li, Jingxi
Tracy, Rhys
Zhu, Zhuangdi
Wang, Yuan-fang
Chen, Hanjie
Shen, Weining
contents Recent integration of Natural Language Processing (NLP) and multimodal models has advanced the field of sports analytics. This survey presents a comprehensive review of the datasets and applications driving these innovations post-2020. We overviewed and categorized datasets into three primary types: language-based, multimodal, and convertible datasets. Language-based and multimodal datasets are for tasks involving text or multimodality (e.g., text, video, audio), respectively. Convertible datasets, initially single-modal (video), can be enriched with additional annotations, such as explanations of actions and video descriptions, to become multimodal, offering future potential for richer and more diverse applications. Our study highlights the contributions of these datasets to various applications, from improving fan experiences to supporting tactical analysis and medical diagnostics. We also discuss the challenges and future directions in dataset development, emphasizing the need for diverse, high-quality data to support real-time processing and personalized user experiences. This survey provides a foundational resource for researchers and practitioners aiming to leverage NLP and multimodal models in sports, offering insights into current trends and future opportunities in the field.
format Preprint
id arxiv_https___arxiv_org_abs_2406_12252
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Language and Multimodal Models in Sports: A Survey of Datasets and Applications
Xia, Haotian
Yang, Zhengbang
Zhao, Yun
Wang, Yuqing
Li, Jingxi
Tracy, Rhys
Zhu, Zhuangdi
Wang, Yuan-fang
Chen, Hanjie
Shen, Weining
Computation and Language
Recent integration of Natural Language Processing (NLP) and multimodal models has advanced the field of sports analytics. This survey presents a comprehensive review of the datasets and applications driving these innovations post-2020. We overviewed and categorized datasets into three primary types: language-based, multimodal, and convertible datasets. Language-based and multimodal datasets are for tasks involving text or multimodality (e.g., text, video, audio), respectively. Convertible datasets, initially single-modal (video), can be enriched with additional annotations, such as explanations of actions and video descriptions, to become multimodal, offering future potential for richer and more diverse applications. Our study highlights the contributions of these datasets to various applications, from improving fan experiences to supporting tactical analysis and medical diagnostics. We also discuss the challenges and future directions in dataset development, emphasizing the need for diverse, high-quality data to support real-time processing and personalized user experiences. This survey provides a foundational resource for researchers and practitioners aiming to leverage NLP and multimodal models in sports, offering insights into current trends and future opportunities in the field.
title Language and Multimodal Models in Sports: A Survey of Datasets and Applications
topic Computation and Language
url https://arxiv.org/abs/2406.12252