OZ-TAL: Online Zero-Shot Temporal Action Localization

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Han, Chaolei, Wang, Hongsong, Gong, Xin, Gui, Jie
Format: Preprint
Publié: 2026
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866911670437150720
author Han, Chaolei
Wang, Hongsong
Gong, Xin
Gui, Jie
author_facet Han, Chaolei
Wang, Hongsong
Gong, Xin
Gui, Jie
contents Online Temporal Action Localization (On-TAL) aims to detect the occurrence time and category of actions in untrimmed streaming videos immediately upon their completion. Recent advancements in this field focus on developing more sophisticated frameworks, shifting from Online Action Detection (OAD)-based aggregation paradigm to instance-level understanding. However, existing approaches are typically trained on specific domains and often exhibit limited generalization capabilities when applied to arbitrary videos, particularly in the presence of previously unseen actions. In this paper, we introduce a new task called Online Zero-shot Temporal Action Localization (OZ-TAL), which aims to detect previously unseen actions in an online fashion. Furthermore, we propose a training-free framework that leverages off-the-shelf Vision-Language Models (VLMs) while introducing additional mechanisms to enhance visual representations and mitigate their inherent biases. We establish new benchmarks and representative baselines for OZ-TAL on THUMOS14 and ActivityNet-1.3, and extensive experiments demonstrate that our method substantially outperforms existing state-of-the-art approaches under both offline and online zero-shot settings.
format Preprint
id arxiv_https___arxiv_org_abs_2605_09976
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle OZ-TAL: Online Zero-Shot Temporal Action Localization
Han, Chaolei
Wang, Hongsong
Gong, Xin
Gui, Jie
Computer Vision and Pattern Recognition
Online Temporal Action Localization (On-TAL) aims to detect the occurrence time and category of actions in untrimmed streaming videos immediately upon their completion. Recent advancements in this field focus on developing more sophisticated frameworks, shifting from Online Action Detection (OAD)-based aggregation paradigm to instance-level understanding. However, existing approaches are typically trained on specific domains and often exhibit limited generalization capabilities when applied to arbitrary videos, particularly in the presence of previously unseen actions. In this paper, we introduce a new task called Online Zero-shot Temporal Action Localization (OZ-TAL), which aims to detect previously unseen actions in an online fashion. Furthermore, we propose a training-free framework that leverages off-the-shelf Vision-Language Models (VLMs) while introducing additional mechanisms to enhance visual representations and mitigate their inherent biases. We establish new benchmarks and representative baselines for OZ-TAL on THUMOS14 and ActivityNet-1.3, and extensive experiments demonstrate that our method substantially outperforms existing state-of-the-art approaches under both offline and online zero-shot settings.
title OZ-TAL: Online Zero-Shot Temporal Action Localization
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2605.09976