Generic Event Boundary Detection via Denoising Diffusion

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Hwang, Jaejun, Gong, Dayoung, Kim, Manjin, Cho, Minsu
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866911107498639360
author Hwang, Jaejun
Gong, Dayoung
Kim, Manjin
Cho, Minsu
author_facet Hwang, Jaejun
Gong, Dayoung
Kim, Manjin
Cho, Minsu
contents Generic event boundary detection (GEBD) aims to identify natural boundaries in a video, segmenting it into distinct and meaningful chunks. Despite the inherent subjectivity of event boundaries, previous methods have focused on deterministic predictions, overlooking the diversity of plausible solutions. In this paper, we introduce a novel diffusion-based boundary detection model, dubbed DiffGEBD, that tackles the problem of GEBD from a generative perspective. The proposed model encodes relevant changes across adjacent frames via temporal self-similarity and then iteratively decodes random noise into plausible event boundaries being conditioned on the encoded features. Classifier-free guidance allows the degree of diversity to be controlled in denoising diffusion. In addition, we introduce a new evaluation metric to assess the quality of predictions considering both diversity and fidelity. Experiments show that our method achieves strong performance on two standard benchmarks, Kinetics-GEBD and TAPOS, generating diverse and plausible event boundaries.
format Preprint
id arxiv_https___arxiv_org_abs_2508_12084
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Generic Event Boundary Detection via Denoising Diffusion
Hwang, Jaejun
Gong, Dayoung
Kim, Manjin
Cho, Minsu
Computer Vision and Pattern Recognition
Artificial Intelligence
Generic event boundary detection (GEBD) aims to identify natural boundaries in a video, segmenting it into distinct and meaningful chunks. Despite the inherent subjectivity of event boundaries, previous methods have focused on deterministic predictions, overlooking the diversity of plausible solutions. In this paper, we introduce a novel diffusion-based boundary detection model, dubbed DiffGEBD, that tackles the problem of GEBD from a generative perspective. The proposed model encodes relevant changes across adjacent frames via temporal self-similarity and then iteratively decodes random noise into plausible event boundaries being conditioned on the encoded features. Classifier-free guidance allows the degree of diversity to be controlled in denoising diffusion. In addition, we introduce a new evaluation metric to assess the quality of predictions considering both diversity and fidelity. Experiments show that our method achieves strong performance on two standard benchmarks, Kinetics-GEBD and TAPOS, generating diverse and plausible event boundaries.
title Generic Event Boundary Detection via Denoising Diffusion
topic Computer Vision and Pattern Recognition
Artificial Intelligence
url https://arxiv.org/abs/2508.12084