Combining Boundary Supervision and Segment-Level Regularization for Fine-Grained Action Segmentation

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Mitsuoka, Hinako, Hotta, Kazuhiro
Formato: Preprint
Publicado: 2026
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866912998365331456
author Mitsuoka, Hinako
Hotta, Kazuhiro
author_facet Mitsuoka, Hinako
Hotta, Kazuhiro
contents Recent progress in Temporal Action Segmentation (TAS) has increasingly relied on complex architectures, which can hinder practical deployment. We present a lightweight dual-loss training framework that improves fine-grained segmentation quality with only one additional output channel and two auxiliary loss terms, requiring minimal architectural modification. Our approach combines a boundary-regression loss that promotes accurate temporal localization via a single-channel boundary prediction and a CDF-based segment-level regularization loss that encourages coherent within-segment structure by matching cumulative distributions over predicted and ground-truth segments. The framework is architecture-agnostic and can be integrated into existing TAS models (e.g., MS-TCN, C2F-TCN, FACT) as a training-time loss function. Across three benchmark datasets, the proposed method improves segment-level consistency and boundary quality, yielding higher F1 and Edit scores across three different models. Frame-wise accuracy remains largely unchanged, highlighting that precise segmentation can be achieved through simple loss design rather than heavier architectures or inference-time refinements.
format Preprint
id arxiv_https___arxiv_org_abs_2604_01859
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Combining Boundary Supervision and Segment-Level Regularization for Fine-Grained Action Segmentation
Mitsuoka, Hinako
Hotta, Kazuhiro
Computer Vision and Pattern Recognition
Recent progress in Temporal Action Segmentation (TAS) has increasingly relied on complex architectures, which can hinder practical deployment. We present a lightweight dual-loss training framework that improves fine-grained segmentation quality with only one additional output channel and two auxiliary loss terms, requiring minimal architectural modification. Our approach combines a boundary-regression loss that promotes accurate temporal localization via a single-channel boundary prediction and a CDF-based segment-level regularization loss that encourages coherent within-segment structure by matching cumulative distributions over predicted and ground-truth segments. The framework is architecture-agnostic and can be integrated into existing TAS models (e.g., MS-TCN, C2F-TCN, FACT) as a training-time loss function. Across three benchmark datasets, the proposed method improves segment-level consistency and boundary quality, yielding higher F1 and Edit scores across three different models. Frame-wise accuracy remains largely unchanged, highlighting that precise segmentation can be achieved through simple loss design rather than heavier architectures or inference-time refinements.
title Combining Boundary Supervision and Segment-Level Regularization for Fine-Grained Action Segmentation
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2604.01859