Context Propagation from Proposals for Semantic Video Object Segmentation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Author: Wang, Tinghuai
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910518543908864
author Wang, Tinghuai
author_facet Wang, Tinghuai
contents In this paper, we propose a novel approach to learning semantic contextual relationships in videos for semantic object segmentation. Our algorithm derives the semantic contexts from video object proposals which encode the key evolution of objects and the relationship among objects over the spatio-temporal domain. This semantic contexts are propagated across the video to estimate the pairwise contexts between all pairs of local superpixels which are integrated into a conditional random field in the form of pairwise potentials and infers the per-superpixel semantic labels. The experiments demonstrate that our contexts learning and propagation model effectively improves the robustness of resolving visual ambiguities in semantic video object segmentation compared with the state-of-the-art methods.
format Preprint
id arxiv_https___arxiv_org_abs_2407_06247
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Context Propagation from Proposals for Semantic Video Object Segmentation
Wang, Tinghuai
Computer Vision and Pattern Recognition
In this paper, we propose a novel approach to learning semantic contextual relationships in videos for semantic object segmentation. Our algorithm derives the semantic contexts from video object proposals which encode the key evolution of objects and the relationship among objects over the spatio-temporal domain. This semantic contexts are propagated across the video to estimate the pairwise contexts between all pairs of local superpixels which are integrated into a conditional random field in the form of pairwise potentials and infers the per-superpixel semantic labels. The experiments demonstrate that our contexts learning and propagation model effectively improves the robustness of resolving visual ambiguities in semantic video object segmentation compared with the state-of-the-art methods.
title Context Propagation from Proposals for Semantic Video Object Segmentation
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2407.06247