Channel-wise Motion Features for Efficient Motion Segmentation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Inoue, Riku, Tsuchiya, Masamitsu, Yasui, Yuji
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912488711258112
author Inoue, Riku
Tsuchiya, Masamitsu
Yasui, Yuji
author_facet Inoue, Riku
Tsuchiya, Masamitsu
Yasui, Yuji
contents For safety-critical robotics applications such as autonomous driving, it is important to detect all required objects accurately in real-time. Motion segmentation offers a solution by identifying dynamic objects from the scene in a class-agnostic manner. Recently, various motion segmentation models have been proposed, most of which jointly use subnetworks to estimate Depth, Pose, Optical Flow, and Scene Flow. As a result, the overall computational cost of the model increases, hindering real-time performance. In this paper, we propose a novel cost-volume-based motion feature representation, Channel-wise Motion Features. By extracting depth features of each instance in the feature map and capturing the scene's 3D motion information, it offers enhanced efficiency. The only subnetwork used to build Channel-wise Motion Features is the Pose Network, and no others are required. Our method not only achieves about 4 times the FPS of state-of-the-art models in the KITTI Dataset and Cityscapes of the VCAS-Motion Dataset, but also demonstrates equivalent accuracy while reducing the parameters to about 25$\%$.
format Preprint
id arxiv_https___arxiv_org_abs_2507_13082
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Channel-wise Motion Features for Efficient Motion Segmentation
Inoue, Riku
Tsuchiya, Masamitsu
Yasui, Yuji
Computer Vision and Pattern Recognition
For safety-critical robotics applications such as autonomous driving, it is important to detect all required objects accurately in real-time. Motion segmentation offers a solution by identifying dynamic objects from the scene in a class-agnostic manner. Recently, various motion segmentation models have been proposed, most of which jointly use subnetworks to estimate Depth, Pose, Optical Flow, and Scene Flow. As a result, the overall computational cost of the model increases, hindering real-time performance. In this paper, we propose a novel cost-volume-based motion feature representation, Channel-wise Motion Features. By extracting depth features of each instance in the feature map and capturing the scene's 3D motion information, it offers enhanced efficiency. The only subnetwork used to build Channel-wise Motion Features is the Pose Network, and no others are required. Our method not only achieves about 4 times the FPS of state-of-the-art models in the KITTI Dataset and Cityscapes of the VCAS-Motion Dataset, but also demonstrates equivalent accuracy while reducing the parameters to about 25$\%$.
title Channel-wise Motion Features for Efficient Motion Segmentation
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2507.13082