Cell as Point: One-Stage Framework for Efficient Cell Tracking

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Song, Yaxuan, Fan, Jianan, Huang, Heng, Chen, Mei, Cai, Weidong
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912643386703872
author Song, Yaxuan
Fan, Jianan
Huang, Heng
Chen, Mei
Cai, Weidong
author_facet Song, Yaxuan
Fan, Jianan
Huang, Heng
Chen, Mei
Cai, Weidong
contents Conventional multi-stage cell tracking approaches rely heavily on detection or segmentation in each frame as a prerequisite, requiring substantial resources for high-quality segmentation masks and increasing the overall prediction time. To address these limitations, we propose CAP, a novel end-to-end one-stage framework that reimagines cell tracking by treating Cell as Point. Unlike traditional methods, CAP eliminates the need for explicit detection or segmentation, instead jointly tracking cells for sequences in one stage by leveraging the inherent correlations among their trajectories. This simplification reduces both labeling requirements and pipeline complexity. However, directly processing the entire sequence in one stage poses challenges related to data imbalance in capturing cell division events and long sequence inference. To solve these challenges, CAP introduces two key innovations: (1) adaptive event-guided (AEG) sampling, which prioritizes cell division events to mitigate the occurrence imbalance of cell events, and (2) the rolling-as-window (RAW) inference strategy, which ensures continuous and stable tracking of newly emerging cells over extended sequences. By removing the dependency on segmentation-based preprocessing while addressing the challenges of imbalanced occurrence of cell events and long-sequence tracking, CAP demonstrates promising cell tracking performance and is 8 to 32 times more efficient than existing methods. The code and model checkpoints will be available soon.
format Preprint
id arxiv_https___arxiv_org_abs_2411_14833
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Cell as Point: One-Stage Framework for Efficient Cell Tracking
Song, Yaxuan
Fan, Jianan
Huang, Heng
Chen, Mei
Cai, Weidong
Image and Video Processing
Computer Vision and Pattern Recognition
Quantitative Methods
Conventional multi-stage cell tracking approaches rely heavily on detection or segmentation in each frame as a prerequisite, requiring substantial resources for high-quality segmentation masks and increasing the overall prediction time. To address these limitations, we propose CAP, a novel end-to-end one-stage framework that reimagines cell tracking by treating Cell as Point. Unlike traditional methods, CAP eliminates the need for explicit detection or segmentation, instead jointly tracking cells for sequences in one stage by leveraging the inherent correlations among their trajectories. This simplification reduces both labeling requirements and pipeline complexity. However, directly processing the entire sequence in one stage poses challenges related to data imbalance in capturing cell division events and long sequence inference. To solve these challenges, CAP introduces two key innovations: (1) adaptive event-guided (AEG) sampling, which prioritizes cell division events to mitigate the occurrence imbalance of cell events, and (2) the rolling-as-window (RAW) inference strategy, which ensures continuous and stable tracking of newly emerging cells over extended sequences. By removing the dependency on segmentation-based preprocessing while addressing the challenges of imbalanced occurrence of cell events and long-sequence tracking, CAP demonstrates promising cell tracking performance and is 8 to 32 times more efficient than existing methods. The code and model checkpoints will be available soon.
title Cell as Point: One-Stage Framework for Efficient Cell Tracking
topic Image and Video Processing
Computer Vision and Pattern Recognition
Quantitative Methods
url https://arxiv.org/abs/2411.14833