Saved in:
Bibliographic Details
Main Authors: Zhang, Pingping, Yan, Tianyu, Wang, Yuhao, Liu, Yang, Tang, Tongdan, Ma, Yili, Lv, Long, Tian, Feng, Sun, Weibing, Lu, and Huchuan
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2603.12708
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914390574366720
author Zhang, Pingping
Yan, Tianyu
Wang, Yuhao
Liu, Yang
Tang, Tongdan
Ma, Yili
Lv, Long
Tian, Feng
Sun, Weibing
Lu, and Huchuan
author_facet Zhang, Pingping
Yan, Tianyu
Wang, Yuhao
Liu, Yang
Tang, Tongdan
Ma, Yili
Lv, Long
Tian, Feng
Sun, Weibing
Lu, and Huchuan
contents Marine Animal Segmentation (MAS) aims at identifying and segmenting marine animals from complex marine environments. Most of previous deep learning-based MAS methods struggle with the long-distance modeling issue. Recently, Segment Anything Model (SAM) has gained popularity in general image segmentation. However, it lacks of perceiving fine-grained details and frequency information. To this end, we propose a novel learning framework, named Hierarchical Frequency Prompted SAM (HFP-SAM) for high-performance MAS. First, we design a Frequency Guided Adapter (FGA) to efficiently inject marine scene information into the frozen SAM backbone through frequency domain prior masks. Additionally, we introduce a Frequency-aware Point Selection (FPS) to generate highlighted regions through frequency analysis. These regions are combined with the coarse predictions of SAM to generate point prompts and integrate into SAM's decoder for fine predictions. Finally, to obtain comprehensive segmentation masks, we introduce a Full-View Mamba (FVM) to efficiently extract spatial and channel contextual information with linear computational complexity. Extensive experiments on four public datasets demonstrate the superior performance of our approach. The source code is publicly available at https://github.com/Drchip61/TIP-HFP-SAM.
format Preprint
id arxiv_https___arxiv_org_abs_2603_12708
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle HFP-SAM: Hierarchical Frequency Prompted SAM for Efficient Marine Animal Segmentation
Zhang, Pingping
Yan, Tianyu
Wang, Yuhao
Liu, Yang
Tang, Tongdan
Ma, Yili
Lv, Long
Tian, Feng
Sun, Weibing
Lu, and Huchuan
Computer Vision and Pattern Recognition
Marine Animal Segmentation (MAS) aims at identifying and segmenting marine animals from complex marine environments. Most of previous deep learning-based MAS methods struggle with the long-distance modeling issue. Recently, Segment Anything Model (SAM) has gained popularity in general image segmentation. However, it lacks of perceiving fine-grained details and frequency information. To this end, we propose a novel learning framework, named Hierarchical Frequency Prompted SAM (HFP-SAM) for high-performance MAS. First, we design a Frequency Guided Adapter (FGA) to efficiently inject marine scene information into the frozen SAM backbone through frequency domain prior masks. Additionally, we introduce a Frequency-aware Point Selection (FPS) to generate highlighted regions through frequency analysis. These regions are combined with the coarse predictions of SAM to generate point prompts and integrate into SAM's decoder for fine predictions. Finally, to obtain comprehensive segmentation masks, we introduce a Full-View Mamba (FVM) to efficiently extract spatial and channel contextual information with linear computational complexity. Extensive experiments on four public datasets demonstrate the superior performance of our approach. The source code is publicly available at https://github.com/Drchip61/TIP-HFP-SAM.
title HFP-SAM: Hierarchical Frequency Prompted SAM for Efficient Marine Animal Segmentation
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2603.12708