Saved in:
Bibliographic Details
Main Authors: Ren, Yili, Wen, Shiqi, Hou, Li, Xiao, Dingwen, Zhang, Weiming, Cao, Caleb Chen, Wang, Lin, Zheng, Zilu, Su, Qianxiao, Zhao, Mingjun, Chen, Lei
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2604.14805
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914479427551232
author Ren, Yili
Wen, Shiqi
Hou, Li
Xiao, Dingwen
Zhang, Weiming
Cao, Caleb Chen
Wang, Lin
Zheng, Zilu
Su, Qianxiao
Zhao, Mingjun
Chen, Lei
author_facet Ren, Yili
Wen, Shiqi
Hou, Li
Xiao, Dingwen
Zhang, Weiming
Cao, Caleb Chen
Wang, Lin
Zheng, Zilu
Su, Qianxiao
Zhao, Mingjun
Chen, Lei
contents Grain-edge segmentation (GES) and lithology semantic segmentation (LSS) are two pivotal tasks for quantifying rock fabric and composition. However, these two tasks are often treated separately, and the segmentation quality is implausible albeit expensive, time-consuming, and expert-annotated datasets have been used. Recently, foundation models, especially the Segment Anything Model (SAM), have demonstrated impressive robustness for boundary alignment. However, directly adapting SAM to joint GES and LSS is nontrivial due to 1) severe domain gap induced by extinction-dependent color variations and ultra-fine grain boundaries, and 2) lacking novel modules for joint learning on multi-angle petrographic image stacks. In this paper, we propose Petro-SAM, a novel two-stage, multi-task framework that can achieve high-quality joint GES and LSS on petrographic images. Specifically, based on SAM, we introduce a Merge Block to integrate seven polarized views, effectively solving the extinction issue. Moreover, we introduce multi-scale feature fusion and color-entropy priors to refine the detection.
format Preprint
id arxiv_https___arxiv_org_abs_2604_14805
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle From Boundaries to Semantics: Prompt-Guided Multi-Task Learning for Petrographic Thin-section Segmentation
Ren, Yili
Wen, Shiqi
Hou, Li
Xiao, Dingwen
Zhang, Weiming
Cao, Caleb Chen
Wang, Lin
Zheng, Zilu
Su, Qianxiao
Zhao, Mingjun
Chen, Lei
Computer Vision and Pattern Recognition
Grain-edge segmentation (GES) and lithology semantic segmentation (LSS) are two pivotal tasks for quantifying rock fabric and composition. However, these two tasks are often treated separately, and the segmentation quality is implausible albeit expensive, time-consuming, and expert-annotated datasets have been used. Recently, foundation models, especially the Segment Anything Model (SAM), have demonstrated impressive robustness for boundary alignment. However, directly adapting SAM to joint GES and LSS is nontrivial due to 1) severe domain gap induced by extinction-dependent color variations and ultra-fine grain boundaries, and 2) lacking novel modules for joint learning on multi-angle petrographic image stacks. In this paper, we propose Petro-SAM, a novel two-stage, multi-task framework that can achieve high-quality joint GES and LSS on petrographic images. Specifically, based on SAM, we introduce a Merge Block to integrate seven polarized views, effectively solving the extinction issue. Moreover, we introduce multi-scale feature fusion and color-entropy priors to refine the detection.
title From Boundaries to Semantics: Prompt-Guided Multi-Task Learning for Petrographic Thin-section Segmentation
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2604.14805