Saved in:
Bibliographic Details
Main Authors: Li, Shuang, Gao, Jian, Kim, Chulhong, Choi, Seongwook, Chen, Qian, Wang, Yibing, Wu, Shuang, Zhang, Yu, Huang, Tingting, Zhou, Yucheng, Yao, Boxin, Yao, Yao, Li, Changhui
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2604.09643
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915931343552512
author Li, Shuang
Gao, Jian
Kim, Chulhong
Choi, Seongwook
Chen, Qian
Wang, Yibing
Wu, Shuang
Zhang, Yu
Huang, Tingting
Zhou, Yucheng
Yao, Boxin
Yao, Yao
Li, Changhui
author_facet Li, Shuang
Gao, Jian
Kim, Chulhong
Choi, Seongwook
Chen, Qian
Wang, Yibing
Wu, Shuang
Zhang, Yu
Huang, Tingting
Zhou, Yucheng
Yao, Boxin
Yao, Yao
Li, Changhui
contents Three-dimensional (3D) handheld photoacoustic tomography typically relies on bulky and expensive external positioning sensors to correct motion artifacts, which severely limits its clinical flexibility and accessibility. To address this challenge, we present PA-SFM, a tracker-free framework that leverages exclusively single-modality photoacoustic data for both sensor pose recovery and high-fidelity 3D reconstruction via differentiable acoustic radiation modeling. Unlike traditional structure-from-motion (SFM) methods based on visual features, PA-SFM integrates the acoustic wave equation into a differentiable programming pipeline. By leveraging a high-performance, GPU-accelerated acoustic radiation kernel, the framework simultaneously optimizes the 3D photoacoustic source distribution and the sensor array pose via gradient descent. To ensure robust convergence in freehand scenarios, we introduce a coarse-to-fine optimization strategy that incorporates geometric consistency checks and rigid-body constraints to eliminate motion outliers. We validated the proposed method through both numerical simulations and in-vivo rat experiments. The results demonstrate that PA-SFM achieves sub-millimeter positioning accuracy and restores high-resolution 3D vascular structures comparable to ground-truth benchmarks, offering a low-cost, software-defined solution for clinical freehand photoacoustic imaging. The source code is publicly available at \href{https://github.com/JaegerCQ/PA-SFM}{https://github.com/JaegerCQ/PA-SFM}.
format Preprint
id arxiv_https___arxiv_org_abs_2604_09643
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle PA-SFM: Tracker-free differentiable acoustic radiation for freehand 3D photoacoustic imaging
Li, Shuang
Gao, Jian
Kim, Chulhong
Choi, Seongwook
Chen, Qian
Wang, Yibing
Wu, Shuang
Zhang, Yu
Huang, Tingting
Zhou, Yucheng
Yao, Boxin
Yao, Yao
Li, Changhui
Computer Vision and Pattern Recognition
Three-dimensional (3D) handheld photoacoustic tomography typically relies on bulky and expensive external positioning sensors to correct motion artifacts, which severely limits its clinical flexibility and accessibility. To address this challenge, we present PA-SFM, a tracker-free framework that leverages exclusively single-modality photoacoustic data for both sensor pose recovery and high-fidelity 3D reconstruction via differentiable acoustic radiation modeling. Unlike traditional structure-from-motion (SFM) methods based on visual features, PA-SFM integrates the acoustic wave equation into a differentiable programming pipeline. By leveraging a high-performance, GPU-accelerated acoustic radiation kernel, the framework simultaneously optimizes the 3D photoacoustic source distribution and the sensor array pose via gradient descent. To ensure robust convergence in freehand scenarios, we introduce a coarse-to-fine optimization strategy that incorporates geometric consistency checks and rigid-body constraints to eliminate motion outliers. We validated the proposed method through both numerical simulations and in-vivo rat experiments. The results demonstrate that PA-SFM achieves sub-millimeter positioning accuracy and restores high-resolution 3D vascular structures comparable to ground-truth benchmarks, offering a low-cost, software-defined solution for clinical freehand photoacoustic imaging. The source code is publicly available at \href{https://github.com/JaegerCQ/PA-SFM}{https://github.com/JaegerCQ/PA-SFM}.
title PA-SFM: Tracker-free differentiable acoustic radiation for freehand 3D photoacoustic imaging
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2604.09643