Scaling Ultrasound Volumetric Reconstruction via Mobile Augmented Reality

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Ng, Kian Wei, Gao, Yujia, Khoo, Deborah, Tan, Ying Zhen, Mao, Chengzheng, Cheng, Haojie, Makmur, Andrew, Ngiam, Kee Yuan, Goh, Serene, Khoo, Eng Tat
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912917202403328
author Ng, Kian Wei
Gao, Yujia
Khoo, Deborah
Tan, Ying Zhen
Mao, Chengzheng
Cheng, Haojie
Makmur, Andrew
Ngiam, Kee Yuan
Goh, Serene
Khoo, Eng Tat
author_facet Ng, Kian Wei
Gao, Yujia
Khoo, Deborah
Tan, Ying Zhen
Mao, Chengzheng
Cheng, Haojie
Makmur, Andrew
Ngiam, Kee Yuan
Goh, Serene
Khoo, Eng Tat
contents Accurate volumetric characterization of lesions is essential for oncologic diagnosis, risk stratification, and treatment planning. While imaging modalities such as Computed Tomography provide high-quality 3D data, 2D ultrasound (2D-US) remains the preferred first-line modality for breast and thyroid imaging due to cost, portability, and safety factors. However, volume estimates derived from 2D-US suffer from high inter-user variability even among experienced clinicians. Existing 3D ultrasound (3D-US) solutions use specialized probes or external tracking hardware, but such configurations increase costs and diminish portability, constraining widespread clinical use. To address these limitations, we present Mobile Augmented Reality Volumetric Ultrasound (MARVUS), a resource-efficient system designed to increase accessibility to accurate and reproducible volumetric assessment. MARVUS is interoperable with conventional ultrasound (US) systems, using a foundation model to enhance cross-specialty generalization while minimizing hardware requirements relative to current 3D-US solutions. In a user study involving experienced clinicians performing measurements on breast phantoms, MARVUS yielded a substantial improvement in volume estimation accuracy (mean difference: 0.469 cm3) with reduced inter-user variability (mean difference: 0.417 cm3). Additionally, we prove that augmented reality (AR) visualizations enhance objective performance metrics and clinician-reported usability. Collectively, our findings suggests that MARVUS can enhance US-based cancer screening, diagnostic workflows, and treatment planning in a scalable, cost-conscious, and resource-efficient manner. Usage video demonstration available (https://youtu.be/m4llYcZpqmM).
format Preprint
id arxiv_https___arxiv_org_abs_2602_18500
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Scaling Ultrasound Volumetric Reconstruction via Mobile Augmented Reality
Ng, Kian Wei
Gao, Yujia
Khoo, Deborah
Tan, Ying Zhen
Mao, Chengzheng
Cheng, Haojie
Makmur, Andrew
Ngiam, Kee Yuan
Goh, Serene
Khoo, Eng Tat
Computer Vision and Pattern Recognition
Emerging Technologies
Human-Computer Interaction
Accurate volumetric characterization of lesions is essential for oncologic diagnosis, risk stratification, and treatment planning. While imaging modalities such as Computed Tomography provide high-quality 3D data, 2D ultrasound (2D-US) remains the preferred first-line modality for breast and thyroid imaging due to cost, portability, and safety factors. However, volume estimates derived from 2D-US suffer from high inter-user variability even among experienced clinicians. Existing 3D ultrasound (3D-US) solutions use specialized probes or external tracking hardware, but such configurations increase costs and diminish portability, constraining widespread clinical use. To address these limitations, we present Mobile Augmented Reality Volumetric Ultrasound (MARVUS), a resource-efficient system designed to increase accessibility to accurate and reproducible volumetric assessment. MARVUS is interoperable with conventional ultrasound (US) systems, using a foundation model to enhance cross-specialty generalization while minimizing hardware requirements relative to current 3D-US solutions. In a user study involving experienced clinicians performing measurements on breast phantoms, MARVUS yielded a substantial improvement in volume estimation accuracy (mean difference: 0.469 cm3) with reduced inter-user variability (mean difference: 0.417 cm3). Additionally, we prove that augmented reality (AR) visualizations enhance objective performance metrics and clinician-reported usability. Collectively, our findings suggests that MARVUS can enhance US-based cancer screening, diagnostic workflows, and treatment planning in a scalable, cost-conscious, and resource-efficient manner. Usage video demonstration available (https://youtu.be/m4llYcZpqmM).
title Scaling Ultrasound Volumetric Reconstruction via Mobile Augmented Reality
topic Computer Vision and Pattern Recognition
Emerging Technologies
Human-Computer Interaction
url https://arxiv.org/abs/2602.18500