Physics-driven Sonification for Improving Multisensory Needle Guidance in Percutaneous Epicardial Access

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Ruozzi, Veronica, Matinfar, Sasan, Vergara, Pasquale, Albanesi, Alessandro, Dell'Aversana, Serena, Carugo, Stefano, Buccoliero, Gianluigi, Navab, Nassir, Redaelli, Alberto, Votta, Emiliano
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917532769714176
author Ruozzi, Veronica
Matinfar, Sasan
Vergara, Pasquale
Albanesi, Alessandro
Dell'Aversana, Serena
Carugo, Stefano
Buccoliero, Gianluigi
Navab, Nassir
Redaelli, Alberto
Votta, Emiliano
author_facet Ruozzi, Veronica
Matinfar, Sasan
Vergara, Pasquale
Albanesi, Alessandro
Dell'Aversana, Serena
Carugo, Stefano
Buccoliero, Gianluigi
Navab, Nassir
Redaelli, Alberto
Votta, Emiliano
contents Percutaneous epicardial access (PEA), performed on a beating heart under fluoroscopy, enables arrhythmia treatment. However, advancing a needle toward the thin and moving pericardium remains highly challenging and risky. To address this problem, we present a physics-driven sonification method for Extended Reality (XR)-based multisensory navigation to enhance user perception during the critical needle landing phase in PEA. Dynamic cardiac anatomy from 4D CTA was reconstructed and registered to a real-world coordinate system. Real-time needle tracking provided the position of the needle tip relative to moving cardiac structures and drove an audio-visual feedback module. The visual display presented navigational cues and dynamic anatomy, while the auditory display encoded physiological cardiac states using a multilayer physical membrane model. A phantom study was conducted with twelve cardiologists performing needle insertions under visual-only and multisensory feedback. The multisensory method significantly improved navigation safety ($χ^2 = 11.30$, $p < 0.01$), reducing myocardial contact (3.64% vs. 7.27%) and increasing correct access (90.91% vs. 52.73%). Needle placement accuracy improved, with closer membrane proximity (Cliff delta = 0.19) and reduced variability ($p < 0.05$). Execution time was comparable, while time-accuracy correlations differed significantly between modalities ($p < 0.01$). NASA-TLX indicated lower cognitive load with multisensory guidance ($p < 0.01$). These results demonstrate the feasibility of physics-driven sonification for improving spatiotemporal awareness and supporting user-centered surgical navigation.
format Preprint
id arxiv_https___arxiv_org_abs_2604_06911
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Physics-driven Sonification for Improving Multisensory Needle Guidance in Percutaneous Epicardial Access
Ruozzi, Veronica
Matinfar, Sasan
Vergara, Pasquale
Albanesi, Alessandro
Dell'Aversana, Serena
Carugo, Stefano
Buccoliero, Gianluigi
Navab, Nassir
Redaelli, Alberto
Votta, Emiliano
Human-Computer Interaction
Percutaneous epicardial access (PEA), performed on a beating heart under fluoroscopy, enables arrhythmia treatment. However, advancing a needle toward the thin and moving pericardium remains highly challenging and risky. To address this problem, we present a physics-driven sonification method for Extended Reality (XR)-based multisensory navigation to enhance user perception during the critical needle landing phase in PEA. Dynamic cardiac anatomy from 4D CTA was reconstructed and registered to a real-world coordinate system. Real-time needle tracking provided the position of the needle tip relative to moving cardiac structures and drove an audio-visual feedback module. The visual display presented navigational cues and dynamic anatomy, while the auditory display encoded physiological cardiac states using a multilayer physical membrane model. A phantom study was conducted with twelve cardiologists performing needle insertions under visual-only and multisensory feedback. The multisensory method significantly improved navigation safety ($χ^2 = 11.30$, $p < 0.01$), reducing myocardial contact (3.64% vs. 7.27%) and increasing correct access (90.91% vs. 52.73%). Needle placement accuracy improved, with closer membrane proximity (Cliff delta = 0.19) and reduced variability ($p < 0.05$). Execution time was comparable, while time-accuracy correlations differed significantly between modalities ($p < 0.01$). NASA-TLX indicated lower cognitive load with multisensory guidance ($p < 0.01$). These results demonstrate the feasibility of physics-driven sonification for improving spatiotemporal awareness and supporting user-centered surgical navigation.
title Physics-driven Sonification for Improving Multisensory Needle Guidance in Percutaneous Epicardial Access
topic Human-Computer Interaction
url https://arxiv.org/abs/2604.06911