Physics-Based iOCT Sonification for Real-time Interaction Awareness in Subretinal Injection

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Vargas, Luis D. Reyes, Ruozzi, Veronica, Ross, Andrea K. M., Dehghani, Shervin, Sommersperger, Michael, Faridpooya, Koorosh, Nasseri, Mohammad Ali, Fairhurst, Merle, Navab, Nassir, Matinfar, Sasan
Formato: Preprint
Publicado: 2026
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866909042135269376
author Vargas, Luis D. Reyes
Ruozzi, Veronica
Ross, Andrea K. M.
Dehghani, Shervin
Sommersperger, Michael
Faridpooya, Koorosh
Nasseri, Mohammad Ali
Fairhurst, Merle
Navab, Nassir
Matinfar, Sasan
author_facet Vargas, Luis D. Reyes
Ruozzi, Veronica
Ross, Andrea K. M.
Dehghani, Shervin
Sommersperger, Michael
Faridpooya, Koorosh
Nasseri, Mohammad Ali
Fairhurst, Merle
Navab, Nassir
Matinfar, Sasan
contents Subretinal injection is a delicate vitreoretinal procedure requiring precise needle placement within the subretinal space while avoiding perforation of the retinal pigment epithelium (RPE), a layer directly beneath the target with extremely limited regenerative capacity. To enhance depth perception during cannula advancement, intraoperative optical coherence tomography (iOCT) offers high-resolution cross-sectional visualization of needle-tissue interaction; however, interpreting these images requires sustained visual attention alongside the en face microscope view, thereby increasing cognitive load during critical phases and placing additional demands on the surgeon's proprioceptive control. In this paper, we propose a structured, real-time sonification framework designed for extensible mapping of iOCT-derived anatomical features into perceptual auditory feedback. The method employs a physics-inspired acoustic model driven by segmented retinal layers from a stream of iOCT B-scans, with needle motion and injection-induced retinal layer displacements serving as excitation inputs to the sound model, enabling perception of tool position and retinal deformation. In a controlled user study (n=34), the proposed sonification achieved high retinal layer identification accuracy and robust detection of retinal deformation-related events, significantly outperforming a state-of-the-art baseline in overall event identification (83.4% vs. 60.6%, p < 0.001), with gains driven primarily by enhanced detection of injection-induced retinal deformation. Evaluation by experts (n=4) confirmed the clinical relevance and potential intraoperative applicability of the method. These results establish structured iOCT sonification as a viable complementary modality for real-time surgical guidance in subretinal injection.
format Preprint
id arxiv_https___arxiv_org_abs_2605_14500
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Physics-Based iOCT Sonification for Real-time Interaction Awareness in Subretinal Injection
Vargas, Luis D. Reyes
Ruozzi, Veronica
Ross, Andrea K. M.
Dehghani, Shervin
Sommersperger, Michael
Faridpooya, Koorosh
Nasseri, Mohammad Ali
Fairhurst, Merle
Navab, Nassir
Matinfar, Sasan
Sound
Human-Computer Interaction
Image and Video Processing
Subretinal injection is a delicate vitreoretinal procedure requiring precise needle placement within the subretinal space while avoiding perforation of the retinal pigment epithelium (RPE), a layer directly beneath the target with extremely limited regenerative capacity. To enhance depth perception during cannula advancement, intraoperative optical coherence tomography (iOCT) offers high-resolution cross-sectional visualization of needle-tissue interaction; however, interpreting these images requires sustained visual attention alongside the en face microscope view, thereby increasing cognitive load during critical phases and placing additional demands on the surgeon's proprioceptive control. In this paper, we propose a structured, real-time sonification framework designed for extensible mapping of iOCT-derived anatomical features into perceptual auditory feedback. The method employs a physics-inspired acoustic model driven by segmented retinal layers from a stream of iOCT B-scans, with needle motion and injection-induced retinal layer displacements serving as excitation inputs to the sound model, enabling perception of tool position and retinal deformation. In a controlled user study (n=34), the proposed sonification achieved high retinal layer identification accuracy and robust detection of retinal deformation-related events, significantly outperforming a state-of-the-art baseline in overall event identification (83.4% vs. 60.6%, p < 0.001), with gains driven primarily by enhanced detection of injection-induced retinal deformation. Evaluation by experts (n=4) confirmed the clinical relevance and potential intraoperative applicability of the method. These results establish structured iOCT sonification as a viable complementary modality for real-time surgical guidance in subretinal injection.
title Physics-Based iOCT Sonification for Real-time Interaction Awareness in Subretinal Injection
topic Sound
Human-Computer Interaction
Image and Video Processing
url https://arxiv.org/abs/2605.14500