High-Quality Virtual Single-Viewpoint Surgical Video: Geometric Autocalibration of Multiple Cameras in Surgical Lights

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Kato, Yuna, Isogawa, Mariko, Mori, Shohei, Saito, Hideo, Kajita, Hiroki, Takatsume, Yoshifumi
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866917946503200768
author Kato, Yuna
Isogawa, Mariko
Mori, Shohei
Saito, Hideo
Kajita, Hiroki
Takatsume, Yoshifumi
author_facet Kato, Yuna
Isogawa, Mariko
Mori, Shohei
Saito, Hideo
Kajita, Hiroki
Takatsume, Yoshifumi
contents Occlusion-free video generation is challenging due to surgeons' obstructions in the camera field of view. Prior work has addressed this issue by installing multiple cameras on a surgical light, hoping some cameras will observe the surgical field with less occlusion. However, this special camera setup poses a new imaging challenge since camera configurations can change every time surgeons move the light, and manual image alignment is required. This paper proposes an algorithm to automate this alignment task. The proposed method detects frames where the lighting system moves, realigns them, and selects the camera with the least occlusion. This algorithm results in a stabilized video with less occlusion. Quantitative results show that our method outperforms conventional approaches. A user study involving medical doctors also confirmed the superiority of our method.
format Preprint
id arxiv_https___arxiv_org_abs_2503_03558
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle High-Quality Virtual Single-Viewpoint Surgical Video: Geometric Autocalibration of Multiple Cameras in Surgical Lights
Kato, Yuna
Isogawa, Mariko
Mori, Shohei
Saito, Hideo
Kajita, Hiroki
Takatsume, Yoshifumi
Computer Vision and Pattern Recognition
Occlusion-free video generation is challenging due to surgeons' obstructions in the camera field of view. Prior work has addressed this issue by installing multiple cameras on a surgical light, hoping some cameras will observe the surgical field with less occlusion. However, this special camera setup poses a new imaging challenge since camera configurations can change every time surgeons move the light, and manual image alignment is required. This paper proposes an algorithm to automate this alignment task. The proposed method detects frames where the lighting system moves, realigns them, and selects the camera with the least occlusion. This algorithm results in a stabilized video with less occlusion. Quantitative results show that our method outperforms conventional approaches. A user study involving medical doctors also confirmed the superiority of our method.
title High-Quality Virtual Single-Viewpoint Surgical Video: Geometric Autocalibration of Multiple Cameras in Surgical Lights
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2503.03558