Trajectory Densification and Depth from Perspective-based Blur

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Qiu, Tianchen, Zhang, Qirun, He, Jiajian, Zhuge, Zhengyue, Xu, Jiahui, Chen, Yueting
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866914190047838208
author Qiu, Tianchen
Zhang, Qirun
He, Jiajian
Zhuge, Zhengyue
Xu, Jiahui
Chen, Yueting
author_facet Qiu, Tianchen
Zhang, Qirun
He, Jiajian
Zhuge, Zhengyue
Xu, Jiahui
Chen, Yueting
contents In the absence of a mechanical stabilizer, the camera undergoes inevitable rotational dynamics during capturing, which induces perspective-based blur especially under long-exposure scenarios. From an optical standpoint, perspective-based blur is depth-position-dependent: objects residing at distinct spatial locations incur different blur levels even under the same imaging settings. Inspired by this, we propose a novel method that estimate metric depth by examining the blur pattern of a video stream and dense trajectory via joint optical design algorithm. Specifically, we employ off-the-shelf vision encoder and point tracker to extract video information. Then, we estimate depth map via windowed embedding and multi-window aggregation, and densify the sparse trajectory from the optical algorithm using a vision-language model. Evaluations on multiple depth datasets demonstrate that our method attains strong performance over large depth range, while maintaining favorable generalization. Relative to the real trajectory in handheld shooting settings, our optical algorithm achieves superior precision and the dense reconstruction maintains strong accuracy.
format Preprint
id arxiv_https___arxiv_org_abs_2512_08627
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Trajectory Densification and Depth from Perspective-based Blur
Qiu, Tianchen
Zhang, Qirun
He, Jiajian
Zhuge, Zhengyue
Xu, Jiahui
Chen, Yueting
Computer Vision and Pattern Recognition
In the absence of a mechanical stabilizer, the camera undergoes inevitable rotational dynamics during capturing, which induces perspective-based blur especially under long-exposure scenarios. From an optical standpoint, perspective-based blur is depth-position-dependent: objects residing at distinct spatial locations incur different blur levels even under the same imaging settings. Inspired by this, we propose a novel method that estimate metric depth by examining the blur pattern of a video stream and dense trajectory via joint optical design algorithm. Specifically, we employ off-the-shelf vision encoder and point tracker to extract video information. Then, we estimate depth map via windowed embedding and multi-window aggregation, and densify the sparse trajectory from the optical algorithm using a vision-language model. Evaluations on multiple depth datasets demonstrate that our method attains strong performance over large depth range, while maintaining favorable generalization. Relative to the real trajectory in handheld shooting settings, our optical algorithm achieves superior precision and the dense reconstruction maintains strong accuracy.
title Trajectory Densification and Depth from Perspective-based Blur
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2512.08627