Iris: Bringing Real-World Priors into Diffusion Model for Monocular Depth Estimation

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Cai, Xinhao, Pei, Gensheng, Sun, Zeren, Yao, Yazhou, Shen, Fumin, Wang, Wenguan
Format: Preprint
Veröffentlicht: 2026
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866910059940806656
author Cai, Xinhao
Pei, Gensheng
Sun, Zeren
Yao, Yazhou
Shen, Fumin
Wang, Wenguan
author_facet Cai, Xinhao
Pei, Gensheng
Sun, Zeren
Yao, Yazhou
Shen, Fumin
Wang, Wenguan
contents In this paper, we propose \textbf{Iris}, a deterministic framework for Monocular Depth Estimation (MDE) that integrates real-world priors into the diffusion model. Conventional feed-forward methods rely on massive training data, yet still miss details. Previous diffusion-based methods leverage rich generative priors yet struggle with synthetic-to-real domain transfer. Iris, in contrast, preserves fine details, generalizes strongly from synthetic to real scenes, and remains efficient with limited training data. To this end, we introduce a two-stage Priors-to-Geometry Deterministic (PGD) schedule: the prior stage uses Spectral-Gated Distillation (SGD) to transfer low-frequency real priors while leaving high-frequency details unconstrained, and the geometry stage applies Spectral-Gated Consistency (SGC) to enforce high-frequency fidelity while refining with synthetic ground truth. The two stages share weights and are executed with a high-to-low timestep schedule. Extensive experimental results confirm that Iris achieves significant improvements in MDE performance with strong in-the-wild generalization.
format Preprint
id arxiv_https___arxiv_org_abs_2603_16340
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Iris: Bringing Real-World Priors into Diffusion Model for Monocular Depth Estimation
Cai, Xinhao
Pei, Gensheng
Sun, Zeren
Yao, Yazhou
Shen, Fumin
Wang, Wenguan
Computer Vision and Pattern Recognition
In this paper, we propose \textbf{Iris}, a deterministic framework for Monocular Depth Estimation (MDE) that integrates real-world priors into the diffusion model. Conventional feed-forward methods rely on massive training data, yet still miss details. Previous diffusion-based methods leverage rich generative priors yet struggle with synthetic-to-real domain transfer. Iris, in contrast, preserves fine details, generalizes strongly from synthetic to real scenes, and remains efficient with limited training data. To this end, we introduce a two-stage Priors-to-Geometry Deterministic (PGD) schedule: the prior stage uses Spectral-Gated Distillation (SGD) to transfer low-frequency real priors while leaving high-frequency details unconstrained, and the geometry stage applies Spectral-Gated Consistency (SGC) to enforce high-frequency fidelity while refining with synthetic ground truth. The two stages share weights and are executed with a high-to-low timestep schedule. Extensive experimental results confirm that Iris achieves significant improvements in MDE performance with strong in-the-wild generalization.
title Iris: Bringing Real-World Priors into Diffusion Model for Monocular Depth Estimation
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2603.16340