Visual Autoregressive Modelling for Monocular Depth Estimation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: El-Ghoussani, Amir, Kaup, André, Navab, Nassir, Carneiro, Gustavo, Belagiannis, Vasileios
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911341167509504
author El-Ghoussani, Amir
Kaup, André
Navab, Nassir
Carneiro, Gustavo
Belagiannis, Vasileios
author_facet El-Ghoussani, Amir
Kaup, André
Navab, Nassir
Carneiro, Gustavo
Belagiannis, Vasileios
contents We propose a monocular depth estimation method based on visual autoregressive (VAR) priors, offering an alternative to diffusion-based approaches. Our method adapts a large-scale text-to-image VAR model and introduces a scale-wise conditional upsampling mechanism with classifier-free guidance. Our approach performs inference in ten fixed autoregressive stages, requiring only 74K synthetic samples for fine-tuning, and achieves competitive results. We report state-of-the-art performance in indoor benchmarks under constrained training conditions, and strong performance when applied to outdoor datasets. This work establishes autoregressive priors as a complementary family of geometry-aware generative models for depth estimation, highlighting advantages in data scalability, and adaptability to 3D vision tasks. Code available at "https://github.com/AmirMaEl/VAR-Depth".
format Preprint
id arxiv_https___arxiv_org_abs_2512_22653
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Visual Autoregressive Modelling for Monocular Depth Estimation
El-Ghoussani, Amir
Kaup, André
Navab, Nassir
Carneiro, Gustavo
Belagiannis, Vasileios
Computer Vision and Pattern Recognition
We propose a monocular depth estimation method based on visual autoregressive (VAR) priors, offering an alternative to diffusion-based approaches. Our method adapts a large-scale text-to-image VAR model and introduces a scale-wise conditional upsampling mechanism with classifier-free guidance. Our approach performs inference in ten fixed autoregressive stages, requiring only 74K synthetic samples for fine-tuning, and achieves competitive results. We report state-of-the-art performance in indoor benchmarks under constrained training conditions, and strong performance when applied to outdoor datasets. This work establishes autoregressive priors as a complementary family of geometry-aware generative models for depth estimation, highlighting advantages in data scalability, and adaptability to 3D vision tasks. Code available at "https://github.com/AmirMaEl/VAR-Depth".
title Visual Autoregressive Modelling for Monocular Depth Estimation
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2512.22653