Bridging Rendering and Generative Modeling with Monte Carlo Transport Scheduling

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Shu, Junwei, Liu, Wenjie, Liu, Hantang, Wang, Changbo, Li, Yang
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917525863792640
author Shu, Junwei
Liu, Wenjie
Liu, Hantang
Wang, Changbo
Li, Yang
author_facet Shu, Junwei
Liu, Wenjie
Liu, Hantang
Wang, Changbo
Li, Yang
contents Monte Carlo rendering and modern generative models both transform uncertain states into structured images, yet they are usually studied as separate processes. We introduce Monte Carlo Transport Scheduling, a framework that treats progressive path tracing as a continuous sampling-driven transport process. Our key observation is that the renderer already produces physically valid states along this process: nested Monte Carlo estimates trace a refinement trajectory whose natural time coordinate follows from sampling variance. This view leads to a continuous training framework that learns from real render endpoints rather than synthetic interpolants, preserving the statistical structure of Monte Carlo estimation while enabling arbitrary-step neural refinement. We evaluate the framework on a controlled rendering benchmark designed to separate transport difficulty from scene context, and show that it yields stable render refinement, supports continuous stopping between rendering states, and transfers as a physical prior for frozen generative samplers. These results suggest a common continuous-time substrate for rendering and generation, where Monte Carlo sampling provides both the physical states and the supervision for learning image transport.
format Preprint
id arxiv_https___arxiv_org_abs_2602_20725
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Bridging Rendering and Generative Modeling with Monte Carlo Transport Scheduling
Shu, Junwei
Liu, Wenjie
Liu, Hantang
Wang, Changbo
Li, Yang
Computer Vision and Pattern Recognition
Monte Carlo rendering and modern generative models both transform uncertain states into structured images, yet they are usually studied as separate processes. We introduce Monte Carlo Transport Scheduling, a framework that treats progressive path tracing as a continuous sampling-driven transport process. Our key observation is that the renderer already produces physically valid states along this process: nested Monte Carlo estimates trace a refinement trajectory whose natural time coordinate follows from sampling variance. This view leads to a continuous training framework that learns from real render endpoints rather than synthetic interpolants, preserving the statistical structure of Monte Carlo estimation while enabling arbitrary-step neural refinement. We evaluate the framework on a controlled rendering benchmark designed to separate transport difficulty from scene context, and show that it yields stable render refinement, supports continuous stopping between rendering states, and transfers as a physical prior for frozen generative samplers. These results suggest a common continuous-time substrate for rendering and generation, where Monte Carlo sampling provides both the physical states and the supervision for learning image transport.
title Bridging Rendering and Generative Modeling with Monte Carlo Transport Scheduling
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2602.20725