GeoDiffusion: A Training-Free Framework for Accurate 3D Geometric Conditioning in Image Generation

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Mueller, Phillip, Uenlue, Talip, Schmidt, Sebastian, Kollovieh, Marcel, Fan, Jiajie, Guennemann, Stephan, Mikelsons, Lars
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866909870068858880
author Mueller, Phillip
Uenlue, Talip
Schmidt, Sebastian
Kollovieh, Marcel
Fan, Jiajie
Guennemann, Stephan
Mikelsons, Lars
author_facet Mueller, Phillip
Uenlue, Talip
Schmidt, Sebastian
Kollovieh, Marcel
Fan, Jiajie
Guennemann, Stephan
Mikelsons, Lars
contents Precise geometric control in image generation is essential for engineering \& product design and creative industries to control 3D object features accurately in image space. Traditional 3D editing approaches are time-consuming and demand specialized skills, while current image-based generative methods lack accuracy in geometric conditioning. To address these challenges, we propose GeoDiffusion, a training-free framework for accurate and efficient geometric conditioning of 3D features in image generation. GeoDiffusion employs a class-specific 3D object as a geometric prior to define keypoints and parametric correlations in 3D space. We ensure viewpoint consistency through a rendered image of a reference 3D object, followed by style transfer to meet user-defined appearance specifications. At the core of our framework is GeoDrag, improving accuracy and speed of drag-based image editing on geometry guidance tasks and general instructions on DragBench. Our results demonstrate that GeoDiffusion enables precise geometric modifications across various iterative design workflows.
format Preprint
id arxiv_https___arxiv_org_abs_2510_22337
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle GeoDiffusion: A Training-Free Framework for Accurate 3D Geometric Conditioning in Image Generation
Mueller, Phillip
Uenlue, Talip
Schmidt, Sebastian
Kollovieh, Marcel
Fan, Jiajie
Guennemann, Stephan
Mikelsons, Lars
Computer Vision and Pattern Recognition
Precise geometric control in image generation is essential for engineering \& product design and creative industries to control 3D object features accurately in image space. Traditional 3D editing approaches are time-consuming and demand specialized skills, while current image-based generative methods lack accuracy in geometric conditioning. To address these challenges, we propose GeoDiffusion, a training-free framework for accurate and efficient geometric conditioning of 3D features in image generation. GeoDiffusion employs a class-specific 3D object as a geometric prior to define keypoints and parametric correlations in 3D space. We ensure viewpoint consistency through a rendered image of a reference 3D object, followed by style transfer to meet user-defined appearance specifications. At the core of our framework is GeoDrag, improving accuracy and speed of drag-based image editing on geometry guidance tasks and general instructions on DragBench. Our results demonstrate that GeoDiffusion enables precise geometric modifications across various iterative design workflows.
title GeoDiffusion: A Training-Free Framework for Accurate 3D Geometric Conditioning in Image Generation
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2510.22337