Im2Haircut: Single-view Strand-based Hair Reconstruction for Human Avatars

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Sklyarova, Vanessa, Zakharov, Egor, Prinzler, Malte, Becherini, Giorgio, Black, Michael J., Thies, Justus
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866908512520503296
author Sklyarova, Vanessa
Zakharov, Egor
Prinzler, Malte
Becherini, Giorgio
Black, Michael J.
Thies, Justus
author_facet Sklyarova, Vanessa
Zakharov, Egor
Prinzler, Malte
Becherini, Giorgio
Black, Michael J.
Thies, Justus
contents We present a novel approach for 3D hair reconstruction from single photographs based on a global hair prior combined with local optimization. Capturing strand-based hair geometry from single photographs is challenging due to the variety and geometric complexity of hairstyles and the lack of ground truth training data. Classical reconstruction methods like multi-view stereo only reconstruct the visible hair strands, missing the inner structure of hairstyles and hampering realistic hair simulation. To address this, existing methods leverage hairstyle priors trained on synthetic data. Such data, however, is limited in both quantity and quality since it requires manual work from skilled artists to model the 3D hairstyles and create near-photorealistic renderings. To address this, we propose a novel approach that uses both, real and synthetic data to learn an effective hairstyle prior. Specifically, we train a transformer-based prior model on synthetic data to obtain knowledge of the internal hairstyle geometry and introduce real data in the learning process to model the outer structure. This training scheme is able to model the visible hair strands depicted in an input image, while preserving the general 3D structure of hairstyles. We exploit this prior to create a Gaussian-splatting-based reconstruction method that creates hairstyles from one or more images. Qualitative and quantitative comparisons with existing reconstruction pipelines demonstrate the effectiveness and superior performance of our method for capturing detailed hair orientation, overall silhouette, and backside consistency. For additional results and code, please refer to https://im2haircut.is.tue.mpg.de.
format Preprint
id arxiv_https___arxiv_org_abs_2509_01469
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Im2Haircut: Single-view Strand-based Hair Reconstruction for Human Avatars
Sklyarova, Vanessa
Zakharov, Egor
Prinzler, Malte
Becherini, Giorgio
Black, Michael J.
Thies, Justus
Computer Vision and Pattern Recognition
We present a novel approach for 3D hair reconstruction from single photographs based on a global hair prior combined with local optimization. Capturing strand-based hair geometry from single photographs is challenging due to the variety and geometric complexity of hairstyles and the lack of ground truth training data. Classical reconstruction methods like multi-view stereo only reconstruct the visible hair strands, missing the inner structure of hairstyles and hampering realistic hair simulation. To address this, existing methods leverage hairstyle priors trained on synthetic data. Such data, however, is limited in both quantity and quality since it requires manual work from skilled artists to model the 3D hairstyles and create near-photorealistic renderings. To address this, we propose a novel approach that uses both, real and synthetic data to learn an effective hairstyle prior. Specifically, we train a transformer-based prior model on synthetic data to obtain knowledge of the internal hairstyle geometry and introduce real data in the learning process to model the outer structure. This training scheme is able to model the visible hair strands depicted in an input image, while preserving the general 3D structure of hairstyles. We exploit this prior to create a Gaussian-splatting-based reconstruction method that creates hairstyles from one or more images. Qualitative and quantitative comparisons with existing reconstruction pipelines demonstrate the effectiveness and superior performance of our method for capturing detailed hair orientation, overall silhouette, and backside consistency. For additional results and code, please refer to https://im2haircut.is.tue.mpg.de.
title Im2Haircut: Single-view Strand-based Hair Reconstruction for Human Avatars
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2509.01469