High-Fidelity Human Avatars from Laptop Webcams using Edge Compute

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Haridas, Akash, Junejo, Imran N.
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866914425663913984
author Haridas, Akash
Junejo, Imran N.
author_facet Haridas, Akash
Junejo, Imran N.
contents Photo-realistic human avatars have broad applications, yet high-fidelity avatar generation has traditionally required expensive professional camera rigs and extensive artistic labor. Recent research has enabled constructing them automatically from smartphones with RGB and IR sensors, however, these new methods still rely on high-resolution cameras on modern smartphones and often require offloading the processing to powerful servers with GPUs. Modern applications such as video conferencing call for the ability to generate these avatars from consumer-grade laptop webcams using limited compute available on-device. In this work, we develop a novel method based on 3D morphable models, landmark detection, photorealistic texture GANs, and differentiable rendering to tackle the problem of low webcam image quality and edge computation. We build an automatic system to generate high-fidelity animatable avatars under these limitations, leveraging the compute capabilities of AMD mobile processors.
format Preprint
id arxiv_https___arxiv_org_abs_2502_02468
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle High-Fidelity Human Avatars from Laptop Webcams using Edge Compute
Haridas, Akash
Junejo, Imran N.
Computer Vision and Pattern Recognition
Photo-realistic human avatars have broad applications, yet high-fidelity avatar generation has traditionally required expensive professional camera rigs and extensive artistic labor. Recent research has enabled constructing them automatically from smartphones with RGB and IR sensors, however, these new methods still rely on high-resolution cameras on modern smartphones and often require offloading the processing to powerful servers with GPUs. Modern applications such as video conferencing call for the ability to generate these avatars from consumer-grade laptop webcams using limited compute available on-device. In this work, we develop a novel method based on 3D morphable models, landmark detection, photorealistic texture GANs, and differentiable rendering to tackle the problem of low webcam image quality and edge computation. We build an automatic system to generate high-fidelity animatable avatars under these limitations, leveraging the compute capabilities of AMD mobile processors.
title High-Fidelity Human Avatars from Laptop Webcams using Edge Compute
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2502.02468