Towards Kinetic Manipulation of the Latent Space

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autor principal: Porres, Diego
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866913574995099648
author Porres, Diego
author_facet Porres, Diego
contents The latent space of many generative models are rich in unexplored valleys and mountains. The majority of tools used for exploring them are so far limited to Graphical User Interfaces (GUIs). While specialized hardware can be used for this task, we show that a simple feature extraction of pre-trained Convolutional Neural Networks (CNNs) from a live RGB camera feed does a very good job at manipulating the latent space with simple changes in the scene, with vast room for improvement. We name this new paradigm Visual-reactive Interpolation, and the full code can be found at https://github.com/PDillis/stylegan3-fun.
format Preprint
id arxiv_https___arxiv_org_abs_2409_09867
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Towards Kinetic Manipulation of the Latent Space
Porres, Diego
Computer Vision and Pattern Recognition
Artificial Intelligence
The latent space of many generative models are rich in unexplored valleys and mountains. The majority of tools used for exploring them are so far limited to Graphical User Interfaces (GUIs). While specialized hardware can be used for this task, we show that a simple feature extraction of pre-trained Convolutional Neural Networks (CNNs) from a live RGB camera feed does a very good job at manipulating the latent space with simple changes in the scene, with vast room for improvement. We name this new paradigm Visual-reactive Interpolation, and the full code can be found at https://github.com/PDillis/stylegan3-fun.
title Towards Kinetic Manipulation of the Latent Space
topic Computer Vision and Pattern Recognition
Artificial Intelligence
url https://arxiv.org/abs/2409.09867