The Evolving Nature of Latent Spaces: From GANs to Diffusion

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autore principale: Schaerf, Ludovica
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866909894807912448
author Schaerf, Ludovica
author_facet Schaerf, Ludovica
contents This paper examines the evolving nature of internal representations in generative visual models, focusing on the conceptual and technical shift from GANs and VAEs to diffusion-based architectures. Drawing on Beatrice Fazi's account of synthesis as the amalgamation of distributed representations, we propose a distinction between "synthesis in a strict sense", where a compact latent space wholly determines the generative process, and "synthesis in a broad sense," which characterizes models whose representational labor is distributed across layers. Through close readings of model architectures and a targeted experimental setup that intervenes in layerwise representations, we show how diffusion models fragment the burden of representation and thereby challenge assumptions of unified internal space. By situating these findings within media theoretical frameworks and critically engaging with metaphors such as the latent space and the Platonic Representation Hypothesis, we argue for a reorientation of how generative AI is understood: not as a direct synthesis of content, but as an emergent configuration of specialized processes.
format Preprint
id arxiv_https___arxiv_org_abs_2510_17383
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle The Evolving Nature of Latent Spaces: From GANs to Diffusion
Schaerf, Ludovica
Machine Learning
Computer Vision and Pattern Recognition
Computers and Society
This paper examines the evolving nature of internal representations in generative visual models, focusing on the conceptual and technical shift from GANs and VAEs to diffusion-based architectures. Drawing on Beatrice Fazi's account of synthesis as the amalgamation of distributed representations, we propose a distinction between "synthesis in a strict sense", where a compact latent space wholly determines the generative process, and "synthesis in a broad sense," which characterizes models whose representational labor is distributed across layers. Through close readings of model architectures and a targeted experimental setup that intervenes in layerwise representations, we show how diffusion models fragment the burden of representation and thereby challenge assumptions of unified internal space. By situating these findings within media theoretical frameworks and critically engaging with metaphors such as the latent space and the Platonic Representation Hypothesis, we argue for a reorientation of how generative AI is understood: not as a direct synthesis of content, but as an emergent configuration of specialized processes.
title The Evolving Nature of Latent Spaces: From GANs to Diffusion
topic Machine Learning
Computer Vision and Pattern Recognition
Computers and Society
url https://arxiv.org/abs/2510.17383