Content-Style Identification via Differential Independence

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Timilsina, Subash, Nguyen, Hoang-Son, Shrestha, Sagar, Fu, Xiao
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866911692659621888
author Timilsina, Subash
Nguyen, Hoang-Son
Shrestha, Sagar
Fu, Xiao
author_facet Timilsina, Subash
Nguyen, Hoang-Son
Shrestha, Sagar
Fu, Xiao
contents Generative analysis often models multi-domain observations as nonlinear mixtures of domain-invariant content variables and domain-specific style variables. Identifying both factors from unpaired domains enables tasks such as domain transfer and counterfactual data generation. Prior work establishes identifiability under (block-wise) statistical independence between content and style, or via sparse Jacobian assumptions on the nonlinear mixing function, but such conditions can be restrictive in practice. In this work, we introduce content-style differential independence (CSDI), an alternative structural condition requiring that infinitesimal variations in content and style induce orthogonal directions on the data manifold, thereby enabling identifiability even when content and style are dependent and the Jacobian is dense. We operationalize this condition through a blockwise orthogonality constraint on the Jacobian subspaces associated with content and style. To support high-dimensional generative models, we design a stochastic regularizer based on numerical Jacobian approximation, enabling scalable training in settings such as high-resolution image generation. Experiments across multiple datasets corroborate the identifiability analysis and demonstrate practical benefits on counterfactual generation and domain translation.
format Preprint
id arxiv_https___arxiv_org_abs_2605_17827
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Content-Style Identification via Differential Independence
Timilsina, Subash
Nguyen, Hoang-Son
Shrestha, Sagar
Fu, Xiao
Machine Learning
Artificial Intelligence
Generative analysis often models multi-domain observations as nonlinear mixtures of domain-invariant content variables and domain-specific style variables. Identifying both factors from unpaired domains enables tasks such as domain transfer and counterfactual data generation. Prior work establishes identifiability under (block-wise) statistical independence between content and style, or via sparse Jacobian assumptions on the nonlinear mixing function, but such conditions can be restrictive in practice. In this work, we introduce content-style differential independence (CSDI), an alternative structural condition requiring that infinitesimal variations in content and style induce orthogonal directions on the data manifold, thereby enabling identifiability even when content and style are dependent and the Jacobian is dense. We operationalize this condition through a blockwise orthogonality constraint on the Jacobian subspaces associated with content and style. To support high-dimensional generative models, we design a stochastic regularizer based on numerical Jacobian approximation, enabling scalable training in settings such as high-resolution image generation. Experiments across multiple datasets corroborate the identifiability analysis and demonstrate practical benefits on counterfactual generation and domain translation.
title Content-Style Identification via Differential Independence
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2605.17827