TaxaDiffusion: Progressively Trained Diffusion Model for Fine-Grained Species Generation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Monsefi, Amin Karimi, Khurana, Mridul, Ramnath, Rajiv, Karpatne, Anuj, Chao, Wei-Lun, Zhang, Cheng
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916811036950528
author Monsefi, Amin Karimi
Khurana, Mridul
Ramnath, Rajiv
Karpatne, Anuj
Chao, Wei-Lun
Zhang, Cheng
author_facet Monsefi, Amin Karimi
Khurana, Mridul
Ramnath, Rajiv
Karpatne, Anuj
Chao, Wei-Lun
Zhang, Cheng
contents We propose TaxaDiffusion, a taxonomy-informed training framework for diffusion models to generate fine-grained animal images with high morphological and identity accuracy. Unlike standard approaches that treat each species as an independent category, TaxaDiffusion incorporates domain knowledge that many species exhibit strong visual similarities, with distinctions often residing in subtle variations of shape, pattern, and color. To exploit these relationships, TaxaDiffusion progressively trains conditioned diffusion models across different taxonomic levels -- starting from broad classifications such as Class and Order, refining through Family and Genus, and ultimately distinguishing at the Species level. This hierarchical learning strategy first captures coarse-grained morphological traits shared by species with common ancestors, facilitating knowledge transfer before refining fine-grained differences for species-level distinction. As a result, TaxaDiffusion enables accurate generation even with limited training samples per species. Extensive experiments on three fine-grained animal datasets demonstrate that outperforms existing approaches, achieving superior fidelity in fine-grained animal image generation. Project page: https://amink8.github.io/TaxaDiffusion/
format Preprint
id arxiv_https___arxiv_org_abs_2506_01923
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle TaxaDiffusion: Progressively Trained Diffusion Model for Fine-Grained Species Generation
Monsefi, Amin Karimi
Khurana, Mridul
Ramnath, Rajiv
Karpatne, Anuj
Chao, Wei-Lun
Zhang, Cheng
Computer Vision and Pattern Recognition
Artificial Intelligence
Machine Learning
We propose TaxaDiffusion, a taxonomy-informed training framework for diffusion models to generate fine-grained animal images with high morphological and identity accuracy. Unlike standard approaches that treat each species as an independent category, TaxaDiffusion incorporates domain knowledge that many species exhibit strong visual similarities, with distinctions often residing in subtle variations of shape, pattern, and color. To exploit these relationships, TaxaDiffusion progressively trains conditioned diffusion models across different taxonomic levels -- starting from broad classifications such as Class and Order, refining through Family and Genus, and ultimately distinguishing at the Species level. This hierarchical learning strategy first captures coarse-grained morphological traits shared by species with common ancestors, facilitating knowledge transfer before refining fine-grained differences for species-level distinction. As a result, TaxaDiffusion enables accurate generation even with limited training samples per species. Extensive experiments on three fine-grained animal datasets demonstrate that outperforms existing approaches, achieving superior fidelity in fine-grained animal image generation. Project page: https://amink8.github.io/TaxaDiffusion/
title TaxaDiffusion: Progressively Trained Diffusion Model for Fine-Grained Species Generation
topic Computer Vision and Pattern Recognition
Artificial Intelligence
Machine Learning
url https://arxiv.org/abs/2506.01923