Generative Dataset Distillation: Balancing Global Structure and Local Details

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Li, Longzhen, Li, Guang, Togo, Ren, Maeda, Keisuke, Ogawa, Takahiro, Haseyama, Miki
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866909183666814976
author Li, Longzhen
Li, Guang
Togo, Ren
Maeda, Keisuke
Ogawa, Takahiro
Haseyama, Miki
author_facet Li, Longzhen
Li, Guang
Togo, Ren
Maeda, Keisuke
Ogawa, Takahiro
Haseyama, Miki
contents In this paper, we propose a new dataset distillation method that considers balancing global structure and local details when distilling the information from a large dataset into a generative model. Dataset distillation has been proposed to reduce the size of the required dataset when training models. The conventional dataset distillation methods face the problem of long redeployment time and poor cross-architecture performance. Moreover, previous methods focused too much on the high-level semantic attributes between the synthetic dataset and the original dataset while ignoring the local features such as texture and shape. Based on the above understanding, we propose a new method for distilling the original image dataset into a generative model. Our method involves using a conditional generative adversarial network to generate the distilled dataset. Subsequently, we ensure balancing global structure and local details in the distillation process, continuously optimizing the generator for more information-dense dataset generation.
format Preprint
id arxiv_https___arxiv_org_abs_2404_17732
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Generative Dataset Distillation: Balancing Global Structure and Local Details
Li, Longzhen
Li, Guang
Togo, Ren
Maeda, Keisuke
Ogawa, Takahiro
Haseyama, Miki
Computer Vision and Pattern Recognition
Artificial Intelligence
Machine Learning
In this paper, we propose a new dataset distillation method that considers balancing global structure and local details when distilling the information from a large dataset into a generative model. Dataset distillation has been proposed to reduce the size of the required dataset when training models. The conventional dataset distillation methods face the problem of long redeployment time and poor cross-architecture performance. Moreover, previous methods focused too much on the high-level semantic attributes between the synthetic dataset and the original dataset while ignoring the local features such as texture and shape. Based on the above understanding, we propose a new method for distilling the original image dataset into a generative model. Our method involves using a conditional generative adversarial network to generate the distilled dataset. Subsequently, we ensure balancing global structure and local details in the distillation process, continuously optimizing the generator for more information-dense dataset generation.
title Generative Dataset Distillation: Balancing Global Structure and Local Details
topic Computer Vision and Pattern Recognition
Artificial Intelligence
Machine Learning
url https://arxiv.org/abs/2404.17732