Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2504.02231 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866908298966466560 |
|---|---|
| author | Cui, Zhipu Tian, Andong Ying, Zhi Lu, Jialiang |
| author_facet | Cui, Zhipu Tian, Andong Ying, Zhi Lu, Jialiang |
| contents | Personalized image generation allows users to preserve styles or subjects of a provided small set of images for further image generation. With the advancement in large text-to-image models, many techniques have been developed to efficiently fine-tune those models for personalization, such as Low Rank Adaptation (LoRA). However, LoRA-based methods often face the challenge of adjusting the rank parameter to achieve satisfactory results. To address this challenge, AutoComponent-LoRA (AC-LoRA) is proposed, which is able to automatically separate the signal component and noise component of the LoRA matrices for fast and efficient personalized artistic style image generation. This method is based on Singular Value Decomposition (SVD) and dynamic heuristics to update the hyperparameters during training. Superior performance over existing methods in overcoming model underfitting or overfitting problems is demonstrated. The results were validated using FID, CLIP, DINO, and ImageReward, achieving an average of 9% improvement. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2504_02231 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | AC-LoRA: Auto Component LoRA for Personalized Artistic Style Image Generation Cui, Zhipu Tian, Andong Ying, Zhi Lu, Jialiang Computer Vision and Pattern Recognition Artificial Intelligence 68T05, 68U10 I.2.6; I.4.0 Personalized image generation allows users to preserve styles or subjects of a provided small set of images for further image generation. With the advancement in large text-to-image models, many techniques have been developed to efficiently fine-tune those models for personalization, such as Low Rank Adaptation (LoRA). However, LoRA-based methods often face the challenge of adjusting the rank parameter to achieve satisfactory results. To address this challenge, AutoComponent-LoRA (AC-LoRA) is proposed, which is able to automatically separate the signal component and noise component of the LoRA matrices for fast and efficient personalized artistic style image generation. This method is based on Singular Value Decomposition (SVD) and dynamic heuristics to update the hyperparameters during training. Superior performance over existing methods in overcoming model underfitting or overfitting problems is demonstrated. The results were validated using FID, CLIP, DINO, and ImageReward, achieving an average of 9% improvement. |
| title | AC-LoRA: Auto Component LoRA for Personalized Artistic Style Image Generation |
| topic | Computer Vision and Pattern Recognition Artificial Intelligence 68T05, 68U10 I.2.6; I.4.0 |
| url | https://arxiv.org/abs/2504.02231 |