Gespeichert in:
| Hauptverfasser: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | https://arxiv.org/abs/2407.18632 |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866910543625846784 |
|---|---|
| author | Irobe, Hiroo Aoki, Wataru Yamazaki, Kimihiro Zhang, Yuhui Nakagawa, Takumi Waida, Hiroki Wada, Yuichiro Kanamori, Takafumi |
| author_facet | Irobe, Hiroo Aoki, Wataru Yamazaki, Kimihiro Zhang, Yuhui Nakagawa, Takumi Waida, Hiroki Wada, Yuichiro Kanamori, Takafumi |
| contents | Advancing defensive mechanisms against adversarial attacks in generative models is a critical research topic in machine learning. Our study focuses on a specific type of generative models - Variational Auto-Encoders (VAEs). Contrary to common beliefs and existing literature which suggest that noise injection towards training data can make models more robust, our preliminary experiments revealed that naive usage of noise augmentation technique did not substantially improve VAE robustness. In fact, it even degraded the quality of learned representations, making VAEs more susceptible to adversarial perturbations. This paper introduces a novel framework that enhances robustness by regularizing the latent space divergence between original and noise-augmented data. Through incorporating a paired probabilistic prior into the standard variational lower bound, our method significantly boosts defense against adversarial attacks. Our empirical evaluations demonstrate that this approach, termed Robust Augmented Variational Auto-ENcoder (RAVEN), yields superior performance in resisting adversarial inputs on widely-recognized benchmark datasets. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2407_18632 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Robust VAEs via Generating Process of Noise Augmented Data Irobe, Hiroo Aoki, Wataru Yamazaki, Kimihiro Zhang, Yuhui Nakagawa, Takumi Waida, Hiroki Wada, Yuichiro Kanamori, Takafumi Machine Learning Advancing defensive mechanisms against adversarial attacks in generative models is a critical research topic in machine learning. Our study focuses on a specific type of generative models - Variational Auto-Encoders (VAEs). Contrary to common beliefs and existing literature which suggest that noise injection towards training data can make models more robust, our preliminary experiments revealed that naive usage of noise augmentation technique did not substantially improve VAE robustness. In fact, it even degraded the quality of learned representations, making VAEs more susceptible to adversarial perturbations. This paper introduces a novel framework that enhances robustness by regularizing the latent space divergence between original and noise-augmented data. Through incorporating a paired probabilistic prior into the standard variational lower bound, our method significantly boosts defense against adversarial attacks. Our empirical evaluations demonstrate that this approach, termed Robust Augmented Variational Auto-ENcoder (RAVEN), yields superior performance in resisting adversarial inputs on widely-recognized benchmark datasets. |
| title | Robust VAEs via Generating Process of Noise Augmented Data |
| topic | Machine Learning |
| url | https://arxiv.org/abs/2407.18632 |