Adversarial Data Augmentation for Single Domain Generalization via Lyapunov Exponent-Guided Optimization

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Zhang, Zuyu, Chen, Ning, Liu, Yongshan, Zhang, Qinghua, Zhang, Xu
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866916829187801088
author Zhang, Zuyu
Chen, Ning
Liu, Yongshan
Zhang, Qinghua
Zhang, Xu
author_facet Zhang, Zuyu
Chen, Ning
Liu, Yongshan
Zhang, Qinghua
Zhang, Xu
contents Single Domain Generalization (SDG) aims to develop models capable of generalizing to unseen target domains using only one source domain, a task complicated by substantial domain shifts and limited data diversity. Existing SDG approaches primarily rely on data augmentation techniques, which struggle to effectively adapt training dynamics to accommodate large domain shifts. To address this, we propose LEAwareSGD, a novel Lyapunov Exponent (LE)-guided optimization approach inspired by dynamical systems theory. By leveraging LE measurements to modulate the learning rate, LEAwareSGD encourages model training near the edge of chaos, a critical state that optimally balances stability and adaptability. This dynamic adjustment allows the model to explore a wider parameter space and capture more generalizable features, ultimately enhancing the model's generalization capability. Extensive experiments on PACS, OfficeHome, and DomainNet demonstrate that LEAwareSGD yields substantial generalization gains, achieving up to 9.47\% improvement on PACS in low-data regimes. These results underscore the effectiveness of training near the edge of chaos for enhancing model generalization capability in SDG tasks.
format Preprint
id arxiv_https___arxiv_org_abs_2507_04302
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Adversarial Data Augmentation for Single Domain Generalization via Lyapunov Exponent-Guided Optimization
Zhang, Zuyu
Chen, Ning
Liu, Yongshan
Zhang, Qinghua
Zhang, Xu
Computer Vision and Pattern Recognition
Machine Learning
Single Domain Generalization (SDG) aims to develop models capable of generalizing to unseen target domains using only one source domain, a task complicated by substantial domain shifts and limited data diversity. Existing SDG approaches primarily rely on data augmentation techniques, which struggle to effectively adapt training dynamics to accommodate large domain shifts. To address this, we propose LEAwareSGD, a novel Lyapunov Exponent (LE)-guided optimization approach inspired by dynamical systems theory. By leveraging LE measurements to modulate the learning rate, LEAwareSGD encourages model training near the edge of chaos, a critical state that optimally balances stability and adaptability. This dynamic adjustment allows the model to explore a wider parameter space and capture more generalizable features, ultimately enhancing the model's generalization capability. Extensive experiments on PACS, OfficeHome, and DomainNet demonstrate that LEAwareSGD yields substantial generalization gains, achieving up to 9.47\% improvement on PACS in low-data regimes. These results underscore the effectiveness of training near the edge of chaos for enhancing model generalization capability in SDG tasks.
title Adversarial Data Augmentation for Single Domain Generalization via Lyapunov Exponent-Guided Optimization
topic Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2507.04302