Learning from Synthetic Data via Provenance-Based Input Gradient Guidance

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Nagano, Koshiro, Fujii, Ryo, Hachiuma, Ryo, Sato, Fumiaki, Sekii, Taiki, Saito, Hideo
Format: Preprint
Publié: 2026
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866911564853936128
author Nagano, Koshiro
Fujii, Ryo
Hachiuma, Ryo
Sato, Fumiaki
Sekii, Taiki
Saito, Hideo
author_facet Nagano, Koshiro
Fujii, Ryo
Hachiuma, Ryo
Sato, Fumiaki
Sekii, Taiki
Saito, Hideo
contents Learning methods using synthetic data have attracted attention as an effective approach for increasing the diversity of training data while reducing collection costs, thereby improving the robustness of model discrimination. However, many existing methods improve robustness only indirectly through the diversification of training samples and do not explicitly teach the model which regions in the input space truly contribute to discrimination; consequently, the model may learn spurious correlations caused by synthesis biases and artifacts. Motivated by this limitation, this paper proposes a learning framework that uses provenance information obtained during the training data synthesis process, indicating whether each region in the input space originates from the target object, as an auxiliary supervisory signal to promote the acquisition of representations focused on target regions. Specifically, input gradients are decomposed based on information about target and non-target regions during synthesis, and input gradient guidance is introduced to suppress gradients over non-target regions. This suppresses the model's reliance on non-target regions and directly promotes the learning of discriminative representations for target regions. Experiments demonstrate the effectiveness and generality of the proposed method across multiple tasks and modalities, including weakly supervised object localization, spatio-temporal action localization, and image classification.
format Preprint
id arxiv_https___arxiv_org_abs_2604_02946
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Learning from Synthetic Data via Provenance-Based Input Gradient Guidance
Nagano, Koshiro
Fujii, Ryo
Hachiuma, Ryo
Sato, Fumiaki
Sekii, Taiki
Saito, Hideo
Computer Vision and Pattern Recognition
Artificial Intelligence
Machine Learning
Learning methods using synthetic data have attracted attention as an effective approach for increasing the diversity of training data while reducing collection costs, thereby improving the robustness of model discrimination. However, many existing methods improve robustness only indirectly through the diversification of training samples and do not explicitly teach the model which regions in the input space truly contribute to discrimination; consequently, the model may learn spurious correlations caused by synthesis biases and artifacts. Motivated by this limitation, this paper proposes a learning framework that uses provenance information obtained during the training data synthesis process, indicating whether each region in the input space originates from the target object, as an auxiliary supervisory signal to promote the acquisition of representations focused on target regions. Specifically, input gradients are decomposed based on information about target and non-target regions during synthesis, and input gradient guidance is introduced to suppress gradients over non-target regions. This suppresses the model's reliance on non-target regions and directly promotes the learning of discriminative representations for target regions. Experiments demonstrate the effectiveness and generality of the proposed method across multiple tasks and modalities, including weakly supervised object localization, spatio-temporal action localization, and image classification.
title Learning from Synthetic Data via Provenance-Based Input Gradient Guidance
topic Computer Vision and Pattern Recognition
Artificial Intelligence
Machine Learning
url https://arxiv.org/abs/2604.02946