Target-Guided Adversarial Point Cloud Transformer Towards Recognition Against Real-world Corruptions

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Wang, Jie, Xu, Tingfa, Ding, Lihe, Li, Jianan
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916464465805312
author Wang, Jie
Xu, Tingfa
Ding, Lihe
Li, Jianan
author_facet Wang, Jie
Xu, Tingfa
Ding, Lihe
Li, Jianan
contents Achieving robust 3D perception in the face of corrupted data presents an challenging hurdle within 3D vision research. Contemporary transformer-based point cloud recognition models, albeit advanced, tend to overfit to specific patterns, consequently undermining their robustness against corruption. In this work, we introduce the Target-Guided Adversarial Point Cloud Transformer, termed APCT, a novel architecture designed to augment global structure capture through an adversarial feature erasing mechanism predicated on patterns discerned at each step during training. Specifically, APCT integrates an Adversarial Significance Identifier and a Target-guided Promptor. The Adversarial Significance Identifier, is tasked with discerning token significance by integrating global contextual analysis, utilizing a structural salience index algorithm alongside an auxiliary supervisory mechanism. The Target-guided Promptor, is responsible for accentuating the propensity for token discard within the self-attention mechanism, utilizing the value derived above, consequently directing the model attention towards alternative segments in subsequent stages. By iteratively applying this strategy in multiple steps during training, the network progressively identifies and integrates an expanded array of object-associated patterns. Extensive experiments demonstrate that our method achieves state-of-the-art results on multiple corruption benchmarks.
format Preprint
id arxiv_https___arxiv_org_abs_2411_00462
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Target-Guided Adversarial Point Cloud Transformer Towards Recognition Against Real-world Corruptions
Wang, Jie
Xu, Tingfa
Ding, Lihe
Li, Jianan
Computer Vision and Pattern Recognition
Achieving robust 3D perception in the face of corrupted data presents an challenging hurdle within 3D vision research. Contemporary transformer-based point cloud recognition models, albeit advanced, tend to overfit to specific patterns, consequently undermining their robustness against corruption. In this work, we introduce the Target-Guided Adversarial Point Cloud Transformer, termed APCT, a novel architecture designed to augment global structure capture through an adversarial feature erasing mechanism predicated on patterns discerned at each step during training. Specifically, APCT integrates an Adversarial Significance Identifier and a Target-guided Promptor. The Adversarial Significance Identifier, is tasked with discerning token significance by integrating global contextual analysis, utilizing a structural salience index algorithm alongside an auxiliary supervisory mechanism. The Target-guided Promptor, is responsible for accentuating the propensity for token discard within the self-attention mechanism, utilizing the value derived above, consequently directing the model attention towards alternative segments in subsequent stages. By iteratively applying this strategy in multiple steps during training, the network progressively identifies and integrates an expanded array of object-associated patterns. Extensive experiments demonstrate that our method achieves state-of-the-art results on multiple corruption benchmarks.
title Target-Guided Adversarial Point Cloud Transformer Towards Recognition Against Real-world Corruptions
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2411.00462