Saved in:
Bibliographic Details
Main Authors: Hu, Yiming, Chu, Xiangxiang, Wang, Yong
Format: Preprint
Published: 2023
Subjects:
Online Access:https://arxiv.org/abs/2311.12086
Tags: Add Tag
No Tags, Be the first to tag this record!
Table of Contents:
  • Neural Architecture Search (NAS) relies heavily on labeled data, which is labor-intensive and time-consuming to obtain. In this paper, we propose a novel NAS method based on an unsupervised paradigm, specifically Masked Autoencoders (MAE), thereby eliminating the need for labeled data. By replacing the supervised learning objective with an image reconstruction task, our approach enables the efficient discovery of network architectures without compromising performance and generalization ability. Additionally, we address the problem of performance collapse encountered in the widely-used Differentiable Architecture Search (DARTS) in the unsupervised setting by designing a hierarchical decoder. Extensive experiments across various datasets demonstrate the effectiveness and robustness of our method, offering empirical evidence of its superiority over the counterparts.