Adaptive aggregation of Monte Carlo augmented decomposed filters for efficient group-equivariant convolutional neural network
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2023
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866912962436923392 |
|---|---|
| author | Zhao, Wenzhao Wichtmann, Barbara D. Albert, Steffen Maurer, Angelika Zöllner, Frank G. Hesser, Jürgen |
| author_facet | Zhao, Wenzhao Wichtmann, Barbara D. Albert, Steffen Maurer, Angelika Zöllner, Frank G. Hesser, Jürgen |
| contents | Group-equivariant convolutional neural networks (G-CNN) heavily rely on parameter sharing to increase CNN's data efficiency and performance. However, the parameter-sharing strategy greatly increases the computational burden for each added parameter, which hampers its application to deep neural network models. In this paper, we address these problems by proposing a non-parameter-sharing approach for group equivariant neural networks. The proposed methods adaptively aggregate a diverse range of filters by a weighted sum of stochastically augmented decomposed filters. We give theoretical proof about how the group equivariance can be achieved by our methods. Our method applies to both continuous and discrete groups, where the augmentation is implemented using Monte Carlo sampling and bootstrap resampling, respectively. Our methods also serve as an efficient extension of standard CNN. The experiments show that our method outperforms parameter-sharing group equivariant networks and enhances the performance of standard CNNs in image classification and denoising tasks, by using suitable filter bases to build efficient lightweight networks. The code is available at https://github.com/ZhaoWenzhao/MCG_CNN. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2305_10110 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Adaptive aggregation of Monte Carlo augmented decomposed filters for efficient group-equivariant convolutional neural network Zhao, Wenzhao Wichtmann, Barbara D. Albert, Steffen Maurer, Angelika Zöllner, Frank G. Hesser, Jürgen Computer Vision and Pattern Recognition Group-equivariant convolutional neural networks (G-CNN) heavily rely on parameter sharing to increase CNN's data efficiency and performance. However, the parameter-sharing strategy greatly increases the computational burden for each added parameter, which hampers its application to deep neural network models. In this paper, we address these problems by proposing a non-parameter-sharing approach for group equivariant neural networks. The proposed methods adaptively aggregate a diverse range of filters by a weighted sum of stochastically augmented decomposed filters. We give theoretical proof about how the group equivariance can be achieved by our methods. Our method applies to both continuous and discrete groups, where the augmentation is implemented using Monte Carlo sampling and bootstrap resampling, respectively. Our methods also serve as an efficient extension of standard CNN. The experiments show that our method outperforms parameter-sharing group equivariant networks and enhances the performance of standard CNNs in image classification and denoising tasks, by using suitable filter bases to build efficient lightweight networks. The code is available at https://github.com/ZhaoWenzhao/MCG_CNN. |
| title | Adaptive aggregation of Monte Carlo augmented decomposed filters for efficient group-equivariant convolutional neural network |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2305.10110 |