SL$^{2}$A-INR: Single-Layer Learnable Activation for Implicit Neural Representation
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866908570036994048 |
|---|---|
| author | Heidari, Moein Rezaeian, Reza Azad, Reza Merhof, Dorit Soltanian-Zadeh, Hamid Hacihaliloglu, Ilker |
| author_facet | Heidari, Moein Rezaeian, Reza Azad, Reza Merhof, Dorit Soltanian-Zadeh, Hamid Hacihaliloglu, Ilker |
| contents | Implicit Neural Representation (INR), leveraging a neural network to transform coordinate input into corresponding attributes, has recently driven significant advances in several vision-related domains. However, the performance of INR is heavily influenced by the choice of the nonlinear activation function used in its multilayer perceptron (MLP) architecture. To date, multiple nonlinearities have been investigated, but current INRs still face limitations in capturing high-frequency components and diverse signal types. We show that these challenges can be alleviated by introducing a novel approach in INR architecture. Specifically, we propose SL$^{2}$A-INR, a hybrid network that combines a single-layer learnable activation function with an MLP that uses traditional ReLU activations. Our method performs superior across diverse tasks, including image representation, 3D shape reconstruction, and novel view synthesis. Through comprehensive experiments, SL$^{2}$A-INR sets new benchmarks in accuracy, quality, and robustness for INR. Our Code is publicly available on~\href{https://github.com/Iceage7/SL2A-INR}{\textcolor{magenta}{GitHub}}. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2409_10836 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | SL$^{2}$A-INR: Single-Layer Learnable Activation for Implicit Neural Representation Heidari, Moein Rezaeian, Reza Azad, Reza Merhof, Dorit Soltanian-Zadeh, Hamid Hacihaliloglu, Ilker Computer Vision and Pattern Recognition Implicit Neural Representation (INR), leveraging a neural network to transform coordinate input into corresponding attributes, has recently driven significant advances in several vision-related domains. However, the performance of INR is heavily influenced by the choice of the nonlinear activation function used in its multilayer perceptron (MLP) architecture. To date, multiple nonlinearities have been investigated, but current INRs still face limitations in capturing high-frequency components and diverse signal types. We show that these challenges can be alleviated by introducing a novel approach in INR architecture. Specifically, we propose SL$^{2}$A-INR, a hybrid network that combines a single-layer learnable activation function with an MLP that uses traditional ReLU activations. Our method performs superior across diverse tasks, including image representation, 3D shape reconstruction, and novel view synthesis. Through comprehensive experiments, SL$^{2}$A-INR sets new benchmarks in accuracy, quality, and robustness for INR. Our Code is publicly available on~\href{https://github.com/Iceage7/SL2A-INR}{\textcolor{magenta}{GitHub}}. |
| title | SL$^{2}$A-INR: Single-Layer Learnable Activation for Implicit Neural Representation |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2409.10836 |