Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2406.13514 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909227911479296 |
|---|---|
| author | Sporring, Jon Xu, Peidi Lu, Jiahao Lauze, François Darkner, Sune |
| author_facet | Sporring, Jon Xu, Peidi Lu, Jiahao Lauze, François Darkner, Sune |
| contents | We present Locally Orderless Networks (LON) and its theoretic foundation which links it to Convolutional Neural Networks (CNN), to Scale-space histograms, and measurement theory. The key elements are a regular sampling of the bias and the derivative of the activation function. We compare LON, CNN, and Scale-space histograms on prototypical single-layer networks. We show how LON and CNN can emulate each other, how LON expands the set of functionals computable to non-linear functions such as squaring. We demonstrate simple networks which illustrate the improved performance of LON over CNN on simple tasks for estimating the gradient magnitude squared, for regressing shape area and perimeter lengths, and for explainability of individual pixels' influence on the result. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2406_13514 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Locally orderless networks Sporring, Jon Xu, Peidi Lu, Jiahao Lauze, François Darkner, Sune Computer Vision and Pattern Recognition We present Locally Orderless Networks (LON) and its theoretic foundation which links it to Convolutional Neural Networks (CNN), to Scale-space histograms, and measurement theory. The key elements are a regular sampling of the bias and the derivative of the activation function. We compare LON, CNN, and Scale-space histograms on prototypical single-layer networks. We show how LON and CNN can emulate each other, how LON expands the set of functionals computable to non-linear functions such as squaring. We demonstrate simple networks which illustrate the improved performance of LON over CNN on simple tasks for estimating the gradient magnitude squared, for regressing shape area and perimeter lengths, and for explainability of individual pixels' influence on the result. |
| title | Locally orderless networks |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2406.13514 |