Salvato in:
| Autori principali: | , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2026
|
| Soggetti: | |
| Accesso online: | https://arxiv.org/abs/2602.01418 |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866916001454489600 |
|---|---|
| author | Øhrstrøm, Christoffer Koo Muchacho, Rafael I. Cabral Dong, Yifei Moumtzidellis, Filippos Güldenring, Ronja Pokorny, Florian T. Nalpantidis, Lazaros |
| author_facet | Øhrstrøm, Christoffer Koo Muchacho, Rafael I. Cabral Dong, Yifei Moumtzidellis, Filippos Güldenring, Ronja Pokorny, Florian T. Nalpantidis, Lazaros |
| contents | We propose Parabolic Position Encoding (PaPE), a parabola-based position encoding for vision modalities in attention-based architectures. Given a set of vision tokens-such as from videos, event camera streams, images, or point clouds-our objective is to encode their positions while accounting for the characteristics of vision modalities. Prior works have largely extended position encodings from 1D-sequences in language to nD-structures in vision, but only with partial account of vision characteristics. We address this gap by designing PaPE from principles distilled from prior work: translation invariance, rotation invariance (PaPE-RI), distance decay, directionality, and context awareness. Extrapolation experiments on ImageNet-1K show how PaPE extrapolates remarkably well, improving in absolute terms by up to 10.5\% over the next-best encoding. Generality experiments on 8 datasets across 4 modalities show that PaPE is a general vision position encoding, as PaPE matches the best baseline on 5 datasets and exceeds all on 2 datasets. Code is available at https://github.com/DTU-PAS/parabolic-position-encoding. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2602_01418 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Parabolic Position Encoding: Vision-Centric, Principled, Extrapolatable, General Øhrstrøm, Christoffer Koo Muchacho, Rafael I. Cabral Dong, Yifei Moumtzidellis, Filippos Güldenring, Ronja Pokorny, Florian T. Nalpantidis, Lazaros Computer Vision and Pattern Recognition Machine Learning We propose Parabolic Position Encoding (PaPE), a parabola-based position encoding for vision modalities in attention-based architectures. Given a set of vision tokens-such as from videos, event camera streams, images, or point clouds-our objective is to encode their positions while accounting for the characteristics of vision modalities. Prior works have largely extended position encodings from 1D-sequences in language to nD-structures in vision, but only with partial account of vision characteristics. We address this gap by designing PaPE from principles distilled from prior work: translation invariance, rotation invariance (PaPE-RI), distance decay, directionality, and context awareness. Extrapolation experiments on ImageNet-1K show how PaPE extrapolates remarkably well, improving in absolute terms by up to 10.5\% over the next-best encoding. Generality experiments on 8 datasets across 4 modalities show that PaPE is a general vision position encoding, as PaPE matches the best baseline on 5 datasets and exceeds all on 2 datasets. Code is available at https://github.com/DTU-PAS/parabolic-position-encoding. |
| title | Parabolic Position Encoding: Vision-Centric, Principled, Extrapolatable, General |
| topic | Computer Vision and Pattern Recognition Machine Learning |
| url | https://arxiv.org/abs/2602.01418 |