Cover Image

What DINO saw: ALiBi positional encoding reduces positional bias in Vision Transformers

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Pawlowsky, Moritz, Vamvakeros, Antonis, Weiss, Alexander, Bielefeld, Anja, Cooper, Samuel J., Docherty, Ronan
Format:	Preprint
Published:	2026
Subjects:	Computer Vision and Pattern Recognition Materials Science
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Maybe you don't need a U-Net: convolutional feature upsampling for materials micrograph segmentation
by: Docherty, Ronan, et al.
Published: (2025)

Upsampling DINOv2 features for unsupervised vision tasks and weakly supervised materials segmentation
by: Docherty, Ronan, et al.
Published: (2024)

Upsampling DINOv2 Features for Unsupervised Vision Tasks and Weakly Supervised Materials Segmentation
by: Ronan Docherty, et al.
Published: (2026)

SAMBA: A Trainable Segmentation Web-App with Smart Labelling
by: Docherty, Ronan, et al.
Published: (2023)

Surgical Repair of Collapsed Attention Heads in ALiBi Transformers
by: Schallon, Palmer
Published: (2026)

Materials science in the era of large language models: a perspective
by: Lei, Ge, et al.
Published: (2024)

Multi-modal, multi-scale representation learning for satellite imagery analysis just needs a good ALiBi
by: Kage, Patrick, et al.
Published: (2026)

Battery Imaging Library: Laboratory EBSD NMC811 electrode (high res) (raw data)
by: Donoghue, J., et al.
Published: (2025)

Prediction of microstructural representativity from a single image
by: Dahari, Amir, et al.
Published: (2024)

Prediction of Microstructural Representativity From A Single Image
by: Amir Dahari, et al.
Published: (2025)

Battery Imaging Library: 3D EBSD Li-ion battery electrode - Dataset 30
by: Mangum, J., et al.
Published: (2025)

Battery Imaging Library: 3D EBSD Li-ion battery electrode - Dataset 56
by: Mangum, J., et al.
Published: (2025)

Battery Imaging Library: 3D EBSD Li-ion battery electrode - Dataset 14
by: Mangum, J., et al.
Published: (2025)

Battery Imaging Library: 3D EBSD Li-ion battery electrode - Dataset 31
by: Mangum, J., et al.
Published: (2025)

Battery Imaging Library: 3D EBSD Li-ion battery electrode - Dataset 69
by: Mangum, J., et al.
Published: (2025)

Battery Imaging Library: 3D EBSD Li-ion battery electrode - Dataset 1
by: Mangum, J., et al.
Published: (2025)

Virtual materials testing of ASSB cathodes combining AI-based stochastic 3D modeling and numerical simulations
by: Dufter, Anina, et al.
Published: (2026)

Horospherical subgroups in positive characteristic
by: Maccan, Matilde, et al.
Published: (2025)

Imaging, counting, and positioning single interstitial atoms in solids
by: Cui, Jizhe, et al.
Published: (2024)

Do traveling waves make good positional encodings?
by: van de Geijn, Chase, et al.
Published: (2025)

Accelerating global search of adsorbate molecule position using machine-learning interatomic potentials with active learning
by: Klimanova, Olga, et al.
Published: (2024)

DSC curve fingerprints directly encode mechanical properties of aluminum alloys
by: Pichlmann, Lukas, et al.
Published: (2026)

Nanoscale characterization of atomic positions in orthorhombic perovskite thin films
by: Martirosyan, M., et al.
Published: (2025)

Nanoscale imaging of reduced forward bias at V-defects in green-emitting nitride LEDs
by: Fornos, C., et al.
Published: (2025)

Deterministic positioning of circular Bragg gratings using atomic force lithography for high-performance quantum dot light sources
by: Dhurjati, Sai Abhishikth, et al.
Published: (2026)

The role of positional encodings in the ARC benchmark
by: Costa, Guilherme H. Bandeira, et al.
Published: (2025)

Revisiting the matrix elements of the position operator in the crystal momentum representation
by: Si, M. S., et al.
Published: (2025)

Unveiling SEI Formation Dynamics of PEO: LiTFSI with Lithium Metal: An In Situ Approach Combining SIMS, XPS, and CTTA
by: Timo Weintraut, et al.
Published: (2025)

Identifying and understanding the positive impact of defects for perovskites optoelectronic devices
by: Deng, Yu-Hao
Published: (2020)

Accurate atomic positions via local-orbital tomography with depth-dependent interactions
by: Mao, Liangze, et al.
Published: (2024)

“I saw souls”: remarks on the theory and practice of intercultural and interfaith spiritual care
by: Helmut Weiss
Published: (2011)

A Radiation Exchange Factor Formulation with Proven Non-Negativity and Unconditional Energy Conservation
by: Bielefeld, Nikolaj Maack
Published: (2025)

Alternative positional encoding functions for neural transformers
by: Lopez-Rubio, Ezequiel, et al.
Published: (2025)

Tailoring dispersion and evanescent modes in multimodal nonlocal lattices using positive-only interactions
by: Rouhi, Lucas, et al.
Published: (2025)

Score-based diffusion models for accurate crystal-structure inpainting and reconstruction of hydrogen positions
by: Reents, Timo, et al.
Published: (2026)

Quantifying the Impact of Cathode Composite Mixing Quality on Active Mass Utilization and Reproducibility of Solid‐State Battery Cells
by: Maximilian Kissel, et al.
Published: (2025)

Simulating alternating bias assisted annealing of amorphous oxide tunnel junctions
by: Tyner, Alexander C., et al.
Published: (2025)

The re-entrant ferromagnetism due to symmetric exchange bias in two septuple-layer MnBi2Te4 epitaxial films
by: Song, Dezhi, et al.
Published: (2024)

Large positive magnetoconductance in carbon nanoscrolls
by: Zhong, Yu-Jie, et al.
Published: (2024)

Boundary conditions for the positive skew bias
by: Colleen C. Frank, et al.
Published: (2024)