Cover Image

Distilling Vision Transformers for Distortion-Robust Representation Learning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Alexis, Konstantinos, Giannopoulos, Giorgos, Gunopulos, Dimitrios
Format:	Preprint
Published:	2026
Subjects:	Computer Vision and Pattern Recognition
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

HighFM: Towards a Foundation Model for Learning Representations from High-Frequency Earth Observation Data
by: Girtsou, Stella, et al.
Published: (2026)

Next day fire prediction via semantic segmentation
by: Alexis, Konstantinos, et al.
Published: (2024)

Möbius Transform for Mitigating Perspective Distortions in Representation Learning
by: Chhipa, Prakash Chandra, et al.
Published: (2024)

Fusion Transformer with Object Mask Guidance for Image Forgery Analysis
by: Karageorgiou, Dimitrios, et al.
Published: (2024)

Instance-Level Generation for Representation Learning
by: Wu, Yankun, et al.
Published: (2025)

LCM: Log Conformal Maps for Robust Representation Learning to Mitigate Perspective Distortion
by: Chippa, Meenakshi Subhash, et al.
Published: (2024)

Robust Representation Learning with Self-Distillation for Domain Generalization
by: Singh, Ankur, et al.
Published: (2023)

Vision Transformers with Self-Distilled Registers
by: Chen, Yinjie, et al.
Published: (2025)

Counterfactual Edits for Generative Evaluation
by: Lymperaiou, Maria, et al.
Published: (2023)

Distillation Dynamics: Towards Understanding Feature-Based Distillation in Vision Transformers
by: Tian, Huiyuan, et al.
Published: (2025)

Multi-manifold Attention for Vision Transformers
by: Konstantinidis, Dimitrios, et al.
Published: (2022)

Calibration Attention: Learning Reliability-Aware Representations for Vision Transformers
by: Liang, Wenhao, et al.
Published: (2025)

Knowledge Distillation in Vision Transformers: A Critical Review
by: Habib, Gousia, et al.
Published: (2023)

Through the PRISm: Importance-Aware Scene Graphs for Image Retrieval
by: Georgoulopoulos, Dimitrios, et al.
Published: (2025)

ENACT: Entropy-based Clustering of Attention Input for Reducing the Computational Needs of Object Detection Transformers
by: Savathrakis, Giorgos, et al.
Published: (2024)

Mechanistic Understandings of Representation Vulnerabilities and Engineering Robust Vision Transformers
by: Islam, Chashi Mahiul, et al.
Published: (2025)

Structure Your Data: Towards Semantic Graph Counterfactuals
by: Dimitriou, Angeliki, et al.
Published: (2024)

AME: Aligned Manifold Entropy for Robust Vision-Language Distillation
by: Cao, Guiming, et al.
Published: (2025)

Fine-Grained ImageNet Classification in the Wild
by: Lymperaiou, Maria, et al.
Published: (2023)

An Annotation-to-Detection Framework for Autonomous and Robust Vine Trunk Localization in the Field by Mobile Agricultural Robots
by: Chatziparaschis, Dimitrios, et al.
Published: (2026)

Masked Generative Story Transformer with Character Guidance and Caption Augmentation
by: Papadimitriou, Christos, et al.
Published: (2024)

Learning Occlusion-Robust Vision Transformers for Real-Time UAV Tracking
by: Wu, You, et al.
Published: (2025)

SPFormer: Enhancing Vision Transformer with Superpixel Representation
by: Mei, Jieru, et al.
Published: (2024)

LiDAR-Anchored Collaborative Distillation for Robust 2D Representations
by: Jo, Wonjun, et al.
Published: (2026)

Distilled Transformers with Locally Enhanced Global Representations for Face Forgery Detection
by: Zhang, Yaning, et al.
Published: (2024)

CLIPSelf: Vision Transformer Distills Itself for Open-Vocabulary Dense Prediction
by: Wu, Size, et al.
Published: (2023)

Automatic Generation of Fashion Images using Prompting in Generative Machine Learning Models
by: Argyrou, Georgia, et al.
Published: (2024)

Learning Motion Blur Robust Vision Transformers for Real-Time UAV Tracking
by: Wu, You, et al.
Published: (2024)

BSViT: A Burst Spiking Vision Transformer for Expressive and Efficient Visual Representation Learning
by: Peng, Hongxiang, et al.
Published: (2026)

InDistill: Information flow-preserving knowledge distillation for model compression
by: Sarridis, Ioannis, et al.
Published: (2022)

Analyzing Local Representations of Self-supervised Vision Transformers
by: Vanyan, Ani, et al.
Published: (2023)

Exploring Compositionality in Vision Transformers using Wavelet Representations
by: Purushottamdas, Akshad Shyam, et al.
Published: (2025)

Two-stage Vision Transformers and Hard Masking offer Robust Object Representations
by: Aniraj, Ananthu, et al.
Published: (2025)

Distillation-guided Representation Learning for Unconstrained Gait Recognition
by: Guo, Yuxiang, et al.
Published: (2023)

V-CECE: Visual Counterfactual Explanations via Conceptual Edits
by: Spanos, Nikolaos, et al.
Published: (2025)

Distill-SODA: Distilling Self-Supervised Vision Transformer for Source-Free Open-Set Domain Adaptation in Computational Pathology
by: Vray, Guillaume, et al.
Published: (2023)

Transparency Distortion Robustness for SOTA Image Segmentation Tasks
by: Knauthe, Volker, et al.
Published: (2024)

Minimizing Embedding Distortion for Robust Out-of-Distribution Performance
by: Shaked, Tom, et al.
Published: (2024)

Depth-Wise Representation Development Under Blockwise Self-Supervised Learning for Video Vision Transformers
by: Römer, Jonas, et al.
Published: (2026)

RWKV-CLIP: A Robust Vision-Language Representation Learner
by: Gu, Tiancheng, et al.
Published: (2024)