Cover Image

Entropy Reveals Block Importance in Masked Self-Supervised Vision Transformers

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Xiang, Peihao, Wu, Kaida, Bai, Ou
Format:	Preprint
Published:	2026
Subjects:	Computer Vision and Pattern Recognition
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

MultiMAE-DER: Multimodal Masked Autoencoder for Dynamic Emotion Recognition
by: Xiang, Peihao, et al.
Published: (2024)

MTCAE-DFER: Multi-Task Cascaded Autoencoder for Dynamic Facial Expression Recognition
by: Xiang, Peihao, et al.
Published: (2024)

Frequency-Guided Masking for Enhanced Vision Self-Supervised Learning
by: Monsefi, Amin Karimi, et al.
Published: (2024)

HMSViT: A Hierarchical Masked Self-Supervised Vision Transformer for Corneal Nerve Segmentation and Diabetic Neuropathy Diagnosis
by: Zhang, Xin, et al.
Published: (2025)

Self-Supervised Vision Transformer for Enhanced Virtual Clothes Try-On
by: Lu, Lingxiao, et al.
Published: (2024)

The Role of Masking for Efficient Supervised Knowledge Distillation of Vision Transformers
by: Son, Seungwoo, et al.
Published: (2023)

AME: Aligned Manifold Entropy for Robust Vision-Language Distillation
by: Cao, Guiming, et al.
Published: (2025)

Evolved Hierarchical Masking for Self-Supervised Learning
by: Feng, Zhanzhou, et al.
Published: (2025)

MiM: Mask in Mask Self-Supervised Pre-Training for 3D Medical Image Analysis
by: Zhuang, Jiaxin, et al.
Published: (2024)

Self-Supervised Vision Transformers Are Efficient Segmentation Learners for Imperfect Labels
by: Lee, Seungho, et al.
Published: (2024)

Self-Supervised Vision Transformers for Writer Retrieval
by: Raven, Tim, et al.
Published: (2024)

Adaptively Bypassing Vision Transformer Blocks for Efficient Visual Tracking
by: Yang, Xiangyang, et al.
Published: (2024)

Polyline Path Masked Attention for Vision Transformer
by: Zhao, Zhongchen, et al.
Published: (2025)

Generalization of Self-Supervised Vision Transformers for Protein Localization Across Microscopy Domains
by: Isselmann, Ben, et al.
Published: (2026)

Exploring Self-Supervised Vision Transformers for Deepfake Detection: A Comparative Analysis
by: Nguyen, Huy H., et al.
Published: (2024)

Language-Unlocked ViT (LUViT): Empowering Self-Supervised Vision Transformers with LLMs
by: Kuzucu, Selim, et al.
Published: (2025)

Pattern Integration and Enhancement Vision Transformer for Self-Supervised Learning in Remote Sensing
by: Lu, Kaixuan, et al.
Published: (2024)

Continual Self-Supervised Learning with Masked Autoencoders in Remote Sensing
by: Möllenbrok, Lars, et al.
Published: (2025)

AIM: Amending Inherent Interpretability via Self-Supervised Masking
by: Alshami, Eyad, et al.
Published: (2025)

Mask What Matters: Controllable Text-Guided Masking for Self-Supervised Medical Image Analysis
by: Wang, Ruilang, et al.
Published: (2025)

MaskedCLIP: Bridging the Masked and CLIP Space for Semi-Supervised Medical Vision-Language Pre-training
by: Zhu, Lei, et al.
Published: (2025)

Solving Masked Jigsaw Puzzles with Diffusion Vision Transformers
by: Liu, Jinyang, et al.
Published: (2024)

Semantic Graph Consistency: Going Beyond Patches for Regularizing Self-Supervised Vision Transformers
by: Devaguptapu, Chaitanya, et al.
Published: (2024)

Pruning by Block Benefit: Exploring the Properties of Vision Transformer Blocks during Domain Adaptation
by: Glandorf, Patrick, et al.
Published: (2025)

Depth-Wise Representation Development Under Blockwise Self-Supervised Learning for Video Vision Transformers
by: Römer, Jonas, et al.
Published: (2026)

Token-Space Mask Prediction for Efficient Vision Transformer Segmentation
by: Galagain, Calvin, et al.
Published: (2026)

Liveness Detection in Computer Vision: Transformer-based Self-Supervised Learning for Face Anti-Spoofing
by: Keresh, Arman, et al.
Published: (2024)

Denoising Vision Transformer Autoencoder with Spectral Self-Regularization
by: Xiang, Xunzhi, et al.
Published: (2025)

Vision Transformers for Weakly-Supervised Microorganism Enumeration
by: Santiago, Javier Ureña, et al.
Published: (2024)

Block-based Symmetric Pruning and Fusion for Efficient Vision Transformers
by: Hsieh, Yi-Kuan, et al.
Published: (2025)

Efficient Self-supervised Vision Pretraining with Local Masked Reconstruction
by: Chen, Jun, et al.
Published: (2022)

RI-MAE: Rotation-Invariant Masked AutoEncoders for Self-Supervised Point Cloud Representation Learning
by: Su, Kunming, et al.
Published: (2024)

AMLP: Adjustable Masking Lesion Patches for Self-Supervised Medical Image Segmentation
by: Wang, Xiangtao, et al.
Published: (2023)

Joint-Embedding Predictive Architecture for Self-Supervised Learning of Mask Classification Architecture
by: Kim, Dong-Hee, et al.
Published: (2024)

Once for Both: Single Stage of Importance and Sparsity Search for Vision Transformer Compression
by: Ye, Hancheng, et al.
Published: (2024)

SEDiT: Mask-Free Video Subtitle Erasure via One-step Diffusion Transformer
by: Hui, Zheng, et al.
Published: (2026)

Semi-Supervised Masked Autoencoders: Unlocking Vision Transformer Potential with Limited Data
by: Faysal, Atik, et al.
Published: (2026)

Masked Modeling for Self-supervised Representation Learning on Vision and Beyond
by: Li, Siyuan, et al.
Published: (2023)

Bringing Masked Autoencoders Explicit Contrastive Properties for Point Cloud Self-Supervised Learning
by: Ren, Bin, et al.
Published: (2024)

Masked Image Modeling as a Framework for Self-Supervised Learning across Eye Movements
by: Weiler, Robin, et al.
Published: (2024)