Cover Image

Beyond [cls]: Exploring the true potential of Masked Image Modeling representations

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Przewięźlikowski, Marcin, Balestriero, Randall, Jasiński, Wojciech, Śmieja, Marek, Zieliński, Bartosz
Format:	Preprint
Published:	2024
Subjects:	Computer Vision and Pattern Recognition Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

SpaRRTa: A Synthetic Benchmark for Evaluating Spatial Intelligence in Visual Foundation Models
by: Kargin, Turhan Can, et al.
Published: (2026)

Augmentation-aware Self-supervised Learning with Conditioned Projector
by: Przewięźlikowski, Marcin, et al.
Published: (2023)

A deep cut into Split Federated Self-supervised Learning
by: Przewięźlikowski, Marcin, et al.
Published: (2024)

Efficient Multi-Source Knowledge Transfer by Model Merging
by: Osial, Marcin, et al.
Published: (2025)

Post-Hoc Guidance for Consistency Models by Joint Flow Distribution Learning
by: Hsu, Chia-Hong, et al.
Published: (2026)

HyperPlanes: Hypernetwork Approach to Rapid NeRF Adaptation
by: Batorski, Paweł, et al.
Published: (2024)

SeBA: Semi-supervised few-shot learning via Separated-at-Birth Alignment for tabular data
by: Jurek, Kacper, et al.
Published: (2026)

Stop Marginalizing My Dreams: Model Inversion via Laplace Kernel for Continual Learning
by: Krukowski, Patryk, et al.
Published: (2026)

LeJEPA: Provable and Scalable Self-Supervised Learning Without the Heuristics
by: Balestriero, Randall, et al.
Published: (2025)

Learning by Reconstruction Produces Uninformative Features For Perception
by: Balestriero, Randall, et al.
Published: (2024)

FlySearch: Exploring how vision-language models explore
by: Pardyl, Adam, et al.
Published: (2025)

Conceptualizing Embeddings: Sparse Disentanglement for Vision-Language Models
by: Kubaty, Piotr, et al.
Published: (2026)

Self-Supervised Anomaly Detection in the Wild: Favor Joint Embeddings Methods
by: Otero, Daniel, et al.
Published: (2024)

SplineCam: Exact Visualization and Characterization of Deep Network Geometry and Decision Boundaries
by: Humayun, Ahmed Imtiaz, et al.
Published: (2023)

Deep Networks Always Grok and Here is Why
by: Humayun, Ahmed Imtiaz, et al.
Published: (2024)

On the Geometry of Deep Learning
by: Balestriero, Randall, et al.
Published: (2024)

Exploring the Coordination of Frequency and Attention in Masked Image Modeling
by: Gui, Jie, et al.
Published: (2022)

VisTabNet: Adapting Vision Transformers for Tabular Data
by: Wydmański, Witold, et al.
Published: (2024)

UniBench: Visual Reasoning Requires Rethinking Vision-Language Beyond Scaling
by: Al-Tahan, Haider, et al.
Published: (2024)

GPS-SSL: Guided Positive Sampling to Inject Prior Into Self-Supervised Learning
by: Feizi, Aarash, et al.
Published: (2024)

Gaussian Embeddings: How JEPAs Secretly Learn Your Data Density
by: Balestriero, Randall, et al.
Published: (2025)

Ditch the Denoiser: Emergence of Noise Robustness in Self-Supervised Learning from Data Curriculum
by: Lu, Wenquan, et al.
Published: (2025)

Rectified LpJEPA: Joint-Embedding Predictive Architectures with Sparse and Maximum-Entropy Representations
by: Kuang, Yilun, et al.
Published: (2026)

FastDINOv2: Frequency Based Curriculum Learning Improves Robustness and Training Speed
by: Zhang, Jiaqi, et al.
Published: (2025)

Understanding the Detrimental Class-level Effects of Data Augmentation
by: Kirichenko, Polina, et al.
Published: (2023)

Keypoint Aware Masked Image Modelling
by: Krishna, Madhava, et al.
Published: (2024)

Joint Embedding vs Reconstruction: Provable Benefits of Latent Space Prediction for Self Supervised Learning
by: Van Assel, Hugues, et al.
Published: (2025)

Effective and Efficient Masked Image Generation Models
by: You, Zebin, et al.
Published: (2025)

From Linearity to Non-Linearity: How Masked Autoencoders Capture Spatial Correlations
by: Bisulco, Anthony, et al.
Published: (2025)

$\mathbb{X}$-Sample Contrastive Loss: Improving Contrastive Learning with Sample Similarity Graphs
by: Sobal, Vlad, et al.
Published: (2024)

Revisiting FunnyBirds evaluation framework for prototypical parts networks
by: Opłatek, Szymon, et al.
Published: (2024)

MaskMedPaint: Masked Medical Image Inpainting with Diffusion Models for Mitigation of Spurious Correlations
by: Jin, Qixuan, et al.
Published: (2024)

Parameter-Efficient Interventions for Enhanced Model Merging
by: Osial, Marcin, et al.
Published: (2024)

DIET-CP: Lightweight and Data Efficient Self Supervised Continued Pretraining
by: Rodas, Bryan, et al.
Published: (2025)

Divide and not forget: Ensemble of selectively trained experts in Continual Learning
by: Rypeść, Grzegorz, et al.
Published: (2024)

Beyond and Free from Diffusion: Invertible Guided Consistency Training
by: Hsu, Chia-Hong, et al.
Published: (2025)

Improving Generative Pre-Training: An In-depth Study of Masked Image Modeling and Denoising Models
by: Choi, Hyesong, et al.
Published: (2024)

OMENN: One Matrix to Explain Neural Networks
by: Wróbel, Adam, et al.
Published: (2024)

MIMIC: Masked Image Modeling with Image Correspondences
by: Marathe, Kalyani, et al.
Published: (2023)

Beyond Independent Frames: Latent Attention Masked Autoencoders for Multi-View Echocardiography
by: Böhi, Simon, et al.
Published: (2026)