Cover Image

Efficient Self-supervised Vision Pretraining with Local Masked Reconstruction

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Chen, Jun, Hu, Ming, Li, Boyang, Elhoseiny, Mohamed
Format:	Preprint
Published:	2022
Subjects:	Computer Vision and Pattern Recognition
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

VRSBench: A Versatile Vision-Language Benchmark Dataset for Remote Sensing Image Understanding
by: Li, Xiang, et al.
Published: (2024)

MaskLRF: Self-supervised Pretraining via Masked Autoencoding of Local Reference Frames for Rotation-invariant 3D Point Set Analysis
by: Furuya, Takahiko
Published: (2024)

Masked Modeling for Self-supervised Representation Learning on Vision and Beyond
by: Li, Siyuan, et al.
Published: (2023)

Masked Diffusion as Self-supervised Representation Learner
by: Pan, Zixuan, et al.
Published: (2023)

Efficient Masked Autoencoders with Self-Consistency
by: Li, Zhaowen, et al.
Published: (2023)

StoryGPT-V: Large Language Models as Consistent Story Visualizers
by: Shen, Xiaoqian, et al.
Published: (2023)

Vgent: Graph-based Retrieval-Reasoning-Augmented Generation For Long Video Understanding
by: Shen, Xiaoqian, et al.
Published: (2025)

Cluster-Wise Spatio-Temporal Masking for Efficient Video-Language Pretraining
by: Zhuang, Weijun, et al.
Published: (2026)

Analyzing Local Representations of Self-supervised Vision Transformers
by: Vanyan, Ani, et al.
Published: (2023)

MAL: Cluster-Masked and Multi-Task Pretraining for Enhanced xLSTM Vision Performance
by: Huang, Wenjun, et al.
Published: (2024)

Document Haystacks: Vision-Language Reasoning Over Piles of 1000+ Documents
by: Chen, Jun, et al.
Published: (2024)

Masked Next-Scale Prediction for Self-supervised Scene Text Recognition
by: Chen, Zhuohao, et al.
Published: (2026)

CoT3DRef: Chain-of-Thoughts Data-Efficient 3D Visual Grounding
by: Abdelrahman, Eslam, et al.
Published: (2023)

Dual-Domain Masked Image Modeling: A Self-Supervised Pretraining Strategy Using Spatial and Frequency Domain Masking for Hyperspectral Data
by: Mohamed, Shaheer, et al.
Published: (2025)

Self-supervised Pretraining and Finetuning for Monocular Depth and Visual Odometry
by: Chidlovskii, Boris, et al.
Published: (2024)

Neural Catalog: Scaling Species Recognition with Catalog of Life-Augmented Generation
by: Khan, Faizan Farooq, et al.
Published: (2025)

Self-supervised Anomaly Detection Pretraining Enhances Long-tail ECG Diagnosis
by: Jiang, Aofan, et al.
Published: (2024)

Learning Where to Look: Self-supervised Viewpoint Selection for Active Localization using Geometrical Information
by: Di Giammarino, Luca, et al.
Published: (2024)

Self-supervised Pretraining of Cell Segmentation Models
by: Stillwagon, Kaden, et al.
Published: (2026)

SIDME: Self-supervised Image Demoiréing via Masked Encoder-Decoder Reconstruction
by: Wang, Xia, et al.
Published: (2025)

Category-level Text-to-Image Retrieval Improved: Bridging the Domain Gap with Diffusion Models and Vision Encoders
by: Khan, Faizan Farooq, et al.
Published: (2025)

Efficient Pretraining Model based on Multi-Scale Local Visual Field Feature Reconstruction for PCB CT Image Element Segmentation
by: Chen, Chen, et al.
Published: (2024)

SyncMask: Synchronized Attentional Masking for Fashion-centric Vision-Language Pretraining
by: Song, Chull Hwan, et al.
Published: (2024)

PR-MIM: Delving Deeper into Partial Reconstruction in Masked Image Modeling
by: Li, Zhong-Yu, et al.
Published: (2024)

Exploring Semantic Masked Autoencoder for Self-supervised Point Cloud Understanding
by: Zha, Yixin, et al.
Published: (2025)

AnatoMask: Enhancing Medical Image Segmentation with Reconstruction-guided Self-masking
by: Li, Yuheng, et al.
Published: (2024)

LaneCorrect: Self-supervised Lane Detection
by: Nie, Ming, et al.
Published: (2024)

PersonViT: Large-scale Self-supervised Vision Transformer for Person Re-Identification
by: Hu, Bin, et al.
Published: (2024)

3DCoMPaT200: Language-Grounded Compositional Understanding of Parts and Materials of 3D Shapes
by: Ahmed, Mahmoud, et al.
Published: (2025)

Linguistics-aware Masked Image Modeling for Self-supervised Scene Text Recognition
by: Zhang, Yifei, et al.
Published: (2025)

Enhancing Vision-Language Compositional Understanding with Multimodal Synthetic Data
by: Li, Haoxin, et al.
Published: (2025)

Collaborative Temporal Consistency Learning for Point-supervised Natural Language Video Localization
by: Tao, Zhuo, et al.
Published: (2025)

MAKE: Multi-Aspect Knowledge-Enhanced Vision-Language Pretraining for Zero-shot Dermatological Assessment
by: Yan, Siyuan, et al.
Published: (2025)

Overcoming Generic Knowledge Loss with Selective Parameter Update
by: Zhang, Wenxuan, et al.
Published: (2023)

Self-supervised Pretraining for Cardiovascular Magnetic Resonance Cine Segmentation
by: de Mooij, Rob A. J., et al.
Published: (2024)

FullLoRA: Efficiently Boosting the Robustness of Pretrained Vision Transformers
by: Yuan, Zheng, et al.
Published: (2024)

Revisiting Prompt Pretraining of Vision-Language Models
by: Chen, Zhenyuan, et al.
Published: (2024)

Point Cloud Self-supervised Learning via 3D to Multi-view Masked Learner
by: Chen, Zhimin, et al.
Published: (2023)

MAP: Unleashing Hybrid Mamba-Transformer Vision Backbone's Potential with Masked Autoregressive Pretraining
by: Liu, Yunze, et al.
Published: (2024)

How Well Can Vision Language Models See Image Details?
by: Gou, Chenhui, et al.
Published: (2024)