Imagen de Portada

Efficient Vision-Language Pre-training by Cluster Masking

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Wei, Zihao, Pan, Zixuan, Owens, Andrew
Formato:	Preprint
Publicado:	2024
Materias:	Computer Vision and Pattern Recognition
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Masked Diffusion Captioning for Visual Feature Learning
por: Feng, Chao, et al.
Publicado: (2025)

MaskedCLIP: Bridging the Masked and CLIP Space for Semi-Supervised Medical Vision-Language Pre-training
por: Zhu, Lei, et al.
Publicado: (2025)

Masked Clustering Prediction for Unsupervised Point Cloud Pre-training
por: Ren, Bin, et al.
Publicado: (2025)

Dynamic Cluster Data Sampling for Efficient and Long-Tail-Aware Vision-Language Pre-training
por: Liang, Mingliang, et al.
Publicado: (2026)

Semantics-enhanced Cross-modal Masked Image Modeling for Vision-Language Pre-training
por: Liu, Haowei, et al.
Publicado: (2024)

NEVLP: Noise-Robust Framework for Efficient Vision-Language Pre-training
por: Tao, Yiyi, et al.
Publicado: (2024)

EVE: Efficient Vision-Language Pre-training with Masked Prediction and Modality-Aware MoE
por: Chen, Junyi, et al.
Publicado: (2023)

Efficient and Long-Tailed Generalization for Pre-trained Vision-Language Model
por: Shi, Jiang-Xin, et al.
Publicado: (2024)

ELIP: Efficient Discriminative Language-Image Pre-training with Fewer Vision Tokens
por: Guo, Yangyang, et al.
Publicado: (2023)

Muskie: Multi-view Masked Image Modeling for 3D Vision Pre-training
por: Li, Wenyu, et al.
Publicado: (2025)

Understanding the Multi-modal Prompts of the Pre-trained Vision-Language Model
por: Ma, Shuailei, et al.
Publicado: (2023)

Masked Pre-training Enables Universal Zero-shot Denoiser
por: Ma, Xiaoxiao, et al.
Publicado: (2024)

Skip Tuning: Pre-trained Vision-Language Models are Effective and Efficient Adapters Themselves
por: Wu, Shihan, et al.
Publicado: (2024)

An Empirical Study of Parameter Efficient Fine-tuning on Vision-Language Pre-train Model
por: Tian, Yuxin, et al.
Publicado: (2024)

Efficient and Effective Universal Adversarial Attack against Vision-Language Pre-training Models
por: Yang, Fan, et al.
Publicado: (2024)

VELVET-Med: Vision and Efficient Language Pre-training for Volumetric Imaging Tasks in Medicine
por: Zhang, Ziyang, et al.
Publicado: (2025)

MLIP: Medical Language-Image Pre-training with Masked Local Representation Learning
por: Liu, Jiarun, et al.
Publicado: (2024)

Efficient Vision-and-Language Pre-training with Text-Relevant Image Patch Selection
por: Ye, Wei, et al.
Publicado: (2024)

Enhancing Vision-Language Pre-training with Rich Supervisions
por: Gao, Yuan, et al.
Publicado: (2024)

Rethinking UMM Visual Generation: Masked Modeling for Efficient Image-Only Pre-training
por: Sun, Peng, et al.
Publicado: (2026)

Frequency Is What You Need: Considering Word Frequency When Text Masking Benefits Vision-Language Model Pre-training
por: Liang, Mingliang, et al.
Publicado: (2024)

Centroid-centered Modeling for Efficient Vision Transformer Pre-training
por: Yan, Xin, et al.
Publicado: (2023)

Emerging Property of Masked Token for Effective Pre-training
por: Choi, Hyesong, et al.
Publicado: (2024)

Dataset Ownership Verification for Pre-trained Masked Models
por: Xie, Yuechen, et al.
Publicado: (2025)

Omniview-Tuning: Boosting Viewpoint Invariance of Vision-Language Pre-training Models
por: Ruan, Shouwei, et al.
Publicado: (2024)

Masked Diffusion as Self-supervised Representation Learner
por: Pan, Zixuan, et al.
Publicado: (2023)

TRIPS: Efficient Vision-and-Language Pre-training with Text-Relevant Image Patch Selection
por: Jiang, Chaoya, et al.
Publicado: (2023)

VILA: On Pre-training for Visual Language Models
por: Lin, Ji, et al.
Publicado: (2023)

Multilingual Vision-Language Pre-training for the Remote Sensing Domain
por: Silva, João Daniel, et al.
Publicado: (2024)

MMCOMPOSITION: Revisiting the Compositionality of Pre-trained Vision-Language Models
por: Hua, Hang, et al.
Publicado: (2024)

Unsupervised Domain Adaption Harnessing Vision-Language Pre-training
por: Zhou, Wenlve, et al.
Publicado: (2024)

FLAME: Frozen Large Language Models Enable Data-Efficient Language-Image Pre-training
por: Cao, Anjia, et al.
Publicado: (2024)

Masks and Manuscripts: Advancing Medical Pre-training with End-to-End Masking and Narrative Structuring
por: Gowda, Shreyank N, et al.
Publicado: (2024)

BUS:Efficient and Effective Vision-language Pre-training with Bottom-Up Patch Summarization
por: Jiang, Chaoya, et al.
Publicado: (2023)

Pan-cancer Histopathology WSI Pre-training with Position-aware Masked Autoencoder
por: Wu, Kun, et al.
Publicado: (2024)

VLP: A Survey on Vision-Language Pre-training
por: Chen, Feilong, et al.
Publicado: (2022)

Mind the Interference: Retaining Pre-trained Knowledge in Parameter Efficient Continual Learning of Vision-Language Models
por: Tang, Longxiang, et al.
Publicado: (2024)

PolarMAE: Efficient Fetal Ultrasound Pre-training via Semantic Screening and Polar-Guided Masking
por: Lv, Meng, et al.
Publicado: (2026)

Sample-agnostic Adversarial Perturbation for Vision-Language Pre-training Models
por: Zheng, Haonan, et al.
Publicado: (2024)

3D Scene Graph Guided Vision-Language Pre-training
por: Liu, Hao, et al.
Publicado: (2024)