Copertina

Efficient Vision-Language Pre-training by Cluster Masking

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Wei, Zihao, Pan, Zixuan, Owens, Andrew
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Computer Vision and Pattern Recognition
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Masked Diffusion Captioning for Visual Feature Learning
di: Feng, Chao, et al.
Pubblicazione: (2025)

MaskedCLIP: Bridging the Masked and CLIP Space for Semi-Supervised Medical Vision-Language Pre-training
di: Zhu, Lei, et al.
Pubblicazione: (2025)

Masked Clustering Prediction for Unsupervised Point Cloud Pre-training
di: Ren, Bin, et al.
Pubblicazione: (2025)

Dynamic Cluster Data Sampling for Efficient and Long-Tail-Aware Vision-Language Pre-training
di: Liang, Mingliang, et al.
Pubblicazione: (2026)

Semantics-enhanced Cross-modal Masked Image Modeling for Vision-Language Pre-training
di: Liu, Haowei, et al.
Pubblicazione: (2024)

NEVLP: Noise-Robust Framework for Efficient Vision-Language Pre-training
di: Tao, Yiyi, et al.
Pubblicazione: (2024)

EVE: Efficient Vision-Language Pre-training with Masked Prediction and Modality-Aware MoE
di: Chen, Junyi, et al.
Pubblicazione: (2023)

Efficient and Long-Tailed Generalization for Pre-trained Vision-Language Model
di: Shi, Jiang-Xin, et al.
Pubblicazione: (2024)

ELIP: Efficient Discriminative Language-Image Pre-training with Fewer Vision Tokens
di: Guo, Yangyang, et al.
Pubblicazione: (2023)

Muskie: Multi-view Masked Image Modeling for 3D Vision Pre-training
di: Li, Wenyu, et al.
Pubblicazione: (2025)

Understanding the Multi-modal Prompts of the Pre-trained Vision-Language Model
di: Ma, Shuailei, et al.
Pubblicazione: (2023)

Masked Pre-training Enables Universal Zero-shot Denoiser
di: Ma, Xiaoxiao, et al.
Pubblicazione: (2024)

Skip Tuning: Pre-trained Vision-Language Models are Effective and Efficient Adapters Themselves
di: Wu, Shihan, et al.
Pubblicazione: (2024)

An Empirical Study of Parameter Efficient Fine-tuning on Vision-Language Pre-train Model
di: Tian, Yuxin, et al.
Pubblicazione: (2024)

Efficient and Effective Universal Adversarial Attack against Vision-Language Pre-training Models
di: Yang, Fan, et al.
Pubblicazione: (2024)

VELVET-Med: Vision and Efficient Language Pre-training for Volumetric Imaging Tasks in Medicine
di: Zhang, Ziyang, et al.
Pubblicazione: (2025)

MLIP: Medical Language-Image Pre-training with Masked Local Representation Learning
di: Liu, Jiarun, et al.
Pubblicazione: (2024)

Efficient Vision-and-Language Pre-training with Text-Relevant Image Patch Selection
di: Ye, Wei, et al.
Pubblicazione: (2024)

Enhancing Vision-Language Pre-training with Rich Supervisions
di: Gao, Yuan, et al.
Pubblicazione: (2024)

Rethinking UMM Visual Generation: Masked Modeling for Efficient Image-Only Pre-training
di: Sun, Peng, et al.
Pubblicazione: (2026)

Frequency Is What You Need: Considering Word Frequency When Text Masking Benefits Vision-Language Model Pre-training
di: Liang, Mingliang, et al.
Pubblicazione: (2024)

Centroid-centered Modeling for Efficient Vision Transformer Pre-training
di: Yan, Xin, et al.
Pubblicazione: (2023)

Emerging Property of Masked Token for Effective Pre-training
di: Choi, Hyesong, et al.
Pubblicazione: (2024)

Dataset Ownership Verification for Pre-trained Masked Models
di: Xie, Yuechen, et al.
Pubblicazione: (2025)

Omniview-Tuning: Boosting Viewpoint Invariance of Vision-Language Pre-training Models
di: Ruan, Shouwei, et al.
Pubblicazione: (2024)

Masked Diffusion as Self-supervised Representation Learner
di: Pan, Zixuan, et al.
Pubblicazione: (2023)

TRIPS: Efficient Vision-and-Language Pre-training with Text-Relevant Image Patch Selection
di: Jiang, Chaoya, et al.
Pubblicazione: (2023)

VILA: On Pre-training for Visual Language Models
di: Lin, Ji, et al.
Pubblicazione: (2023)

Multilingual Vision-Language Pre-training for the Remote Sensing Domain
di: Silva, João Daniel, et al.
Pubblicazione: (2024)

MMCOMPOSITION: Revisiting the Compositionality of Pre-trained Vision-Language Models
di: Hua, Hang, et al.
Pubblicazione: (2024)

Unsupervised Domain Adaption Harnessing Vision-Language Pre-training
di: Zhou, Wenlve, et al.
Pubblicazione: (2024)

FLAME: Frozen Large Language Models Enable Data-Efficient Language-Image Pre-training
di: Cao, Anjia, et al.
Pubblicazione: (2024)

Masks and Manuscripts: Advancing Medical Pre-training with End-to-End Masking and Narrative Structuring
di: Gowda, Shreyank N, et al.
Pubblicazione: (2024)

BUS:Efficient and Effective Vision-language Pre-training with Bottom-Up Patch Summarization
di: Jiang, Chaoya, et al.
Pubblicazione: (2023)

Pan-cancer Histopathology WSI Pre-training with Position-aware Masked Autoencoder
di: Wu, Kun, et al.
Pubblicazione: (2024)

VLP: A Survey on Vision-Language Pre-training
di: Chen, Feilong, et al.
Pubblicazione: (2022)

Mind the Interference: Retaining Pre-trained Knowledge in Parameter Efficient Continual Learning of Vision-Language Models
di: Tang, Longxiang, et al.
Pubblicazione: (2024)

PolarMAE: Efficient Fetal Ultrasound Pre-training via Semantic Screening and Polar-Guided Masking
di: Lv, Meng, et al.
Pubblicazione: (2026)

Sample-agnostic Adversarial Perturbation for Vision-Language Pre-training Models
di: Zheng, Haonan, et al.
Pubblicazione: (2024)

3D Scene Graph Guided Vision-Language Pre-training
di: Liu, Hao, et al.
Pubblicazione: (2024)