Copertina

Frequency Is What You Need: Considering Word Frequency When Text Masking Benefits Vision-Language Model Pre-training

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Liang, Mingliang, Larson, Martha
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Computer Vision and Pattern Recognition
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Enhancing Vision-Language Model Pre-training with Image-text Pair Pruning Based on Word Frequency
di: Liang, Mingliang, et al.
Pubblicazione: (2024)

Centered Masking for Language-Image Pre-Training
di: Liang, Mingliang, et al.
Pubblicazione: (2024)

Dynamic Cluster Data Sampling for Efficient and Long-Tail-Aware Vision-Language Pre-training
di: Liang, Mingliang, et al.
Pubblicazione: (2026)

OCT Data is All You Need: How Vision Transformers with and without Pre-training Benefit Imaging
di: Han, Zihao, et al.
Pubblicazione: (2025)

Efficient Vision-Language Pre-training by Cluster Masking
di: Wei, Zihao, et al.
Pubblicazione: (2024)

SeTformer is What You Need for Vision and Language
di: Shamsolmoali, Pourya, et al.
Pubblicazione: (2024)

Semantics-enhanced Cross-modal Masked Image Modeling for Vision-Language Pre-training
di: Liu, Haowei, et al.
Pubblicazione: (2024)

MaskedCLIP: Bridging the Masked and CLIP Space for Semi-Supervised Medical Vision-Language Pre-training
di: Zhu, Lei, et al.
Pubblicazione: (2025)

Frequency-Guided Masking for Enhanced Vision Self-Supervised Learning
di: Monsefi, Amin Karimi, et al.
Pubblicazione: (2024)

Masked Generative Transformer Is What You Need for Image Editing
di: Chow, Wei, et al.
Pubblicazione: (2026)

Text is All You Need for Vision-Language Model Jailbreaking
di: Chen, Yihang, et al.
Pubblicazione: (2026)

Muskie: Multi-view Masked Image Modeling for 3D Vision Pre-training
di: Li, Wenyu, et al.
Pubblicazione: (2025)

MLIP: Medical Language-Image Pre-training with Masked Local Representation Learning
di: Liu, Jiarun, et al.
Pubblicazione: (2024)

Can LLM-Generated Text Empower Surgical Vision-Language Pre-training?
di: Che, Chengan, et al.
Pubblicazione: (2026)

Multi-View Representation is What You Need for Point-Cloud Pre-Training
di: Yan, Siming, et al.
Pubblicazione: (2023)

How Vision-Language Tasks Benefit from Large Pre-trained Models: A Survey
di: Qi, Yayun, et al.
Pubblicazione: (2024)

Dataset Ownership Verification for Pre-trained Masked Models
di: Xie, Yuechen, et al.
Pubblicazione: (2025)

Do You Need Text Rectification? Soft Attention Mask Embedding for Rectification-Free Scene Text Spotting
di: Colombo, Antonio, et al.
Pubblicazione: (2026)

Revealing the Impact of Visual Text Style on Attribute-based Descriptions Produced by Large Visual Language Models
di: Wang, Xiaomeng, et al.
Pubblicazione: (2026)

MMCOMPOSITION: Revisiting the Compositionality of Pre-trained Vision-Language Models
di: Hua, Hang, et al.
Pubblicazione: (2024)

Text-Guided Attention is All You Need for Zero-Shot Robustness in Vision-Language Models
di: Yu, Lu, et al.
Pubblicazione: (2024)

CLIP4STR: A Simple Baseline for Scene Text Recognition with Pre-trained Vision-Language Model
di: Zhao, Shuai, et al.
Pubblicazione: (2023)

EVE: Efficient Vision-Language Pre-training with Masked Prediction and Modality-Aware MoE
di: Chen, Junyi, et al.
Pubblicazione: (2023)

TAP-VL: Text Layout-Aware Pre-training for Enriched Vision-Language Models
di: Fhima, Jonathan, et al.
Pubblicazione: (2024)

Smart Feature is What You Need
di: Hu, Zhaoxin, et al.
Pubblicazione: (2024)

On the Reliability of Vision-Language Models Under Adversarial Frequency-Domain Perturbations
di: Vice, Jordan, et al.
Pubblicazione: (2025)

Learning to Rank Pre-trained Vision-Language Models for Downstream Tasks
di: Ding, Yuhe, et al.
Pubblicazione: (2024)

Learning to See What You Need: Gaze Attention for Multimodal Large Language Models
di: Song, Junha, et al.
Pubblicazione: (2026)

Sample-agnostic Adversarial Perturbation for Vision-Language Pre-training Models
di: Zheng, Haonan, et al.
Pubblicazione: (2024)

Understanding the Multi-modal Prompts of the Pre-trained Vision-Language Model
di: Ma, Shuailei, et al.
Pubblicazione: (2023)

One Prompt Word is Enough to Boost Adversarial Robustness for Pre-trained Vision-Language Models
di: Li, Lin, et al.
Pubblicazione: (2024)

Q-Mask: Query-driven Causal Masks for Text Anchoring in OCR-Oriented Vision-Language Models
di: Xu, Longwei, et al.
Pubblicazione: (2026)

When Does Pruning Benefit Vision Representations?
di: Cassano, Enrico, et al.
Pubblicazione: (2025)

Enhancing Vision-Language Pre-training with Rich Supervisions
di: Gao, Yuan, et al.
Pubblicazione: (2024)

MaskDiffusion: Exploiting Pre-trained Diffusion Models for Semantic Segmentation
di: Kawano, Yasufumi, et al.
Pubblicazione: (2024)

A Reality Check of Vision-Language Pre-training in Radiology: Have We Progressed Using Text?
di: Silva-Rodríguez, Julio, et al.
Pubblicazione: (2025)

Is What You Ask For What You Get? Investigating Concept Associations in Text-to-Image Models
di: Magid, Salma Abdel, et al.
Pubblicazione: (2024)

Continual Forgetting for Pre-trained Vision Models
di: Zhao, Hongbo, et al.
Pubblicazione: (2024)

Integrating Frequency-Domain Representations with Low-Rank Adaptation in Vision-Language Models
di: Khan, Md Azim, et al.
Pubblicazione: (2025)

Vision Model Pre-training on Interleaved Image-Text Data via Latent Compression Learning
di: Yang, Chenyu, et al.
Pubblicazione: (2024)