Cover Image

Understanding the Robustness of Multi-modal Contrastive Learning to Distribution Shift

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Xue, Yihao, Joshi, Siddharth, Nguyen, Dang, Mirzasoleiman, Baharan
Format:	Preprint
Published:	2023
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Data-Efficient Contrastive Self-supervised Learning: Most Beneficial Examples for Supervised Learning Contribute the Least
by: Joshi, Siddharth, et al.
Published: (2023)

Investigating the Benefits of Projection Head for Representation Learning
by: Xue, Yihao, et al.
Published: (2024)

Challenges and Opportunities in Improving Worst-Group Generalization in Presence of Spurious Features
by: Joshi, Siddharth, et al.
Published: (2023)

Few-shot Adaptation to Distribution Shifts By Mixing Source and Target Embeddings
by: Xue, Yihao, et al.
Published: (2023)

Dataset Distillation via Knowledge Distillation: Towards Efficient Self-Supervised Pre-Training of Deep Networks
by: Joshi, Siddharth, et al.
Published: (2024)

Investigating the Impact of Model Width and Density on Generalization in Presence of Label Noise
by: Xue, Yihao, et al.
Published: (2022)

Graph Contrastive Learning under Heterophily via Graph Filters
by: Yang, Wenhan, et al.
Published: (2023)

Data-Efficient Contrastive Language-Image Pretraining: Prioritizing Data Quality over Quantity
by: Joshi, Siddharth, et al.
Published: (2024)

Representations Shape Weak-to-Strong Generalization: Theoretical Insights and Empirical Predictions
by: Xue, Yihao, et al.
Published: (2025)

Beyond Semantic Entropy: Boosting LLM Uncertainty Quantification with Pairwise Semantic Similarity
by: Nguyen, Dang, et al.
Published: (2025)

Changing the Training Data Distribution to Reduce Simplicity Bias Improves In-distribution Generalization
by: Nguyen, Dang, et al.
Published: (2024)

Beyond What Seems Necessary: Hidden Gains from Scaling Training-Time Reasoning Length under Outcome Supervision
by: Xue, Yihao, et al.
Published: (2026)

Do We Need All the Synthetic Data? Targeted Image Augmentation via Diffusion Models
by: Nguyen, Dang, et al.
Published: (2025)

Understanding the Role of Training Data in Test-Time Scaling
by: Javanmard, Adel, et al.
Published: (2025)

Tuning the Implicit Regularizer of Masked Diffusion Language Models: Enhancing Generalization via Insights from $k$-Parity
by: Huang, Jianhao, et al.
Published: (2026)

LoRA is All You Need for Safety Alignment of Reasoning LLMs
by: Xue, Yihao, et al.
Published: (2025)

Mini-batch Coresets for Memory-efficient Language Model Training on Data Mixtures
by: Nguyen, Dang, et al.
Published: (2024)

Theoretical Perspectives on Data Quality and Synergistic Effects in Pre- and Post-Training Reasoning Models
by: Javanmard, Adel, et al.
Published: (2026)

MM-GEN: Enhancing Task Performance Through Targeted Multimodal Data Curation
by: Joshi, Siddharth, et al.
Published: (2025)

Synthetic Text Generation for Training Large Language Models via Gradient Matching
by: Nguyen, Dang, et al.
Published: (2025)

Data Selection for Fine-tuning Vision Language Models via Cross Modal Alignment Trajectories
by: Naharas, Nilay, et al.
Published: (2025)

Data Distribution as a Lever for Guiding Optimizers Toward Superior Generalization in LLMs
by: Gangavarapu, Tushaar, et al.
Published: (2026)

How Transformers Learn to Plan via Multi-Token Prediction
by: Huang, Jianhao, et al.
Published: (2026)

Better Safe than Sorry: Pre-training CLIP against Targeted Data Poisoning and Backdoor Attacks
by: Yang, Wenhan, et al.
Published: (2023)

Identifying Spurious Biases Early in Training through the Lens of Simplicity Bias
by: Yang, Yu, et al.
Published: (2023)

SmallToLarge (S2L): Scalable Data Selection for Fine-tuning Large Language Models by Summarizing Training Trajectories of Small Models
by: Yang, Yu, et al.
Published: (2024)

Verify when Uncertain: Beyond Self-Consistency in Black Box Hallucination Detection
by: Xue, Yihao, et al.
Published: (2025)

On the Comparison between Multi-modal and Single-modal Contrastive Learning
by: Huang, Wei, et al.
Published: (2024)

Robust Visual Representation Learning with Multi-modal Prior Knowledge for Image Classification Under Distribution Shift
by: Zhou, Hongkuan, et al.
Published: (2024)

Backdoor Attacks on Multi-modal Contrastive Learning
by: Kuniyilh, Simi D, et al.
Published: (2026)

Positive Distribution Shift as a Framework for Understanding Tractable Learning
by: Medvedev, Marko, et al.
Published: (2026)

Graph Data Augmentation with Contrastive Learning on Covariate Distribution Shift
by: Zeng, Fanlong, et al.
Published: (2025)

Scalable Out-of-distribution Robustness in the Presence of Unobserved Confounders
by: Prashant, Parjanya, et al.
Published: (2024)

Class Distribution Shifts in Zero-Shot Learning: Learning Robust Representations
by: Slavutsky, Yuli, et al.
Published: (2023)

Adaptive Estimation and Learning under Temporal Distribution Shift
by: Baby, Dheeraj, et al.
Published: (2025)

Continual Contrastive Learning on Tabular Data with Out of Distribution
by: Ginanjar, Achmad, et al.
Published: (2025)

Robust Transfer Learning for Active Level Set Estimation with Locally Adaptive Gaussian Process Prior
by: Ngo, Giang, et al.
Published: (2024)

Learning Optimal Classification Trees Robust to Distribution Shifts
by: Justin, Nathan, et al.
Published: (2023)

ComaDICE: Offline Cooperative Multi-Agent Reinforcement Learning with Stationary Distribution Shift Regularization
by: Bui, The Viet, et al.
Published: (2024)

Improving Medical Multi-modal Contrastive Learning with Expert Annotations
by: Kumar, Yogesh, et al.
Published: (2024)