Image de couverture de livre

Understanding the Gain from Data Filtering in Multimodal Contrastive Learning

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Pareek, Divyansh, Oh, Sewoong, Du, Simon S.
Format:	Preprint
Publié:	2025
Sujets:	Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Understanding the Gains from Repeated Self-Distillation
par: Pareek, Divyansh, et autres
Publié: (2024)

Data Mixture Inference: What do BPE Tokenizers Reveal about their Training Data?
par: Hayase, Jonathan, et autres
Publié: (2024)

CLIPLoss and Norm-Based Data Selection Methods for Multimodal Contrastive Learning
par: Wang, Yiping, et autres
Publié: (2024)

Variance Alignment Score: A Simple But Tough-to-Beat Data Selection Method for Multimodal Contrastive Learning
par: Wang, Yiping, et autres
Publié: (2024)

PLeaS -- Merging Models with Permutations and Least Squares
par: Nasery, Anshul, et autres
Publié: (2024)

Hierarchical Contrastive Learning for Multimodal Data
par: Li, Huichao, et autres
Publié: (2026)

DeepPolar: Inventing Nonlinear Large-Kernel Polar Codes via Deep Learning
par: Hebbar, S Ashwin, et autres
Publié: (2024)

Cross-Contrastive Clustering for Multimodal Attributed Graphs with Dual Graph Filtering
par: Zheng, Haoran, et autres
Publié: (2025)

Randomization Techniques to Mitigate the Risk of Copyright Infringement
par: Chen, Wei-Ning, et autres
Publié: (2024)

Training AI to be Loyal
par: Oh, Sewoong, et autres
Publié: (2025)

Contrastive Representation for Data Filtering in Cross-Domain Offline Reinforcement Learning
par: Wen, Xiaoyu, et autres
Publié: (2024)

CUBE: Contrastive Understanding by Balanced Experiments
par: Kim, Dongseok, et autres
Publié: (2025)

Advancing Drug Discovery with Enhanced Chemical Understanding via Asymmetric Contrastive Multimodal Learning
par: Wang, Yifei, et autres
Publié: (2023)

Continual Multimodal Contrastive Learning
par: Liu, Xiaohao, et autres
Publié: (2025)

Group Contrastive Learning for Weakly Paired Multimodal Data
par: Gorla, Aditya, et autres
Publié: (2026)

Decoupled-Value Attention for Prior-Data Fitted Networks: GP Inference for Physical Equations
par: Sharma, Kaustubh, et autres
Publié: (2025)

Sampling from Your Language Model One Byte at a Time
par: Hayase, Jonathan, et autres
Publié: (2025)

Understanding Language Prior of LVLMs by Contrasting Chain-of-Embedding
par: Long, Lin, et autres
Publié: (2025)

Characterizing the Training Dynamics of Private Fine-tuning with Langevin diffusion
par: Ke, Shuqi, et autres
Publié: (2024)

Do Vision--Language Models Understand 3D Scenes or Just Catalogue Objects?
par: Maheshwari, Animesh, et autres
Publié: (2026)

Graph Contrastive Learning under Heterophily via Graph Filters
par: Yang, Wenhan, et autres
Publié: (2023)

Canonicalizing Multimodal Contrastive Representation Learning
par: Gupta, Sharut, et autres
Publié: (2026)

Understanding Multimodal LLMs Under Distribution Shifts: An Information-Theoretic Approach
par: Oh, Changdae, et autres
Publié: (2025)

Generative Pre-Training of Time-Series Data for Unsupervised Fault Detection in Semiconductor Manufacturing
par: Lee, Sewoong, et autres
Publié: (2023)

One-shot Empirical Privacy Estimation for Federated Learning
par: Andrew, Galen, et autres
Publié: (2023)

Are Robust LLM Fingerprints Adversarially Robust?
par: Nasery, Anshul, et autres
Publié: (2025)

Structure-aware Contrastive Learning for Diagram Understanding of Multimodal Models
par: Sasaki, Hiroshi
Publié: (2025)

Mechanistic Evidence for Spectral Structures in Prior-Data Fitted Networks
par: Sharma, Kaustubh, et autres
Publié: (2026)

Recycling the Web: A Method to Enhance Pre-training Data Quality and Quantity for Language Models
par: Nguyen, Thao, et autres
Publié: (2025)

Data-Efficient Strategies for Probabilistic Voltage Envelopes under Network Contingencies
par: Pareek, Parikshit, et autres
Publié: (2023)

S4S: Solving for a Diffusion Model Solver
par: Frankel, Eric, et autres
Publié: (2025)

Improved Communication-Privacy Trade-offs in $L_2$ Mean Estimation under Streaming Differential Privacy
par: Chen, Wei-Ning, et autres
Publié: (2024)

Can Public Large Language Models Help Private Cross-device Federated Learning?
par: Wang, Boxin, et autres
Publié: (2023)

A Multi-Component AI Framework for Computational Psychology: From Robust Predictive Modeling to Deployed Generative Dialogue
par: Pareek, Anant
Publié: (2025)

Neuronal Fluctuations: Learning Rates vs Participating Neurons
par: Pareek, Darsh, et autres
Publié: (2025)

DPZero: Private Fine-Tuning of Language Models without Backpropagation
par: Zhang, Liang, et autres
Publié: (2023)

Contrastive Learning on Multimodal Analysis of Electronic Health Records
par: Cai, Tianxi, et autres
Publié: (2024)

Towards Understanding the Benefit of Multitask Representation Learning in Decision Process
par: Lu, Rui, et autres
Publié: (2025)

Learning Power Flow with Confidence: A Probabilistic Guarantee Framework for Voltage Risk
par: Pareek, Parikshit, et autres
Publié: (2023)

SuperBPE: Space Travel for Language Models
par: Liu, Alisa, et autres
Publié: (2025)