Cover Image

Finetuning CLIP to Reason about Pairwise Differences

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Sam, Dylan, Willmott, Devin, Semedo, Joao D., Kolter, J. Zico
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Computer Vision and Pattern Recognition
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

HyperCLIP: Adapting Vision-Language models with Hypernetworks
by: Akinwande, Victor, et al.
Published: (2024)

Inference Optimal VLMs Need Fewer Visual Tokens and More Parameters
by: Li, Kevin Y., et al.
Published: (2024)

Mimetic Initialization of MLPs
by: Trockman, Asher, et al.
Published: (2026)

Diffusing Differentiable Representations
by: Savani, Yash, et al.
Published: (2024)

One-Step Diffusion Distillation via Deep Equilibrium Models
by: Geng, Zhengyang, et al.
Published: (2023)

Prompt Recovery for Image Generation Models: A Comparative Study of Discrete Optimizers
by: Williams, Joshua Nathaniel, et al.
Published: (2024)

Consistency Models Made Easy
by: Geng, Zhengyang, et al.
Published: (2024)

Mean Flows for One-step Generative Modeling
by: Geng, Zhengyang, et al.
Published: (2025)

From Variance to Veracity: Unbundling and Mitigating Gradient Variance in Differentiable Bundle Adjustment Layers
by: Gurumurthy, Swaminathan, et al.
Published: (2024)

Improved Mean Flows: On the Challenges of Fastforward Generative Models
by: Geng, Zhengyang, et al.
Published: (2025)

T-MARS: Improving Visual Representations by Circumventing Text Feature Learning
by: Maini, Pratyush, et al.
Published: (2023)

DART: Implicit Doppler Tomography for Radar Novel View Synthesis
by: Huang, Tianshu, et al.
Published: (2024)

Joint Distillation for Fast Likelihood Evaluation and Sampling in Flow-based Models
by: Ai, Xinyue, et al.
Published: (2025)

One-Step Diffusion Distillation through Score Implicit Matching
by: Luo, Weijian, et al.
Published: (2024)

Blind Inverse Problem Solving Made Easy by Text-to-Image Latent Diffusion
by: Dontas, Michail, et al.
Published: (2024)

Predicting the Performance of Black-box LLMs through Follow-up Queries
by: Sam, Dylan, et al.
Published: (2025)

IsoCLIP: Decomposing CLIP Projectors for Efficient Intra-modal Alignment
by: Magistri, Simone, et al.
Published: (2026)

The Balanced-Pairwise-Affinities Feature Transform
by: Shalam, Daniel, et al.
Published: (2024)

Multimodal LLMs under Pairwise Modalities
by: Li, Yan, et al.
Published: (2026)

Evaluating Language Model Reasoning about Confidential Information
by: Sam, Dylan, et al.
Published: (2025)

DeCLIP: Decoding CLIP representations for deepfake localization
by: Smeu, Stefan, et al.
Published: (2024)

Spatio-Temporal LLM: Reasoning about Environments and Actions
by: Zheng, Haozhen, et al.
Published: (2025)

Enhancing CLIP with CLIP: Exploring Pseudolabeling for Limited-Label Prompt Tuning
by: Menghini, Cristina, et al.
Published: (2023)

Revisiting Mixout: An Overlooked Path to Robust Finetuning
by: Aminbeidokhti, Masih, et al.
Published: (2025)

Pairwise Similarity Distribution Clustering for Noisy Label Learning
by: Bai, Sihan
Published: (2024)

Efficient Bayesian Inference from Noisy Pairwise Comparisons
by: Aczel, Till, et al.
Published: (2025)

Detecting AI-Generated Images via CLIP
by: Moskowitz, A. G., et al.
Published: (2024)

FairerCLIP: Debiasing CLIP's Zero-Shot Predictions using Functions in RKHSs
by: Dehdashtian, Sepehr, et al.
Published: (2024)

NeuCLIP: Efficient Large-Scale CLIP Training with Neural Normalizer Optimization
by: Wei, Xiyuan, et al.
Published: (2025)

Approximate Nullspace Augmented Finetuning for Robust Vision Transformers
by: Liu, Haoyang, et al.
Published: (2024)

NOAH: Learning Pairwise Object Category Attentions for Image Classification
by: Li, Chao, et al.
Published: (2024)

FastCLIP: A Suite of Optimization Techniques to Accelerate CLIP Training with Limited Resources
by: Wei, Xiyuan, et al.
Published: (2024)

Breaking the Limits of Open-Weight CLIP: An Optimization Framework for Self-supervised Fine-tuning of CLIP
by: Mehta, Anant, et al.
Published: (2026)

CLIP-UP: A Simple and Efficient Mixture-of-Experts CLIP Training Recipe with Sparse Upcycling
by: Wang, Xinze, et al.
Published: (2025)

MoP-CLIP: A Mixture of Prompt-Tuned CLIP Models for Domain Incremental Learning
by: Nicolas, Julien, et al.
Published: (2023)

Mind the Gap Between Prototypes and Images in Cross-domain Finetuning
by: Tian, Hongduan, et al.
Published: (2024)

Vision Transformer Finetuning Benefits from Non-Smooth Components
by: Odonnat, Ambroise, et al.
Published: (2026)

Beyond Pairwise Preferences: Listwise Reward-Aware Alignment for Diffusion Models
by: Wang, Austin, et al.
Published: (2026)

TiC-CLIP: Continual Training of CLIP Models
by: Garg, Saurabh, et al.
Published: (2023)

Online Zero-Shot Classification with CLIP
by: Qian, Qi, et al.
Published: (2024)