Cover Image

Robust Fine-tuning of Zero-shot Models via Variance Reduction

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zhu, Beier, Cui, Jiequan, Zhang, Hanwang
Format:	Preprint
Published:	2024
Subjects:	Computer Vision and Pattern Recognition
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Project-Probe-Aggregate: Efficient Fine-Tuning for Group Robustness
by: Zhu, Beier, et al.
Published: (2025)

Generalized Logit Adjustment: Calibrating Fine-tuned Models by Removing Label Bias in Foundation Models
by: Zhu, Beier, et al.
Published: (2023)

Classes Are Not Equal: An Empirical Study on Image Recognition Fairness
by: Cui, Jiequan, et al.
Published: (2024)

Reducing Class-Wise Performance Disparity via Margin Regularization
by: Zhu, Beier, et al.
Published: (2026)

Fine-tuning Multimodal LLMs to Follow Zero-shot Demonstrative Instructions
by: Li, Juncheng, et al.
Published: (2023)

Debiased Fine-Tuning for Vision-language Models by Prompt Regularization
by: Zhu, Beier, et al.
Published: (2023)

Enhancing CLIP Robustness via Cross-Modality Alignment
by: Zhu, Xingyu, et al.
Published: (2025)

StarFT: Robust Fine-tuning of Zero-shot Models via Spuriosity Alignment
by: Kim, Younghyun, et al.
Published: (2025)

Enhancing Zero-Shot Vision Models by Label-Free Prompt Distribution Learning and Bias Correcting
by: Zhu, Xingyu, et al.
Published: (2024)

Selective Vision-Language Subspace Projection for Few-shot CLIP
by: Zhu, Xingyu, et al.
Published: (2024)

Unsupervised Visual Chain-of-Thought Reasoning via Preference Optimization
by: Zhao, Kesen, et al.
Published: (2025)

CARE Transformer: Mobile-Friendly Linear Visual Transformer via Decoupled Dual Interaction
by: Zhou, Yuan, et al.
Published: (2024)

Generalized Kullback-Leibler Divergence Loss
by: Cui, Jiequan, et al.
Published: (2025)

Generative Distribution Distillation
by: Cui, Jiequan, et al.
Published: (2025)

Instruction Tuning-free Visual Token Complement for Multimodal LLMs
by: Wang, Dongsheng, et al.
Published: (2024)

Distilling Parallel Gradients for Fast ODE Solvers of Diffusion Models
by: Zhu, Beier, et al.
Published: (2025)

Doubly Abductive Counterfactual Inference for Text-based Image Editing
by: Song, Xue, et al.
Published: (2024)

Aligned Contrastive Loss for Long-Tailed Recognition
by: Ma, Jiali, et al.
Published: (2025)

Principled Steering via Null-space Projection for Jailbreak Defense in Vision-Language Models
by: Zhu, Xingyu, et al.
Published: (2026)

Decoupled Kullback-Leibler Divergence Loss
by: Cui, Jiequan, et al.
Published: (2023)

SynQ: Accurate Zero-shot Quantization by Synthesis-aware Fine-tuning
by: Kim, Minjun, et al.
Published: (2026)

LoRA of Change: Learning to Generate LoRA for the Editing Instruction from A Single Before-After Image Pair
by: Song, Xue, et al.
Published: (2024)

Pushing Rendering Boundaries: Hard Gaussian Splatting
by: Xu, Qingshan, et al.
Published: (2024)

Adapting Point Cloud Analysis via Multimodal Bayesian Distribution Learning
by: Zhu, Xingyu, et al.
Published: (2026)

Prompt-aligned Gradient for Prompt Tuning
by: Zhu, Beier, et al.
Published: (2022)

Efficient and Versatile Robust Fine-Tuning of Zero-shot Models
by: Kim, Sungyeon, et al.
Published: (2024)

Look Carefully: Adaptive Visual Reinforcements in Multimodal Large Language Models for Hallucination Mitigation
by: Zhu, Xingyu, et al.
Published: (2026)

Thinking with Images as Continuous Actions: Numerical Visual Chain-of-Thought
by: Zhao, Kesen, et al.
Published: (2026)

Parallel Diffusion Solver via Residual Dirichlet Policy Optimization
by: Wang, Ruoyu, et al.
Published: (2025)

NeuSpring: Neural Spring Fields for Reconstruction and Simulation of Deformable Objects from Videos
by: Xu, Qingshan, et al.
Published: (2025)

Fine-grained Abnormality Prompt Learning for Zero-shot Anomaly Detection
by: Zhu, Jiawen, et al.
Published: (2024)

Dual Risk Minimization: Towards Next-Level Robustness in Fine-tuning Zero-Shot Models
by: Li, Kaican, et al.
Published: (2024)

MuSteerNet: Human Reaction Generation from Videos via Observation-Reaction Mutual Steering
by: Zhou, Yuan, et al.
Published: (2026)

Dynamic Multimodal Prototype Learning in Vision-Language Models
by: Zhu, Xingyu, et al.
Published: (2025)

Robust Fine-tuning for Pre-trained 3D Point Cloud Models
by: Zhang, Zhibo, et al.
Published: (2024)

Few-shot Learner Parameterization by Diffusion Time-steps
by: Yue, Zhongqi, et al.
Published: (2024)

PointRFT: Explicit Reinforcement Fine-tuning for Point Cloud Few-shot Learning
by: Wang, Yankai, et al.
Published: (2026)

Streaming Drag-Oriented Interactive Video Manipulation: Drag Anything, Anytime!
by: Zhou, Junbao, et al.
Published: (2025)

Hierarchically Robust Zero-shot Vision-language Models
by: Dong, Junhao, et al.
Published: (2026)

Diffusion-Sharpening: Fine-tuning Diffusion Models with Denoising Trajectory Sharpening
by: Tian, Ye, et al.
Published: (2025)