Cover Image

Dynamic Multimodal Prototype Learning in Vision-Language Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zhu, Xingyu, Wang, Shuo, Zhu, Beier, Li, Miaoge, Li, Yunfan, Fang, Junfeng, Wang, Zhicai, Wang, Dongsheng, Zhang, Hanwang
Format:	Preprint
Published:	2025
Subjects:	Computer Vision and Pattern Recognition
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Look Carefully: Adaptive Visual Reinforcements in Multimodal Large Language Models for Hallucination Mitigation
by: Zhu, Xingyu, et al.
Published: (2026)

Mitigating Hallucinations in Large Vision-Language Models without Performance Degradation
by: Zhu, Xingyu, et al.
Published: (2026)

Principled Steering via Null-space Projection for Jailbreak Defense in Vision-Language Models
by: Zhu, Xingyu, et al.
Published: (2026)

Hierarchical Semantic Alignment for Image Clustering
by: Zhu, Xingyu, et al.
Published: (2025)

Enhancing Zero-Shot Vision Models by Label-Free Prompt Distribution Learning and Bias Correcting
by: Zhu, Xingyu, et al.
Published: (2024)

Selective Vision-Language Subspace Projection for Few-shot CLIP
by: Zhu, Xingyu, et al.
Published: (2024)

GuardAlign: Test-time Safety Alignment in Multimodal Large Language Models
by: Zhu, Xingyu, et al.
Published: (2026)

Instruction Tuning-free Visual Token Complement for Multimodal LLMs
by: Wang, Dongsheng, et al.
Published: (2024)

Adapting Point Cloud Analysis via Multimodal Bayesian Distribution Learning
by: Zhu, Xingyu, et al.
Published: (2026)

Enhancing CLIP Robustness via Cross-Modality Alignment
by: Zhu, Xingyu, et al.
Published: (2025)

Res-Bench: Benchmarking the Robustness of Multimodal Large Language Models to Dynamic Resolution Input
by: Li, Chenxu, et al.
Published: (2025)

Robust Fine-tuning of Zero-shot Models via Variance Reduction
by: Zhu, Beier, et al.
Published: (2024)

Debiased Fine-Tuning for Vision-language Models by Prompt Regularization
by: Zhu, Beier, et al.
Published: (2023)

Distilling Parallel Gradients for Fast ODE Solvers of Diffusion Models
by: Zhu, Beier, et al.
Published: (2025)

Patch-Prompt Aligned Bayesian Prompt Tuning for Vision-Language Models
by: Liu, Xinyang, et al.
Published: (2023)

Thinking with Images as Continuous Actions: Numerical Visual Chain-of-Thought
by: Zhao, Kesen, et al.
Published: (2026)

Generalized Logit Adjustment: Calibrating Fine-tuned Models by Removing Label Bias in Foundation Models
by: Zhu, Beier, et al.
Published: (2023)

Project-Probe-Aggregate: Efficient Fine-Tuning for Group Robustness
by: Zhu, Beier, et al.
Published: (2025)

Unsupervised Visual Chain-of-Thought Reasoning via Preference Optimization
by: Zhao, Kesen, et al.
Published: (2025)

Multimodal Feature Prototype Learning for Interpretable and Discriminative Cancer Survival Prediction
by: Jiang, Shuo, et al.
Published: (2025)

STiTch: Semantic Transition and Transportation in Collaboration for Training-Free Zero-Shot Composed Image Retrieval
by: Li, Miaoge, et al.
Published: (2026)

Model Inversion Attacks Through Target-Specific Conditional Diffusion Models
by: Li, Ouxiang, et al.
Published: (2024)

MuSteerNet: Human Reaction Generation from Videos via Observation-Reaction Mutual Steering
by: Zhou, Yuan, et al.
Published: (2026)

Prompt-aligned Gradient for Prompt Tuning
by: Zhu, Beier, et al.
Published: (2022)

Parallel Diffusion Solver via Residual Dirichlet Policy Optimization
by: Wang, Ruoyu, et al.
Published: (2025)

TsCA: On the Semantic Consistency Alignment via Conditional Transport for Compositional Zero-Shot Learning
by: Li, Miaoge, et al.
Published: (2024)

MIRL: Mutual Information-Guided Reinforcement Learning for Vision-Language Models
by: Zhang, Yin, et al.
Published: (2026)

Dataset Distillation via Vision-Language Category Prototype
by: Zou, Yawen, et al.
Published: (2025)

Exploring Transferable Homogeneous Groups for Compositional Zero-Shot Learning
by: Rao, Zhijie, et al.
Published: (2025)

3D Question Answering via only 2D Vision-Language Models
by: Wang, Fengyun, et al.
Published: (2025)

SDEval: Safety Dynamic Evaluation for Multimodal Large Language Models
by: Wang, Hanqing, et al.
Published: (2025)

Vision Also You Need: Navigating Out-of-Distribution Detection with Multimodal Large Language Model
by: Xu, Haoran, et al.
Published: (2026)

TokenCom: Vision-Language Model for Multimodal and Multitask Token Communications
by: Jiang, Feibo, et al.
Published: (2026)

MERGETUNE: Continued Fine-Tuning of Vision-Language Models
by: Wang, Wenqing, et al.
Published: (2026)

Streaming Drag-Oriented Interactive Video Manipulation: Drag Anything, Anytime!
by: Zhou, Junbao, et al.
Published: (2025)

Boosting Open-Domain Continual Learning via Leveraging Intra-domain Category-aware Prototype
by: Lu, Yadong, et al.
Published: (2024)

Griffon-G: Bridging Vision-Language and Vision-Centric Tasks via Large Multimodal Models
by: Zhan, Yufei, et al.
Published: (2024)

Adaptive Stochastic Coefficients for Accelerating Diffusion Sampling
by: Wang, Ruoyu, et al.
Published: (2025)

Task Preference Optimization: Improving Multimodal Large Language Models with Vision Task Alignment
by: Yan, Ziang, et al.
Published: (2024)

Classes Are Not Equal: An Empirical Study on Image Recognition Fairness
by: Cui, Jiequan, et al.
Published: (2024)