Cover Image

Enhancing Multimodal Large Language Models with Multi-instance Visual Prompt Generator for Visual Representation Enrichment

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zhong, Wenliang, Wu, Wenyi, Li, Qi, Barton, Rob, Du, Boxin, Sam, Shioulin, Bouyarmane, Karim, Tutar, Ismail, Huang, Junzhou
Format:	Preprint
Published:	2024
Subjects:	Computer Vision and Pattern Recognition
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Diffuse to Choose: Enriching Image Conditioned Inpainting in Latent Diffusion Models for Virtual Try-All
by: Seyfioglu, Mehmet Saygin, et al.
Published: (2024)

Hints of Prompt: Enhancing Visual Representation for Multimodal LLMs in Autonomous Driving
by: Zhou, Hao, et al.
Published: (2024)

PathM3: A Multimodal Multi-Task Multiple Instance Learning Framework for Whole Slide Image Classification and Captioning
by: Zhou, Qifeng, et al.
Published: (2024)

Confidence-Aware Sub-Structure Beam Search (CABS): Mitigating Hallucination in Structured Data Generation with Large Language Models
by: Wei, Chengwei, et al.
Published: (2024)

Visual Bridge: Universal Visual Perception Representations Generating
by: Gao, Yilin, et al.
Published: (2025)

Multi-scale Multi-instance Visual Sound Localization and Segmentation
by: Mo, Shentong, et al.
Published: (2024)

Visual Representation Alignment for Multimodal Large Language Models
by: Yoon, Heeji, et al.
Published: (2025)

Exploring the Transferability of Visual Prompting for Multimodal Large Language Models
by: Zhang, Yichi, et al.
Published: (2024)

Visual Prompting in Multimodal Large Language Models: A Survey
by: Wu, Junda, et al.
Published: (2024)

Exploring Multimodal Prompt for Visualization Authoring with Large Language Models
by: Wen, Zhen, et al.
Published: (2025)

Style-Instructed Mask-Free Virtual Try On
by: Zhang, Mengqi, et al.
Published: (2026)

Rethinking Visual Prompting for Multimodal Large Language Models with External Knowledge
by: Lin, Yuanze, et al.
Published: (2024)

VP-Bench: A Comprehensive Benchmark for Visual Prompting in Multimodal Large Language Models
by: Xu, Mingjie, et al.
Published: (2025)

DEFT-VTON: Efficient Virtual Try-On with Consistent Generalised H-Transform
by: Xu, Xingzi, et al.
Published: (2025)

Causal Probing for Internal Visual Representations in Multimodal Large Language Models
by: Deng, Zehao, et al.
Published: (2026)

Unleashing the Intrinsic Visual Representation Capability of Multimodal Large Language Models
by: Li, Hengzhuang, et al.
Published: (2025)

Image-of-Thought Prompting for Visual Reasoning Refinement in Multimodal Large Language Models
by: Zhou, Qiji, et al.
Published: (2024)

Large Language Model for Lossless Image Compression with Visual Prompts
by: Du, Junhao, et al.
Published: (2025)

video-SALMONN: Speech-Enhanced Audio-Visual Large Language Models
by: Sun, Guangzhi, et al.
Published: (2024)

Adjoint sharding for very long context training of state space models
by: Xu, Xingzi, et al.
Published: (2025)

A Survey of Hallucination in Large Visual Language Models
by: Lan, Wei, et al.
Published: (2024)

ControlMLLM: Training-Free Visual Prompt Learning for Multimodal Large Language Models
by: Wu, Mingrui, et al.
Published: (2024)

Predictive Regularization Against Visual Representation Degradation in Multimodal Large Language Models
by: Wang, Enguang, et al.
Published: (2026)

VisualAgentBench: Towards Large Multimodal Models as Visual Foundation Agents
by: Liu, Xiao, et al.
Published: (2024)

scpFormer: A Foundation Model for Unified Representation and Integration of the Single-Cell Proteomics
by: Zhou, Qifeng, et al.
Published: (2026)

Compositional Image Retrieval via Instruction-Aware Contrastive Learning
by: Zhong, Wenliang, et al.
Published: (2024)

Groma: Localized Visual Tokenization for Grounding Multimodal Large Language Models
by: Ma, Chuofan, et al.
Published: (2024)

DeSilva, Jeremy (ed.); with an introduction by Janet Browne. A most interesting problem: what Darwin's Descent of man got right and wrong about human evolution. 288 pp., illus., bibliogrs. Princeton: Univ. Press, 2021. £22.00 (cloth)
by: Rob Barton
Published: (2024)

Joint Visual and Text Prompting for Improved Object-Centric Perception with Multimodal Large Language Models
by: Jiang, Songtao, et al.
Published: (2024)

Prompt-Aware Adapter: Towards Learning Adaptive Visual Tokens for Multimodal Large Language Models
by: Zhang, Yue, et al.
Published: (2024)

EAGLE: Towards Efficient Arbitrary Referring Visual Prompts Comprehension for Multimodal Large Language Models
by: Zhang, Jiacheng, et al.
Published: (2024)

By My Eyes: Grounding Multimodal Large Language Models with Sensor Data via Visual Prompting
by: Yoon, Hyungjun, et al.
Published: (2024)

When Rubrics Fail: Error Enumeration as Reward in Reference-Free RL Post-Training for Virtual Try-On
by: Ikezogwo, Wisdom, et al.
Published: (2026)

Explicit Visual Prompts for Visual Object Tracking
by: Shi, Liangtao, et al.
Published: (2024)

Incorporating Visual Experts to Resolve the Information Loss in Multimodal Large Language Models
by: He, Xin, et al.
Published: (2024)

InstructVTON: Optimal Auto-Masking and Natural-Language-Guided Interactive Style Control for Inpainting-Based Virtual Try-On
by: Han, Julien, et al.
Published: (2025)

Structured Object Language Modeling (SoLM): Native Structured Objects Generation Conforming to Complex Schemas with Self-Supervised Denoising
by: Tavanaei, Amir, et al.
Published: (2024)

Pathology-knowledge Enhanced Multi-instance Prompt Learning for Few-shot Whole Slide Image Classification
by: Qu, Linhao, et al.
Published: (2024)

Visual-Guided Key-Token Regularization for Multimodal Large Language Model Unlearning
by: Cai, Chengyi, et al.
Published: (2026)

SEP: Self-Enhanced Prompt Tuning for Visual-Language Model
by: Yao, Hantao, et al.
Published: (2024)