Cover Image

From Holistic to Localized: Local Enhanced Adapters for Efficient Visual Instruction Fine-Tuning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Jiao, Pengkun, Zhu, Bin, Chen, Jingjing, Ngo, Chong-Wah, Jiang, Yu-Gang
Format:	Preprint
Published:	2024
Subjects:	Computer Vision and Pattern Recognition Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Don't Deceive Me: Mitigating Gaslighting through Attention Reallocation in LMMs
by: Jiao, Pengkun, et al.
Published: (2025)

RoDE: Linear Rectified Mixture of Diverse Experts for Food Large Multi-Modal Models
by: Jiao, Pengkun, et al.
Published: (2024)

Unlocking Textual and Visual Wisdom: Open-Vocabulary 3D Object Detection Enhanced by Comprehensive Guidance from Text and Image
by: Jiao, Pengkun, et al.
Published: (2024)

Retrieval Augmented Recipe Generation
by: Liu, Guoshan, et al.
Published: (2024)

FoodLMM: A Versatile Food Assistant using Large Multi-modal Model
by: Yin, Yuehao, et al.
Published: (2023)

Advancing Food Nutrition Estimation via Visual-Ingredient Feature Fusion
by: Qi, Huiyan, et al.
Published: (2025)

Spatiotemporal Sycophancy: Negation-Based Gaslighting in Video Large Language Models
by: Tang, Ziyao, et al.
Published: (2026)

Domain Expansion and Boundary Growth for Open-Set Single-Source Domain Generalization
by: Jiao, Pengkun, et al.
Published: (2024)

Pear: Pruning and Sharing Adapters in Visual Parameter-Efficient Fine-Tuning
by: Zhong, Yibo, et al.
Published: (2024)

EAGLE: Towards Efficient Arbitrary Referring Visual Prompts Comprehension for Multimodal Large Language Models
by: Zhang, Jiacheng, et al.
Published: (2024)

Interpretable Embedding for Ad-hoc Video Search
by: Wu, Jiaxin, et al.
Published: (2024)

SpatialImaginer: Towards Adaptive Visual Imagination for Spatial Reasoning
by: Li, Yian, et al.
Published: (2026)

From Canteen Food to Daily Meals: Generalizing Food Recognition to More Practical Scenarios
by: Liu, Guoshan, et al.
Published: (2024)

Mixture of Physical Priors Adapter for Parameter-Efficient Fine-Tuning
by: Wang, Zhaozhi, et al.
Published: (2024)

Beyond Graph Model: Reliable VLM Fine-Tuning via Random Graph Adapter
by: Jiang, Bo, et al.
Published: (2025)

MoSA: Mixture of Sparse Adapters for Visual Efficient Tuning
by: Zhang, Qizhe, et al.
Published: (2023)

Multi-modal Instruction Tuned LLMs with Fine-grained Visual Perception
by: He, Junwen, et al.
Published: (2024)

Improving Interpretable Embeddings for Ad-hoc Video Search with Generative Captions and Multi-word Concept Bank
by: Wu, Jiaxin, et al.
Published: (2024)

PosMLP-Video: Spatial and Temporal Relative Position Encoding for Efficient Video Recognition
by: Hao, Yanbin, et al.
Published: (2024)

NuScenes-QA: A Multi-modal Visual Question Answering Benchmark for Autonomous Driving Scenario
by: Qian, Tianwen, et al.
Published: (2023)

Adapter-X: A Novel General Parameter-Efficient Fine-Tuning Framework for Vision
by: Li, Minglei, et al.
Published: (2024)

Why Not Replace? Sustaining Long-Term Visual Localization via Handcrafted-Learned Feature Collaboration on CPU
by: Lin, Yicheng, et al.
Published: (2025)

ControlThinker: Unveiling Latent Semantics for Controllable Image Generation through Visual Reasoning
by: Han, Feng, et al.
Published: (2025)

Towards Unbiased Cross-Modal Representation Learning for Food Image-to-Recipe Retrieval
by: Wang, Qing, et al.
Published: (2025)

BT-Adapter: Video Conversation is Feasible Without Video Instruction Tuning
by: Liu, Ruyang, et al.
Published: (2023)

Semantic Hierarchical Prompt Tuning for Parameter-Efficient Fine-Tuning
by: Zhu, Haowei, et al.
Published: (2024)

Mitigating Cross-modal Representation Bias for Multicultural Image-to-Recipe Retrieval
by: Wang, Qing, et al.
Published: (2025)

INST-IT: Boosting Instance Understanding via Explicit Visual Prompt Instruction Tuning
by: Peng, Wujian, et al.
Published: (2024)

Fine-Grained VLM Fine-tuning via Latent Hierarchical Adapter Learning
by: Zhao, Yumiao, et al.
Published: (2025)

LLMs-based Augmentation for Domain Adaptation in Long-tailed Food Datasets
by: Wang, Qing, et al.
Published: (2025)

Benchmarking Gaslighting Negation Attacks Against Reasoning Models
by: Zhu, Bin, et al.
Published: (2025)

ConsistentRFT: Reducing Visual Hallucinations in Flow-based Reinforcement Fine-Tuning
by: Tan, Xiaofeng, et al.
Published: (2026)

CookingDiffusion: Cooking Procedural Image Generation with Stable Diffusion
by: Wang, Yuan, et al.
Published: (2025)

Class Agnostic Instance-level Descriptor for Visual Instance Search
by: Sun, Qi-Ying, et al.
Published: (2025)

PanAdapter: Two-Stage Fine-Tuning with Spatial-Spectral Priors Injecting for Pansharpening
by: Wu, RuoCheng, et al.
Published: (2024)

Decoupling Spatio-Temporal Adapter for Fine-Grained Badminton Action Localization
by: Wang, Tianyu, et al.
Published: (2026)

Decoupled Training with Local Reinforcement Fine-Tuning in Federated Learning
by: Ma, Yuting, et al.
Published: (2026)

On the Suitability of Reinforcement Fine-Tuning to Visual Tasks
by: Chen, Xiaxu, et al.
Published: (2025)

OVFoodSeg: Elevating Open-Vocabulary Food Image Segmentation via Image-Informed Textual Representation
by: Wu, Xiongwei, et al.
Published: (2024)

Robust and Generalizable GNN Fine-Tuning via Uncertainty-aware Adapter Learning
by: Jiang, Bo, et al.
Published: (2025)