Image de couverture de livre

Enhanced Vision-Language Models for Diverse Sensor Understanding: Cost-Efficient Optimization and Benchmarking

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Chung, Sangyun, Yu, Youngjoon, Kim, Se Yeon, Chee, Youngchae, Ro, Yong Man
Format:	Preprint
Publié:	2024
Sujets:	Computer Vision and Pattern Recognition
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

SPARK: Multi-Vision Sensor Perception and Reasoning Benchmark for Large-scale Vision-Language Models
par: Yu, Youngjoon, et autres
Publié: (2024)

MAD: Modality-Adaptive Decoding for Mitigating Cross-Modal Hallucinations in Multimodal Large Language Models
par: Chung, Sangyun, et autres
Publié: (2026)

Revisiting Misalignment in Multispectral Pedestrian Detection: A Language-Driven Approach for Cross-modal Alignment Fusion
par: Kim, Taeheon, et autres
Publié: (2024)

MSCoTDet: Language-driven Multi-modal Fusion for Improved Multispectral Pedestrian Detection
par: Kim, Taeheon, et autres
Publié: (2024)

Remote Sensing Large Vision-Language Model: Semantic-augmented Multi-level Alignment and Semantic-aware Expert Modeling
par: Park, Sungjune, et autres
Publié: (2025)

Phantom of Latent for Large Language and Vision Models
par: Lee, Byung-Kwan, et autres
Publié: (2024)

TroL: Traversal of Layers for Large Language and Vision Models
par: Lee, Byung-Kwan, et autres
Publié: (2024)

GCAgent: Long-Video Understanding via Schematic and Narrative Episodic Memory
par: Yeo, Jeong Hun, et autres
Publié: (2025)

Empathetic Response in Audio-Visual Conversations Using Emotion Preference Optimization and MambaCompressor
par: Kim, Yeonju, et autres
Publié: (2024)

Causal Mode Multiplexer: A Novel Framework for Unbiased Multispectral Pedestrian Detection
par: Kim, Taeheon, et autres
Publié: (2024)

What if...?: Thinking Counterfactual Keywords Helps to Mitigate Hallucination in Large Multi-modal Models
par: Kim, Junho, et autres
Publié: (2024)

ReFoCUS: Reinforcement-guided Frame Optimization for Contextual Understanding
par: Lee, Hosu, et autres
Publié: (2025)

Meteor: Mamba-based Traversal of Rationale for Large Language and Vision Models
par: Lee, Byung-Kwan, et autres
Publié: (2024)

MoAI: Mixture of All Intelligence for Large Language and Vision Models
par: Lee, Byung-Kwan, et autres
Publié: (2024)

Fork-Merge Decoding: Enhancing Multimodal Understanding in Audio-Visual Large Language Models
par: Jung, Chaeyoung, et autres
Publié: (2025)

CoLLaVO: Crayon Large Language and Vision mOdel
par: Lee, Byung-Kwan, et autres
Publié: (2024)

Integrating Language-Derived Appearance Elements with Visual Cues in Pedestrian Detection
par: Park, Sungjune, et autres
Publié: (2023)

Text-driven Talking Face Synthesis by Reprogramming Audio-driven Models
par: Choi, Jeongsoo, et autres
Publié: (2023)

Unified Reinforcement and Imitation Learning for Vision-Language Models
par: Lee, Byung-Kwan, et autres
Publié: (2025)

Look Every Frame All at Once: Video-Ma$^2$mba for Efficient Long-form Video Understanding with Multi-Axis Gradient Checkpointing
par: Lee, Hosu, et autres
Publié: (2024)

DIP-R1: Deep Inspection and Perception with RL Looking Through and Understanding Complex Scenes
par: Park, Sungjune, et autres
Publié: (2025)

How Well Do Vision--Language Models Understand Cities? A Comparative Study on Spatial Reasoning from Street-View Images
par: Ro, Juneyoung, et autres
Publié: (2025)

Efficient Training for Multilingual Visual Speech Recognition: Pre-training with Discretized Visual Speech Representation
par: Kim, Minsu, et autres
Publié: (2024)

Deep Understanding of Sign Language for Sign to Subtitle Alignment
par: Jang, Youngjoon, et autres
Publié: (2025)

VLsI: Verbalized Layers-to-Interactions from Large to Small Vision Language Models
par: Lee, Byung-Kwan, et autres
Publié: (2024)

Language-guided Learning for Object Detection Tackling Multiple Variations in Aerial Images
par: Park, Sungjune, et autres
Publié: (2025)

AV2AV: Direct Audio-Visual Speech to Audio-Visual Speech Translation with Unified Audio-Visual Speech Representation
par: Choi, Jeongsoo, et autres
Publié: (2023)

MMS-LLaMA: Efficient LLM-based Audio-Visual Speech Recognition with Minimal Multimodal Speech Tokens
par: Yeo, Jeong Hun, et autres
Publié: (2025)

Robust Pedestrian Detection via Constructing Versatile Pedestrian Knowledge Bank
par: Park, Sungjune, et autres
Publié: (2024)

Recursive Think-Answer Process for LLMs and VLMs
par: Lee, Byung-Kwan, et autres
Publié: (2026)

CODE: Contrasting Self-generated Description to Combat Hallucination in Large Multi-modal Models
par: Kim, Junho, et autres
Publié: (2024)

STRIDE: When to Speak Meets Sequence Denoising for Streaming Video Understanding
par: Kim, Junho, et autres
Publié: (2026)

AVCD: Mitigating Hallucinations in Audio-Visual Large Language Models through Contrastive Decoding
par: Jung, Chaeyoung, et autres
Publié: (2025)

Exploring Phonetic Context-Aware Lip-Sync For Talking Face Generation
par: Park, Se Jin, et autres
Publié: (2023)

Benchmarking Direct Preference Optimization for Medical Large Vision-Language Models
par: Kim, Dain, et autres
Publié: (2026)

AV-EmoDialog: Chat with Audio-Visual Users Leveraging Emotional Cues
par: Park, Se Jin, et autres
Publié: (2024)

Robust Egocentric Visual Attention Prediction Through Language-guided Scene Context-aware Learning
par: Park, Sungjune, et autres
Publié: (2026)

Robust Grounding with MLLMs Against Occlusion and Small Objects via Language-Guided Semantic Cues
par: Park, Beomchan, et autres
Publié: (2026)

SALOVA: Segment-Augmented Long Video Assistant for Targeted Retrieval and Routing in Long-Form Video Analysis
par: Kim, Junho, et autres
Publié: (2024)

Where Visual Speech Meets Language: VSP-LLM Framework for Efficient and Context-Aware Visual Speech Processing
par: Yeo, Jeong Hun, et autres
Publié: (2024)