Copertina

Audio-visual training for improved grounding in video-text LLMs

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Sagare, Shivprasad, S, Hemachandran, Sarabhai, Kinshuk, Ullegaddi, Prashant, SA, Rajeshkumar
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Computer Vision and Pattern Recognition Computation and Language Multimedia
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Integrating Fine-Grained Audio-Visual Evidence for Robust Multimodal Emotion Reasoning
di: Zhao, Zhixian, et al.
Pubblicazione: (2026)

Empowering Multimodal LLMs with External Tools: A Comprehensive Survey
di: An, Wenbin, et al.
Pubblicazione: (2025)

Dynamic Self-adaptive Multiscale Distillation from Pre-trained Multimodal Large Model for Efficient Cross-modal Representation Learning
di: Liang, Zhengyang, et al.
Pubblicazione: (2024)

Analyzing Images of Legal Documents: Toward Multi-Modal LLMs for Access to Justice
di: Westermann, Hannes, et al.
Pubblicazione: (2024)

FutureOmni: Evaluating Future Forecasting from Omni-Modal Context for Multimodal LLMs
di: Chen, Qian, et al.
Pubblicazione: (2026)

Improving Lip-synchrony in Direct Audio-Visual Speech-to-Speech Translation
di: Goncalves, Lucas, et al.
Pubblicazione: (2024)

RAVEN: Query-Guided Representation Alignment for Question Answering over Audio, Video, Embedded Sensors, and Natural Language
di: Biswas, Subrata, et al.
Pubblicazione: (2025)

LongVALE: Vision-Audio-Language-Event Benchmark Towards Time-Aware Omni-Modal Perception of Long Videos
di: Geng, Tiantian, et al.
Pubblicazione: (2024)

EVE: Efficient Vision-Language Pre-training with Masked Prediction and Modality-Aware MoE
di: Chen, Junyi, et al.
Pubblicazione: (2023)

On the Audio Hallucinations in Large Audio-Video Language Models
di: Nishimura, Taichi, et al.
Pubblicazione: (2024)

TimeLens: Rethinking Video Temporal Grounding with Multimodal LLMs
di: Zhang, Jun, et al.
Pubblicazione: (2025)

Multimodal LLMs Can Reason about Aesthetics in Zero-Shot
di: Jiang, Ruixiang, et al.
Pubblicazione: (2025)

Audio-visual Event Localization on Portrait Mode Short Videos
di: Liu, Wuyang, et al.
Pubblicazione: (2025)

AV-Dialog: Spoken Dialogue Models with Audio-Visual Input
di: Chen, Tuochao, et al.
Pubblicazione: (2025)

Wiki-LLaVA: Hierarchical Retrieval-Augmented Generation for Multimodal LLMs
di: Caffagni, Davide, et al.
Pubblicazione: (2024)

Uni-MoE: Scaling Unified Multimodal LLMs with Mixture of Experts
di: Li, Yunxin, et al.
Pubblicazione: (2024)

Distilling Neuro-Symbolic Programs into 3D Multi-modal LLMs
di: Mo, Wentao, et al.
Pubblicazione: (2026)

Mitigating Hallucinations in Multimodal LLMs via Object-aware Preference Optimization
di: Compagnoni, Alberto, et al.
Pubblicazione: (2025)

MaVEn: An Effective Multi-granularity Hybrid Visual Encoding Framework for Multimodal Large Language Model
di: Jiang, Chaoya, et al.
Pubblicazione: (2024)

LocoMotion: Learning Motion-Focused Video-Language Representations
di: Doughty, Hazel, et al.
Pubblicazione: (2024)

Lighthouse: A User-Friendly Library for Reproducible Video Moment Retrieval and Highlight Detection
di: Nishimura, Taichi, et al.
Pubblicazione: (2024)

Advancing Grounded Multimodal Named Entity Recognition via LLM-Based Reformulation and Box-Based Segmentation
di: Li, Jinyuan, et al.
Pubblicazione: (2024)

BioVL-QR: Egocentric Biochemical Vision-and-Language Dataset Using Micro QR Codes
di: Nishimoto, Tomohiro, et al.
Pubblicazione: (2024)

M$^3$Face: A Unified Multi-Modal Multilingual Framework for Human Face Generation and Editing
di: Mofayezi, Mohammadreza, et al.
Pubblicazione: (2024)

VideoCLIP-XL: Advancing Long Description Understanding for Video CLIP Models
di: Wang, Jiapeng, et al.
Pubblicazione: (2024)

See or Guess: Counterfactually Regularized Image Captioning
di: Cao, Qian, et al.
Pubblicazione: (2024)

Multi-task Prompt Words Learning for Social Media Content Generation
di: Xue, Haochen, et al.
Pubblicazione: (2024)

Knowledge Acquisition Disentanglement for Knowledge-based Visual Question Answering with Large Language Models
di: An, Wenbin, et al.
Pubblicazione: (2024)

COM Kitchens: An Unedited Overhead-view Video Dataset as a Vision-Language Benchmark
di: Maeda, Koki, et al.
Pubblicazione: (2024)

Movie101v2: Improved Movie Narration Benchmark
di: Yue, Zihao, et al.
Pubblicazione: (2024)

Prompt-A-Video: Prompt Your Video Diffusion Model via Preference-Aligned LLM
di: Ji, Yatai, et al.
Pubblicazione: (2024)

Harmfully Manipulated Images Matter in Multimodal Misinformation Detection
di: Wang, Bing, et al.
Pubblicazione: (2024)

Ask Questions with Double Hints: Visual Question Generation with Answer-awareness and Region-reference
di: Shen, Kai, et al.
Pubblicazione: (2024)

GalleryGPT: Analyzing Paintings with Large Multimodal Models
di: Bin, Yi, et al.
Pubblicazione: (2024)

Beyond Coarse-Grained Matching in Video-Text Retrieval
di: Chen, Aozhu, et al.
Pubblicazione: (2024)

EasyAnimate: High-Performance Video Generation Framework with Hybrid Windows Attention and Reward Backpropagation
di: Xu, Jiaqi, et al.
Pubblicazione: (2024)

Fit and Prune: Fast and Training-free Visual Token Pruning for Multi-modal Large Language Models
di: Ye, Weihao, et al.
Pubblicazione: (2024)

Anim-Director: A Large Multimodal Model Powered Agent for Controllable Animation Video Generation
di: Li, Yunxin, et al.
Pubblicazione: (2024)

MIPS at SemEval-2024 Task 3: Multimodal Emotion-Cause Pair Extraction in Conversations with Multimodal Language Models
di: Cheng, Zebang, et al.
Pubblicazione: (2024)

ReTaKe: Reducing Temporal and Knowledge Redundancy for Long Video Understanding
di: Wang, Xiao, et al.
Pubblicazione: (2024)