Cover Image

See, Hear, and Understand: Benchmarking Audiovisual Human Speech Understanding in Multimodal Large Language Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Nguyen, Le Thien Phuc, Yu, Zhuoran, Hang, Samuel Low Yu, An, Subin, Lee, Jeongik, Ban, Yohan, Chung, SeungEun, Nguyen, Thanh-Huy, Maeng, JuWan, Lee, Soochahn, Lee, Yong Jae
Format:	Preprint
Published:	2025
Subjects:	Computer Vision and Pattern Recognition Artificial Intelligence Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

LASER: Lip Landmark Assisted Speaker Detection for Robustness
by: Nguyen, Le Thien Phuc, et al.
Published: (2025)

CoAPT: Context Attribute words for Prompt Tuning
by: Lee, Gun, et al.
Published: (2024)

UniTalk: Towards Universal Active Speaker Detection in Real World Scenarios
by: Nguyen, Le Thien Phuc, et al.
Published: (2025)

Seeing Through the Tool: A Controlled Benchmark for Occlusion Robustness in Foundation Segmentation Models
by: Ho, Nhan, et al.
Published: (2026)

See, Rank, and Filter: Important Word-Aware Clip Filtering via Scene Understanding for Moment Retrieval and Highlight Detection
by: Lee, YuEun, et al.
Published: (2025)

Semiclassical truncated-Wigner-approximation theory of molecular-vibration-polariton dynamics in optical cavities
by: Phuc, Nguyen Thanh
Published: (2023)

Semiclassical Truncated-Wigner-Approximation Theory of Molecular Exciton-Polariton Dynamics in Optical Cavities
by: Phuc, Nguyen Thanh
Published: (2024)

MatRes: Zero-Shot Test-Time Model Adaptation for Simultaneous Matching and Restoration
by: Lee, Kanggeon, et al.
Published: (2026)

Auto-regressive transformation for image alignment
by: Lee, Kanggeon, et al.
Published: (2025)

Particle Diffusion Matching: Random Walk Correspondence Search for the Alignment of Standard and Ultra-Widefield Fundus Images
by: Lee, Kanggeon, et al.
Published: (2026)

How Multimodal LLMs Solve Image Tasks: A Lens on Visual Grounding, Task Reasoning, and Answer Decoding
by: Yu, Zhuoran, et al.
Published: (2025)

GMAT: Grounded Multi-Agent Clinical Description Generation for Text Encoder in Vision-Language MIL for Whole Slide Image Classification
by: Quang, Ngoc Bui Lam, et al.
Published: (2025)

Lean and Mean Adaptive Optimization via Subset-Norm and Subspace-Momentum with Convergence Guarantees
by: Nguyen, Thien Hang, et al.
Published: (2024)

Emotic Masked Autoencoder with Attention Fusion for Facial Expression Recognition
by: Nguyen-Xuan, Bach, et al.
Published: (2024)

Video Understanding: Through A Temporal Lens
by: Nguyen, Thong Thanh
Published: (2026)

Understanding Digital Gifting Through Messengers Across Cultures: A Comparative Study of University Students in South Korea, China, and Japan
by: Lee, YeEun, et al.
Published: (2025)

IGL-DT: Iterative Global-Local Feature Learning with Dual-Teacher Semantic Segmentation Framework under Limited Annotation Scheme
by: Tran, Dinh Dai Quan, et al.
Published: (2025)

Distinct signatures of cutaneous microbiome associated with disease severity in Hailey–Hailey disease
by: Jae Yeon Kim, et al.
Published: (2024)

Adaptive Collaboration of Arena-Based Argumentative LLMs for Explainable and Contestable Legal Reasoning
by: Cao, Hoang-Loc, et al.
Published: (2026)

Active Diffusion Matching: Score-based Iterative Alignment of Cross-Modal Retinal Images
by: Lee, Kanggeon, et al.
Published: (2026)

Contamination Detection for VLMs using Multi-Modal Semantic Perturbation
by: Park, Jaden, et al.
Published: (2025)

VisionGuard: Synergistic Framework for Helmet Violation Detection
by: Nguyen, Lam-Huy, et al.
Published: (2025)

ReCap: Event-Aware Image Captioning with Article Retrieval and Semantic Gaussian Normalization
by: Nguyen, Thinh-Phuc, et al.
Published: (2025)

Psychometric Item Validation Using Virtual Respondents with Trait-Response Mediators
by: Lim, Sungjib, et al.
Published: (2025)

Rx Strategist: Prescription Verification using LLM Agents System
by: Van, Phuc Phan, et al.
Published: (2024)

Reasoning-Augmented Representations for Multimodal Retrieval
by: Zhang, Jianrui, et al.
Published: (2026)

Efficient integration of perceptual variational autoencoder into dynamic latent scale generative adversarial network
by: Jeongik Cho, et al.
Published: (2024)

Cobalt Binary Compounds for Advanced Interconnect Materials
by: Maeng, Gyungho, et al.
Published: (2026)

PhoWhisper: Automatic Speech Recognition for Vietnamese
by: Le, Thanh-Thien, et al.
Published: (2024)

Weight-Shifting Operators of Hypergeometric Type for Maass Forms
by: Lee, Seung Ju
Published: (2025)

Moral Distress, Burnout, Turnover Intention, and Coping Strategies among Korean Nurses during the Late Stage of the COVID-19 Pandemic: A Mixed-Method Study
by: Jae Jun Lee, et al.
Published: (2024)

Bridging Audio and Vision: Zero-Shot Audiovisual Segmentation by Connecting Pretrained Models
by: Lee, Seung-jae, et al.
Published: (2025)

Balancing Exploration and Exploitation in LLM using Soft RLLF for Enhanced Negation Understanding
by: Nguyen, Ha-Thanh, et al.
Published: (2024)

Synthesis of materials from agricultural wastes combined with Fe3O4for methylene blue adsorption and application to treat organic pollutants in water samples
by: Hoang Anh Thi, et al.
Published: (2024)

Understanding User Perception and Intention to Use Smart Homes for Energy Efficiency: A Survey
by: Zharova, Alona, et al.
Published: (2022)

AuditoryBench++: Can Language Models Understand Auditory Knowledge without Hearing?
by: Ok, Hyunjong, et al.
Published: (2025)

Valorizing renewable biomass into potential prebiotic oligosaccharides: Enzymatic, microbial, and synthetic biology strategies.
by: Yun, Yu Rim, et al.
Published: (2026)

Learning What To Hear: Boosting Sound-Source Association For Robust Audiovisual Instance Segmentation
by: Seo, Jinbae, et al.
Published: (2025)

ViKey: Enhancing Temporal Understanding in Videos via Visual Prompting
by: Lee, Yeonkyung, et al.
Published: (2026)

Adaptive Prompting for Continual Relation Extraction: A Within-Task Variance Perspective
by: Le, Minh, et al.
Published: (2024)