Image de couverture de livre

Seeing Sound, Hearing Sight: Uncovering Modality Bias and Conflict of AI models in Sound Localization

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Jia, Yanhao, Xie, Ji, Jivaganesh, S, Li, Hao, Wu, Xu, Zhang, Mengmi
Format:	Preprint
Publié:	2025
Sujets:	Sound Artificial Intelligence Computer Vision and Pattern Recognition Multimedia Audio and Speech Processing
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

From Sound to Sight: Towards AI-authored Music Videos
par: Vitasovic, Leo, et autres
Publié: (2025)

SonicVisionLM: Playing Sound with Vision Language Models
par: Xie, Zhifeng, et autres
Publié: (2024)

Aligning Sight and Sound: Advanced Sound Source Localization Through Audio-Visual Alignment
par: Senocak, Arda, et autres
Publié: (2024)

Sound-VECaps: Improving Audio Generation with Visual Enhanced Captions
par: Yuan, Yi, et autres
Publié: (2024)

Learning What To Hear: Boosting Sound-Source Association For Robust Audiovisual Instance Segmentation
par: Seo, Jinbae, et autres
Publié: (2025)

Hearing from Silence: Reasoning Audio Descriptions from Silent Videos via Vision-Language Model
par: Ren, Yong, et autres
Publié: (2025)

Cross-Modal Watermarking for Authentic Audio Recovery and Tamper Localization in Synthesized Audiovisual Forgeries
par: Kim, Minyoung, et autres
Publié: (2025)

A Unified Framework for Modality-Agnostic Deepfakes Detection
par: Yu, Cai, et autres
Publié: (2023)

Can Sound Replace Vision in LLaVA With Token Substitution?
par: Vosoughi, Ali, et autres
Publié: (2025)

Speech-to-See: End-to-End Speech-Driven Open-Set Object Detection
par: Lu, Wenhuan, et autres
Publié: (2025)

Gotta Hear Them All: Towards Sound Source Aware Audio Generation
par: Guo, Wei, et autres
Publié: (2024)

A Survey on Cross-Modal Interaction Between Music and Multimodal Data
par: Li, Sifei, et autres
Publié: (2025)

OmniSep: Unified Omni-Modality Sound Separation with Query-Mixup
par: Cheng, Xize, et autres
Publié: (2024)

SoundMind: RL-Incentivized Logic Reasoning for Audio-Language Models
par: Diao, Xingjian, et autres
Publié: (2025)

Microphone Conversion: Mitigating Device Variability in Sound Event Classification
par: Ryu, Myeonghoon, et autres
Publié: (2024)

Representation Learning for Semantic Alignment of Language, Audio, and Visual Modalities
par: Sudarsanam, Parthasaarathy, et autres
Publié: (2025)

Voice Evaluation of Reasoning Ability: Diagnosing the Modality-Induced Performance Gap
par: Lin, Yueqian, et autres
Publié: (2025)

Leveraging Pre-trained AudioLDM for Sound Generation: A Benchmark Study
par: Yuan, Yi, et autres
Publié: (2023)

Robust Wake Word Spotting With Frame-Level Cross-Modal Attention Based Audio-Visual Conformer
par: Wang, Haoxu, et autres
Publié: (2024)

SemantiCodec: An Ultra Low Bitrate Semantic Audio Codec for General Sound
par: Liu, Haohe, et autres
Publié: (2024)

Robust LLM-based Audio-Visual Speech Recognition with Sparse Modality Alignment and Visual Unit-Guided Refinement
par: Su, Fei, et autres
Publié: (2026)

Stimulus Modality Matters: Impact of Perceptual Evaluations from Different Modalities on Speech Emotion Recognition System Performance
par: Chou, Huang-Cheng, et autres
Publié: (2024)

Video-Guided Text-to-Music Generation Using Public Domain Movie Collections
par: Kim, Haven, et autres
Publié: (2025)

Teaching Physical Awareness to LLMs through Sounds
par: Wang, Weiguo, et autres
Publié: (2025)

YingSound: Video-Guided Sound Effects Generation with Multi-modal Chain-of-Thought Controls
par: Chen, Zihao, et autres
Publié: (2024)

Revisit Modality Imbalance at the Decision Layer
par: Ma, Xiaoyu, et autres
Publié: (2025)

SoundLoc3D: Invisible 3D Sound Source Localization and Classification Using a Multimodal RGB-D Acoustic Camera
par: He, Yuhang, et autres
Publié: (2024)

Intelligent Text-Conditioned Music Generation
par: Xie, Zhouyao, et autres
Publié: (2024)

A Simple but Strong Baseline for Sounding Video Generation: Effective Adaptation of Audio and Video Diffusion Models for Joint Generation
par: Ishii, Masato, et autres
Publié: (2024)

SoundingActions: Learning How Actions Sound from Narrated Egocentric Videos
par: Chen, Changan, et autres
Publié: (2024)

Trusted Fake Audio Detection Based on Dirichlet Distribution
par: Ding, Chi, et autres
Publié: (2025)

Exploring compressibility of transformer based text-to-music (TTM) models
par: Moschopoulos, Vasileios, et autres
Publié: (2024)

Seeing and Hearing: Open-domain Visual-Audio Generation with Diffusion Latent Aligners
par: Xing, Yazhou, et autres
Publié: (2024)

SemiPL: A Semi-supervised Method for Event Sound Source Localization
par: Li, Yue, et autres
Publié: (2024)

Enhancing Expressiveness in Dance Generation via Integrating Frequency and Music Style Information
par: Huang, Qiaochu, et autres
Publié: (2024)

Audio-Language Models for Audio-Centric Tasks: A Systematic Survey
par: Su, Yi, et autres
Publié: (2025)

Sonic4D: Spatial Audio Generation for Immersive 4D Scene Exploration
par: Xie, Siyi, et autres
Publié: (2025)

Audio-Visual Speaker Tracking: Progress, Challenges, and Future Directions
par: Zhao, Jinzheng, et autres
Publié: (2023)

Sound2Vision: Generating Diverse Visuals from Audio through Cross-Modal Latent Alignment
par: Sung-Bin, Kim, et autres
Publié: (2024)

Building Audio-Visual Digital Twins with Smartphones
par: Lan, Zitong, et autres
Publié: (2025)