Image de couverture de livre

Teaching Physical Awareness to LLMs through Sounds

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Wang, Weiguo, Nie, Andy, Zhou, Wenrui, Kai, Yi, Hu, Chengchen
Format:	Preprint
Publié:	2025
Sujets:	Sound Artificial Intelligence Multimedia Robotics Audio and Speech Processing
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

SHMamba: Structured Hyperbolic State Space Model for Audio-Visual Question Answering
par: Yang, Zhe, et autres
Publié: (2024)

Leveraging Pre-trained AudioLDM for Sound Generation: A Benchmark Study
par: Yuan, Yi, et autres
Publié: (2023)

From Sound to Sight: Towards AI-authored Music Videos
par: Vitasovic, Leo, et autres
Publié: (2025)

Learning What To Hear: Boosting Sound-Source Association For Robust Audiovisual Instance Segmentation
par: Seo, Jinbae, et autres
Publié: (2025)

Robust Audio Anti-Spoofing with Fusion-Reconstruction Learning on Multi-Order Spectrograms
par: Wen, Penghui, et autres
Publié: (2023)

GACA-DiT: Diffusion-based Dance-to-Music Generation with Genre-Adaptive Rhythm and Context-Aware Alignment
par: Wang, Jinting, et autres
Publié: (2025)

SemantiCodec: An Ultra Low Bitrate Semantic Audio Codec for General Sound
par: Liu, Haohe, et autres
Publié: (2024)

Emotion-Aware Speech Generation with Character-Specific Voices for Comics
par: Qian, Zhiwen, et autres
Publié: (2025)

Deciphering GunType Hierarchy through Acoustic Analysis of Gunshot Recordings
par: Shah, Ankit, et autres
Publié: (2025)

Retrieval-Augmented Text-to-Audio Generation
par: Yuan, Yi, et autres
Publié: (2023)

Separate Anything You Describe
par: Liu, Xubo, et autres
Publié: (2023)

StyleSpeech: Parameter-efficient Fine Tuning for Pre-trained Controllable Text-to-Speech
par: Lou, Haowei, et autres
Publié: (2024)

SonicSense: Object Perception from In-Hand Acoustic Vibration
par: Liu, Jiaxun, et autres
Publié: (2024)

AudioRole: An Audio Dataset for Character Role-Playing in Large Language Models
par: Li, Wenyu, et autres
Publié: (2025)

Zero-Effort Image-to-Music Generation: An Interpretable RAG-based VLM Approach
par: Zhao, Zijian, et autres
Publié: (2025)

DOA-Aware Audio-Visual Self-Supervised Learning for Sound Event Localization and Detection
par: Fujita, Yoto, et autres
Publié: (2024)

DreamHead: Learning Spatial-Temporal Correspondence via Hierarchical Diffusion for Audio-driven Talking Head Synthesis
par: Hong, Fa-Ting, et autres
Publié: (2024)

Structured Multi-Track Accompaniment Arrangement via Style Prior Modelling
par: Zhao, Jingwei, et autres
Publié: (2023)

MSAC: Multiple Speech Attribute Control Method for Reliable Speech Emotion Recognition
par: Pan, Yu, et autres
Publié: (2023)

YuE: Scaling Open Foundation Models for Long-Form Music Generation
par: Yuan, Ruibin, et autres
Publié: (2025)

GVMGen: A General Video-to-Music Generation Model with Hierarchical Attentions
par: Zuo, Heda, et autres
Publié: (2025)

Disentangling Score Content and Performance Style for Joint Piano Rendering and Transcription
par: Zeng, Wei, et autres
Publié: (2025)

Index-MSR: A high-efficiency multimodal fusion framework for speech recognition
par: Chen, Jinming, et autres
Publié: (2025)

LPIPS-AttnWav2Lip: Generic Audio-Driven lip synchronization for Talking Head Generation in the Wild
par: Chen, Zhipeng, et autres
Publié: (2026)

Towards Generating Diverse Audio Captions via Adversarial Training
par: Mei, Xinhao, et autres
Publié: (2022)

ONOTE: Benchmarking Omnimodal Notation Processing for Expert-level Music Intelligence
par: Ma, Menghe, et autres
Publié: (2026)

Sound-VECaps: Improving Audio Generation with Visual Enhanced Captions
par: Yuan, Yi, et autres
Publié: (2024)

On the Design of Diffusion-based Neural Speech Codecs
par: Foti, Pietro, et autres
Publié: (2025)

CoComposer: LLM Multi-agent Collaborative Music Composition
par: Xing, Peiwen, et autres
Publié: (2025)

Controllable Video-to-Music Generation with Multiple Time-Varying Conditions
par: Wu, Junxian, et autres
Publié: (2025)

Embedding Alignment in Code Generation for Audio
par: Kouteili, Sam, et autres
Publié: (2025)

FreeAudio: Training-Free Timing Planning for Controllable Long-Form Text-to-Audio Generation
par: Jiang, Yuxuan, et autres
Publié: (2025)

Prompt-aware classifier free guidance for diffusion models
par: Zhang, Xuanhao, et autres
Publié: (2025)

Listening and Seeing Again: Generative Error Correction for Audio-Visual Speech Recognition
par: Liu, Rui, et autres
Publié: (2025)

Exploring Classical Piano Performance Generation with Expressive Music Variational AutoEncoder
par: Luo, Jing, et autres
Publié: (2025)

Model-Guided Dual-Role Alignment for High-Fidelity Open-Domain Video-to-Audio Generation
par: Zhang, Kang, et autres
Publié: (2025)

Sync-TVA: A Graph-Attention Framework for Multimodal Emotion Recognition with Cross-Modal Fusion
par: Deng, Zeyu, et autres
Publié: (2025)

MMVA: Multimodal Matching Based on Valence and Arousal across Images, Music, and Musical Captions
par: Choi, Suhwan, et autres
Publié: (2025)

DeepFake Doctor: Diagnosing and Treating Audio-Video Fake Detection
par: Klemt, Marcel, et autres
Publié: (2025)

LAVCap: LLM-based Audio-Visual Captioning using Optimal Transport
par: Rho, Kyeongha, et autres
Publié: (2025)