Copertina

Measuring Sound Symbolism in Audio-visual Models

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Tseng, Wei-Cheng, Shih, Yi-Jen, Harwath, David, Mooney, Raymond
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Computation and Language Computer Vision and Pattern Recognition Sound Audio and Speech Processing
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Interface Design for Self-Supervised Speech Models
di: Shih, Yi-Jen, et al.
Pubblicazione: (2024)

Multimodal Contextualized Semantic Parsing from Speech
di: Voas, Jordan, et al.
Pubblicazione: (2024)

SoundingActions: Learning How Actions Sound from Narrated Egocentric Videos
di: Chen, Changan, et al.
Pubblicazione: (2024)

AV-SUPERB: A Multi-Task Evaluation Benchmark for Audio-Visual Representation Models
di: Tseng, Yuan, et al.
Pubblicazione: (2023)

Self-supervised Speech Models for Word-Level Stuttered Speech Detection
di: Shih, Yi-Jen, et al.
Pubblicazione: (2024)

Action2Sound: Ambient-Aware Generation of Action Sounds from Egocentric Videos
di: Chen, Changan, et al.
Pubblicazione: (2024)

ThinkSound: Chain-of-Thought Reasoning in Multimodal Large Language Models for Audio Generation and Editing
di: Liu, Huadai, et al.
Pubblicazione: (2025)

Siamese Vision Transformers are Scalable Audio-visual Learners
di: Lin, Yan-Bo, et al.
Pubblicazione: (2024)

A Critical Assessment of Visual Sound Source Localization Models Including Negative Audio
di: Juanola, Xavier, et al.
Pubblicazione: (2024)

On the Audio Hallucinations in Large Audio-Video Language Models
di: Nishimura, Taichi, et al.
Pubblicazione: (2024)

Seeing Speech and Sound: Distinguishing and Locating Audios in Visual Scenes
di: Ryu, Hyeonggon, et al.
Pubblicazione: (2025)

Audio-Visual Talker Localization in Video for Spatial Sound Reproduction
di: Berghi, Davide, et al.
Pubblicazione: (2024)

SoundWeaver: Semantic Warm-Starting for Text-to-Audio Diffusion Serving
di: Barik, Ayush, et al.
Pubblicazione: (2026)

Bridging Ears and Eyes: Analyzing Audio and Visual Large Language Models to Humans in Visible Sound Recognition and Reducing Their Sensory Gap via Cross-Modal Distillation
di: Jiang, Xilin, et al.
Pubblicazione: (2025)

Talker-T2AV: Joint Talking Audio-Video Generation with Autoregressive Diffusion Modeling
di: Ye, Zhen, et al.
Pubblicazione: (2026)

ExpGest: Expressive Speaker Generation Using Diffusion Model and Hybrid Audio-Text Guidance
di: Cheng, Yongkang, et al.
Pubblicazione: (2024)

Seeing Sound: Assembling Sounds from Visuals for Audio-to-Image Generation
di: Petermann, Darius, et al.
Pubblicazione: (2025)

DeepSound-V1: Start to Think Step-by-Step in the Audio Generation from Videos
di: Liang, Yunming, et al.
Pubblicazione: (2025)

Gotta Hear Them All: Towards Sound Source Aware Audio Generation
di: Guo, Wei, et al.
Pubblicazione: (2024)

Statistics-aware Audio-visual Deepfake Detector
di: Astrid, Marcella, et al.
Pubblicazione: (2024)

Aligning Sight and Sound: Advanced Sound Source Localization Through Audio-Visual Alignment
di: Senocak, Arda, et al.
Pubblicazione: (2024)

Contrastive Conditional Latent Diffusion for Audio-visual Segmentation
di: Mao, Yuxin, et al.
Pubblicazione: (2023)

Seeing is Believing: Emotion-Aware Audio-Visual Language Modeling for Expressive Speech Generation
di: Tan, Weiting, et al.
Pubblicazione: (2025)

Taming Data and Transformers for Audio Generation
di: Haji-Ali, Moayed, et al.
Pubblicazione: (2024)

Learning Self-Supervised Audio-Visual Representations for Sound Recommendations
di: Krishnamurthy, Sudha
Pubblicazione: (2024)

Dual Audio-Centric Modality Coupling for Talking Head Generation
di: Fu, Ao, et al.
Pubblicazione: (2025)

Both Ears Wide Open: Towards Language-Driven Spatial Audio Generation
di: Sun, Peiwen, et al.
Pubblicazione: (2024)

OmniAudio: Generating Spatial Audio from 360-Degree Video
di: Liu, Huadai, et al.
Pubblicazione: (2025)

Multiple Consistency-guided Test-Time Adaptation for Contrastive Audio-Language Models with Unlabeled Audio
di: Chen, Gongyu, et al.
Pubblicazione: (2024)

SpeechCLIP+: Self-supervised multi-task representation learning for speech via CLIP and speech-image data
di: Wang, Hsuan-Fu, et al.
Pubblicazione: (2024)

Bootstrapping Audio-Visual Segmentation by Strengthening Audio Cues
di: Chen, Tianxiang, et al.
Pubblicazione: (2024)

Improving Lip-synchrony in Direct Audio-Visual Speech-to-Speech Translation
di: Goncalves, Lucas, et al.
Pubblicazione: (2024)

ParaSpeechCLAP: A Dual-Encoder Speech-Text Model for Rich Stylistic Language-Audio Pretraining
di: Diwan, Anuj, et al.
Pubblicazione: (2026)

CCStereo: Audio-Visual Contextual and Contrastive Learning for Binaural Audio Generation
di: Chen, Yuanhong, et al.
Pubblicazione: (2025)

Dynamic Derivation and Elimination: Audio Visual Segmentation with Enhanced Audio Semantics
di: Liu, Chen, et al.
Pubblicazione: (2025)

Synchronized Video-to-Audio Generation via Mel Quantization-Continuum Decomposition
di: Wang, Juncheng, et al.
Pubblicazione: (2025)

DDAVS: Disentangled Audio Semantics and Delayed Bidirectional Alignment for Audio-Visual Segmentation
di: Tian, Jingqi, et al.
Pubblicazione: (2025)

Probing the Robustness Properties of Neural Speech Codecs
di: Tseng, Wei-Cheng, et al.
Pubblicazione: (2025)

CoGenAV: Versatile Audio-Visual Representation Learning via Contrastive-Generative Synchronization
di: Bai, Detao, et al.
Pubblicazione: (2025)

SSAVSV: Towards Unified Model for Self-Supervised Audio-Visual Speaker Verification
di: Rajasekhar, Gnana Praveen, et al.
Pubblicazione: (2025)