Learning to Hear by Seeing: It's Time for Vision Language Models to Understand Artistic Emotion from Sight and Sound
Fuente:
arXiv
Guardado en:
| Autores principales: | Zhang, Dengming, You, Weitao, Li, Jingxiong, Lin, Weishen, Shi, Wenda, Zhao, Xue, Zuo, Heda, Wu, Junxian, Sun, Lingyun |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
Ejemplares similares
Controllable Video-to-Music Generation with Multiple Time-Varying Conditions
por: Wu, Junxian, et al.
Publicado: (2025)
por: Wu, Junxian, et al.
Publicado: (2025)
Personalized Dynamic Music Emotion Recognition with Dual-Scale Attention-Based Meta-Learning
por: Zhang, Dengming, et al.
Publicado: (2024)
por: Zhang, Dengming, et al.
Publicado: (2024)
GVMGen: A General Video-to-Music Generation Model with Hierarchical Attentions
por: Zuo, Heda, et al.
Publicado: (2025)
por: Zuo, Heda, et al.
Publicado: (2025)
Seeing Sound, Hearing Sight: Uncovering Modality Bias and Conflict of AI models in Sound Localization
por: Jia, Yanhao, et al.
Publicado: (2025)
por: Jia, Yanhao, et al.
Publicado: (2025)
FonTS: Text Rendering with Typography and Style Controls
por: Shi, Wenda, et al.
Publicado: (2024)
por: Shi, Wenda, et al.
Publicado: (2024)
With Ears to See and Eyes to Hear: Sound Symbolism Experiments with Multimodal Large Language Models
por: Loakman, Tyler, et al.
Publicado: (2024)
por: Loakman, Tyler, et al.
Publicado: (2024)
Seeing isn't Hearing: Benchmarking Vision Language Models at Interpreting Spectrograms
por: Loakman, Tyler, et al.
Publicado: (2025)
por: Loakman, Tyler, et al.
Publicado: (2025)
EMOVA: Empowering Language Models to See, Hear and Speak with Vivid Emotions
por: Chen, Kai, et al.
Publicado: (2024)
por: Chen, Kai, et al.
Publicado: (2024)
WordCon: Word-level Typography Control in Scene Text Rendering
por: Shi, Wenda, et al.
Publicado: (2025)
por: Shi, Wenda, et al.
Publicado: (2025)
AnySurf: Any Surface Generation with Directed Edge
por: Shi, Wenda, et al.
Publicado: (2026)
por: Shi, Wenda, et al.
Publicado: (2026)
Seeing Eye to Eye: Enabling Cognitive Alignment Through Shared First-Person Perspective in Human-AI Collaboration
por: Teng, Zhuyu, et al.
Publicado: (2026)
por: Teng, Zhuyu, et al.
Publicado: (2026)
Efficient and Scalable Chinese Vector Font Generation via Component Composition
por: Song, Jinyu, et al.
Publicado: (2024)
por: Song, Jinyu, et al.
Publicado: (2024)
See, Hear, and Understand: Benchmarking Audiovisual Human Speech Understanding in Multimodal Large Language Models
por: Nguyen, Le Thien Phuc, et al.
Publicado: (2025)
por: Nguyen, Le Thien Phuc, et al.
Publicado: (2025)
Does AI See like Art Historians? Interpreting How Vision Language Models Recognize Artistic Style
por: Limpijankit, Marvin, et al.
Publicado: (2026)
por: Limpijankit, Marvin, et al.
Publicado: (2026)
EmoArt: A Multidimensional Dataset for Emotion-Aware Artistic Generation
por: Zhang, Cheng, et al.
Publicado: (2025)
por: Zhang, Cheng, et al.
Publicado: (2025)
The Audio-Visual BatVision Dataset for Research on Sight and Sound
por: Brunetto, Amandine, et al.
Publicado: (2023)
por: Brunetto, Amandine, et al.
Publicado: (2023)
Green Energy and State Power: The Case of Zhanatas Wind Power Project in Kazakhstan
por: Weishen Zeng
Publicado: (2025)
por: Weishen Zeng
Publicado: (2025)
It Hears, It Sees too: Multi-Modal LLM for Depression Detection By Integrating Visual Understanding into Audio Language Models
por: Zhao, Xiangyu, et al.
Publicado: (2025)
por: Zhao, Xiangyu, et al.
Publicado: (2025)
Hearing and Seeing Through CLIP: A Framework for Self-Supervised Sound Source Localization
por: Park, Sooyoung, et al.
Publicado: (2025)
por: Park, Sooyoung, et al.
Publicado: (2025)
Multilevel constructions of constant dimension codes based on one-factorization of complete graphs
por: Xu, Dengming, et al.
Publicado: (2025)
por: Xu, Dengming, et al.
Publicado: (2025)
SightSound-R1: Cross-Modal Reasoning Distillation from Vision to Audio Language Models
por: Wang, Qiaolin, et al.
Publicado: (2025)
por: Wang, Qiaolin, et al.
Publicado: (2025)
Bad Seeing or Bad Thinking? Rewarding Perception for Vision-Language Reasoning
por: Wang, Haozhe, et al.
Publicado: (2026)
por: Wang, Haozhe, et al.
Publicado: (2026)
Hear Me, See Me, Understand Me: Audio-Visual Autism Behavior Recognition
por: Deng, Shijian, et al.
Publicado: (2024)
por: Deng, Shijian, et al.
Publicado: (2024)
Jigsaw-Puzzles: From Seeing to Understanding to Reasoning in Vision-Language Models
por: Lyu, Zesen, et al.
Publicado: (2025)
por: Lyu, Zesen, et al.
Publicado: (2025)
Large Language Models Implicitly Learn to See and Hear Just By Reading
por: Verma, Prateek, et al.
Publicado: (2025)
por: Verma, Prateek, et al.
Publicado: (2025)
Do Audio-Visual Large Language Models Really See and Hear?
por: Selvakumar, Ramaneswaran, et al.
Publicado: (2026)
por: Selvakumar, Ramaneswaran, et al.
Publicado: (2026)
Viscometric investigations and molecular interactions of some derivatives of 5-substituted indole dihydropyrimidines in mixed organic solvents
por: L. C. Heda
Publicado: (2010)
por: L. C. Heda
Publicado: (2010)
HanMoVLM: Large Vision-Language Models for Professional Artistic Painting Evaluation
por: Yang, Hongji, et al.
Publicado: (2026)
por: Yang, Hongji, et al.
Publicado: (2026)
Vision Language Models See What You Want but not What You See
por: Gao, Qingying, et al.
Publicado: (2024)
por: Gao, Qingying, et al.
Publicado: (2024)
See What I Mean: Aligning Vision and Language Representations for Video Fine-grained Object Understanding
por: Sun, Boyuan, et al.
Publicado: (2026)
por: Sun, Boyuan, et al.
Publicado: (2026)
ArtGPT-4: Towards Artistic-understanding Large Vision-Language Models with Enhanced Adapter
por: Yuan, Zhengqing, et al.
Publicado: (2023)
por: Yuan, Zhengqing, et al.
Publicado: (2023)
See Me, Hear Me: Skype in the Classroom
por: Foote, Carolyn
Publicado: (2008)
por: Foote, Carolyn
Publicado: (2008)
v-HUB: A Benchmark for Video Humor Understanding from Vision and Sound
por: Shi, Zhengpeng, et al.
Publicado: (2025)
por: Shi, Zhengpeng, et al.
Publicado: (2025)
Spray Coating of Thick Perovskite Films for Photodetectors: The Aerosol–Liquid–Solid Mechanisms and Sensing Applications
por: Wei Qian, et al.
Publicado: (2026)
por: Wei Qian, et al.
Publicado: (2026)
BlindSight: Harnessing Sparsity for Efficient Vision-Language Models
por: Srikrishnan, Tharun Adithya, et al.
Publicado: (2025)
por: Srikrishnan, Tharun Adithya, et al.
Publicado: (2025)
InsightSee: Advancing Multi-agent Vision-Language Models for Enhanced Visual Understanding
por: Zhang, Huaxiang, et al.
Publicado: (2024)
por: Zhang, Huaxiang, et al.
Publicado: (2024)
Meta-aware Learning in text-to-SQL Large Language Model
por: Zhang, Wenda
Publicado: (2025)
por: Zhang, Wenda
Publicado: (2025)
UniHetero: Could Generation Enhance Understanding for Vision-Language-Model at Large Data Scale?
por: Chen, Fengjiao, et al.
Publicado: (2025)
por: Chen, Fengjiao, et al.
Publicado: (2025)
EgoSound: Benchmarking Sound Understanding in Egocentric Videos
por: Zhu, Bingwen, et al.
Publicado: (2026)
por: Zhu, Bingwen, et al.
Publicado: (2026)
Think-as-You-See: Streaming Chain-of-Thought Reasoning for Large Vision-Language Models
por: Zhang, Jialiang, et al.
Publicado: (2026)
por: Zhang, Jialiang, et al.
Publicado: (2026)
Ejemplares similares
-
Controllable Video-to-Music Generation with Multiple Time-Varying Conditions
por: Wu, Junxian, et al.
Publicado: (2025) -
Personalized Dynamic Music Emotion Recognition with Dual-Scale Attention-Based Meta-Learning
por: Zhang, Dengming, et al.
Publicado: (2024) -
GVMGen: A General Video-to-Music Generation Model with Hierarchical Attentions
por: Zuo, Heda, et al.
Publicado: (2025) -
Seeing Sound, Hearing Sight: Uncovering Modality Bias and Conflict of AI models in Sound Localization
por: Jia, Yanhao, et al.
Publicado: (2025) -
FonTS: Text Rendering with Typography and Style Controls
por: Shi, Wenda, et al.
Publicado: (2024)