Cover Image

Pioneering Multimodal Emotion Recognition in the Era of Large Models: From Closed Sets to Open Vocabularies

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Han, Jing, Gao, Zhiqiang, Gao, Shihao, Liu, Jialing, Chen, Hongyu, Zhang, Zixing, Schuller, Björn W.
Format:	Preprint
Published:	2025
Subjects:	Human-Computer Interaction
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

MER 2024: Semi-Supervised Learning, Noise Robustness, and Open-Vocabulary Multimodal Emotion Recognition
by: Lian, Zheng, et al.
Published: (2024)

OV-MER: Towards Open-Vocabulary Multimodal Emotion Recognition
by: Lian, Zheng, et al.
Published: (2024)

AffectGPT-R1: Leveraging Reinforcement Learning for Open-Vocabulary Multimodal Emotion Recognition
by: Lian, Zheng, et al.
Published: (2025)

Large Language Models for Depression Recognition in Spoken Language Integrating Psychological Knowledge
by: Li, Yupei, et al.
Published: (2025)

STAA-Net: A Sparse and Transferable Adversarial Attack for Speech Emotion Recognition
by: Chang, Yi, et al.
Published: (2024)

MER 2026: From Discriminative Emotion Recognition to Generative Emotion Understanding
by: Lian, Zheng, et al.
Published: (2026)

Artificial Emotion: A Survey of Theories and Debates on Realising Emotion in Artificial Intelligence
by: Li, Yupei, et al.
Published: (2025)

AffectGPT-RL: Revealing Roles of Reinforcement Learning in Open-Vocabulary Emotion Recognition
by: Lian, Zheng, et al.
Published: (2026)

Follow the Clues, Frame the Truth: Hybrid-evidential Deductive Reasoning in Open-Vocabulary Multimodal Emotion Recognition
by: Liu, Yu, et al.
Published: (2026)

Knowledge-based Emotion Recognition using Large Language Models
by: Han, Bin, et al.
Published: (2024)

Explainable Multimodal Emotion Recognition
by: Lian, Zheng, et al.
Published: (2023)

Hierarchical MoE: Continuous Multimodal Emotion Recognition with Incomplete and Asynchronous Inputs
by: Zhu, Yitong, et al.
Published: (2025)

AffectGPT: Dataset and Framework for Explainable Multimodal Emotion Recognition
by: Lian, Zheng, et al.
Published: (2024)

MERBench: A Unified Evaluation Benchmark for Multimodal Emotion Recognition
by: Lian, Zheng, et al.
Published: (2024)

Volume-Based Space-Time Cube for Large-Scale Continuous Spatial Time Series
by: Deng, Zikun, et al.
Published: (2025)

Reading Smiles: Proxy Bias in Foundation Models for Facial Emotion Recognition
by: Tsangko, Iosif, et al.
Published: (2025)

ArtMentor: AI-Assisted Evaluation of Artworks to Explore Multimodal Large Language Models Capabilities
by: Zheng, Chanjin, et al.
Published: (2025)

Emolysis: A Multimodal Open-Source Group Emotion Analysis and Visualization Toolkit
by: Ghosh, Shreya, et al.
Published: (2023)

M4SER: Multimodal, Multirepresentation, Multitask, and Multistrategy Learning for Speech Emotion Recognition
by: He, Jiajun, et al.
Published: (2025)

FIRMED: A Peak-Centered Multimodal Dataset with Fine-Grained Annotation for Emotion Recognition
by: Tang, Hao, et al.
Published: (2025)

OpenWatch: A Multimodal Benchmark for Hand Gesture Recognition on Smartwatches
by: Bonazzi, Pietro, et al.
Published: (2026)

IntentVLM: Open-Vocabulary Intention Recognition through Forward-Inverse Modeling with Video-Language Models
by: Rahimi, Hamed, et al.
Published: (2026)

AffectGPT: A New Dataset, Model, and Benchmark for Emotion Understanding with Multimodal Large Language Models
by: Lian, Zheng, et al.
Published: (2025)

A New Era in Human Factors Engineering: A Survey of the Applications and Prospects of Large Multimodal Models
by: Fan, Li, et al.
Published: (2024)

MuMTAffect: A Multimodal Multitask Affective Framework for Personality and Emotion Recognition from Physiological Signals
by: Seikavandi, Meisam Jamshidi, et al.
Published: (2025)

MI 2 MI: Training Dyad with Collaborative Brain-Computer Interface and Cooperative Motor Imagery Tasks for Better BCI Performance
by: Cheng, Shiwei, et al.
Published: (2024)

An Introduction to Silent Paralinguistics
by: Ren, Zhao, et al.
Published: (2025)

Multimodal Functional Maximum Correlation for Emotion Recognition
by: Zheng, Deyang, et al.
Published: (2025)

EmotionCarrier: A Multimodality 'Mindfulness-Training' Tool for Positive Emotional Value
by: Wang, Yi
Published: (2025)

MER 2025: When Affective Computing Meets Large Language Models
by: Lian, Zheng, et al.
Published: (2025)

Improving Inclusivity for Emotion Recognition Based on Face Tracking
by: Ellenberg, Mats Ole, et al.
Published: (2025)

Enhancing EEG Signal-Based Emotion Recognition with Synthetic Data: Diffusion Model Approach
by: Siddhad, Gourav, et al.
Published: (2024)

BiMoE: Brain-Inspired Experts for EEG-Dominant Affective State Recognition
by: Zhu, Hongyu, et al.
Published: (2026)

FEEL: Quantifying Heterogeneity in Physiological Signals for Generalizable Emotion Recognition
by: Singh, Pragya, et al.
Published: (2026)

Understanding Emotional Body Expressions via Large Language Models
by: Lu, Haifeng, et al.
Published: (2024)

Enhancing Cross-Dataset EEG Emotion Recognition: A Novel Approach with Emotional EEG Style Transfer Network
by: Zhou, Yijin, et al.
Published: (2024)

A Causality-aware Paradigm for Evaluating Creativity of Multimodal Large Language Models
by: Huang, Zhongzhan, et al.
Published: (2025)

Linking Facial Recognition of Emotions and Socially Shared Regulation in Medical Simulation
by: Huang, Xiaoshan, et al.
Published: (2025)

Hypergraph Multi-Modal Learning for EEG-based Emotion Recognition in Conversation
by: Kang, Zijian, et al.
Published: (2025)

Deep Fuzzy Framework for Emotion Recognition using EEG Signals and Emotion Representation in Type-2 Fuzzy VAD Space
by: Asif, Mohammad, et al.
Published: (2024)