More Is Better: A MoE-Based Emotion Recognition Framework with Human Preference Alignment
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866915434471620608 |
|---|---|
| author | Xie, Jun Zhu, Yingjian Chen, Feng Zhang, Zhenghao Fan, Xiaohui Yi, Hongzhu Wang, Xinming Yu, Chen Bi, Yue Zhao, Zhaoran Guan, Xiongjun Wang, Zhepeng |
| author_facet | Xie, Jun Zhu, Yingjian Chen, Feng Zhang, Zhenghao Fan, Xiaohui Yi, Hongzhu Wang, Xinming Yu, Chen Bi, Yue Zhao, Zhaoran Guan, Xiongjun Wang, Zhepeng |
| contents | In this paper, we present our solution for the semi-supervised learning track (MER-SEMI) in MER2025. We propose a comprehensive framework, grounded in the principle that "more is better," to construct a robust Mixture of Experts (MoE) emotion recognition system. Our approach integrates a diverse range of input modalities as independent experts, including novel signals such as knowledge from large Vision-Language Models (VLMs) and temporal Action Unit (AU) information. To effectively utilize unlabeled data, we introduce a consensus-based pseudo-labeling strategy, generating high-quality labels from the agreement between a baseline model and Gemini, which are then used in a two-stage training paradigm. Finally, we employ a multi-expert voting ensemble combined with a rule-based re-ranking process to correct prediction bias and better align the outputs with human preferences. Evaluated on the MER2025-SEMI challenge dataset, our method achieves an F1-score of 0.8772 on the test set, ranking 2nd in the track. Our code is available at https://github.com/zhuyjan/MER2025-MRAC25. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2508_06036 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | More Is Better: A MoE-Based Emotion Recognition Framework with Human Preference Alignment Xie, Jun Zhu, Yingjian Chen, Feng Zhang, Zhenghao Fan, Xiaohui Yi, Hongzhu Wang, Xinming Yu, Chen Bi, Yue Zhao, Zhaoran Guan, Xiongjun Wang, Zhepeng Computer Vision and Pattern Recognition In this paper, we present our solution for the semi-supervised learning track (MER-SEMI) in MER2025. We propose a comprehensive framework, grounded in the principle that "more is better," to construct a robust Mixture of Experts (MoE) emotion recognition system. Our approach integrates a diverse range of input modalities as independent experts, including novel signals such as knowledge from large Vision-Language Models (VLMs) and temporal Action Unit (AU) information. To effectively utilize unlabeled data, we introduce a consensus-based pseudo-labeling strategy, generating high-quality labels from the agreement between a baseline model and Gemini, which are then used in a two-stage training paradigm. Finally, we employ a multi-expert voting ensemble combined with a rule-based re-ranking process to correct prediction bias and better align the outputs with human preferences. Evaluated on the MER2025-SEMI challenge dataset, our method achieves an F1-score of 0.8772 on the test set, ranking 2nd in the track. Our code is available at https://github.com/zhuyjan/MER2025-MRAC25. |
| title | More Is Better: A MoE-Based Emotion Recognition Framework with Human Preference Alignment |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2508.06036 |