Compound Expression Recognition via Multi Model Ensemble for the ABAW7 Challenge
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914887912914944 |
|---|---|
| author | Liu, Xuxiong Shen, Kang Yao, Jun Wang, Boyan Liu, Minrui An, Liuwei Cui, Zishun Feng, Weijie Sun, Xiao |
| author_facet | Liu, Xuxiong Shen, Kang Yao, Jun Wang, Boyan Liu, Minrui An, Liuwei Cui, Zishun Feng, Weijie Sun, Xiao |
| contents | Compound Expression Recognition (CER) is vital for effective interpersonal interactions. Human emotional expressions are inherently complex due to the presence of compound expressions, requiring the consideration of both local and global facial cues for accurate judgment. In this paper, we propose an ensemble learning-based solution to address this complexity. Our approach involves training three distinct expression classification models using convolutional networks, Vision Transformers, and multiscale local attention networks. By employing late fusion for model ensemble, we combine the outputs of these models to predict the final results. Our method demonstrates high accuracy on the RAF-DB datasets and is capable of recognizing expressions in certain portions of the C-EXPR-DB through zero-shot learning. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2407_12257 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Compound Expression Recognition via Multi Model Ensemble for the ABAW7 Challenge Liu, Xuxiong Shen, Kang Yao, Jun Wang, Boyan Liu, Minrui An, Liuwei Cui, Zishun Feng, Weijie Sun, Xiao Computer Vision and Pattern Recognition Compound Expression Recognition (CER) is vital for effective interpersonal interactions. Human emotional expressions are inherently complex due to the presence of compound expressions, requiring the consideration of both local and global facial cues for accurate judgment. In this paper, we propose an ensemble learning-based solution to address this complexity. Our approach involves training three distinct expression classification models using convolutional networks, Vision Transformers, and multiscale local attention networks. By employing late fusion for model ensemble, we combine the outputs of these models to predict the final results. Our method demonstrates high accuracy on the RAF-DB datasets and is capable of recognizing expressions in certain portions of the C-EXPR-DB through zero-shot learning. |
| title | Compound Expression Recognition via Multi Model Ensemble for the ABAW7 Challenge |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2407.12257 |