Enregistré dans:
| Auteurs principaux: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2023
|
| Sujets: | |
| Accès en ligne: | https://arxiv.org/abs/2312.09066 |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866909215674597376 |
|---|---|
| author | Wu, Chi-hsuan Liu, Shih-yang Huang, Xijie Wang, Xingbo Zhang, Rong Minciullo, Luca Yiu, Wong Kai Kwan, Kenny Cheng, Kwang-Ting |
| author_facet | Wu, Chi-hsuan Liu, Shih-yang Huang, Xijie Wang, Xingbo Zhang, Rong Minciullo, Luca Yiu, Wong Kai Kwan, Kenny Cheng, Kwang-Ting |
| contents | Online learning is a rapidly growing industry. However, a major doubt about online learning is whether students are as engaged as they are in face-to-face classes. An engagement recognition system can notify the instructors about the students condition and improve the learning experience. Current challenges in engagement detection involve poor label quality, extreme data imbalance, and intra-class variety - the variety of behaviors at a certain engagement level. To address these problems, we present the CMOSE dataset, which contains a large number of data from different engagement levels and high-quality labels annotated according to psychological advice. We also propose a training mechanism MocoRank to handle the intra-class variety and the ordinal pattern of different degrees of engagement classes. MocoRank outperforms prior engagement detection frameworks, achieving a 1.32% increase in overall accuracy and 5.05% improvement in average accuracy. Further, we demonstrate the effectiveness of multi-modality in engagement detection by combining video features with speech and audio features. The data transferability experiments also state that the proposed CMOSE dataset provides superior label quality and behavior diversity. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2312_09066 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | CMOSE: Comprehensive Multi-Modality Online Student Engagement Dataset with High-Quality Labels Wu, Chi-hsuan Liu, Shih-yang Huang, Xijie Wang, Xingbo Zhang, Rong Minciullo, Luca Yiu, Wong Kai Kwan, Kenny Cheng, Kwang-Ting Computer Vision and Pattern Recognition Artificial Intelligence Online learning is a rapidly growing industry. However, a major doubt about online learning is whether students are as engaged as they are in face-to-face classes. An engagement recognition system can notify the instructors about the students condition and improve the learning experience. Current challenges in engagement detection involve poor label quality, extreme data imbalance, and intra-class variety - the variety of behaviors at a certain engagement level. To address these problems, we present the CMOSE dataset, which contains a large number of data from different engagement levels and high-quality labels annotated according to psychological advice. We also propose a training mechanism MocoRank to handle the intra-class variety and the ordinal pattern of different degrees of engagement classes. MocoRank outperforms prior engagement detection frameworks, achieving a 1.32% increase in overall accuracy and 5.05% improvement in average accuracy. Further, we demonstrate the effectiveness of multi-modality in engagement detection by combining video features with speech and audio features. The data transferability experiments also state that the proposed CMOSE dataset provides superior label quality and behavior diversity. |
| title | CMOSE: Comprehensive Multi-Modality Online Student Engagement Dataset with High-Quality Labels |
| topic | Computer Vision and Pattern Recognition Artificial Intelligence |
| url | https://arxiv.org/abs/2312.09066 |