Saved in:
Bibliographic Details
Main Authors: Wang, Zhifeng, Wang, Minghui, Zeng, Chunyan, Li, Longlong
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2410.07834
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910643951501312
author Wang, Zhifeng
Wang, Minghui
Zeng, Chunyan
Li, Longlong
author_facet Wang, Zhifeng
Wang, Minghui
Zeng, Chunyan
Li, Longlong
contents The integration of Artificial Intelligence into the modern educational system is rapidly evolving, particularly in monitoring student behavior in classrooms, a task traditionally dependent on manual observation. This conventional method is notably inefficient, prompting a shift toward more advanced solutions like computer vision. However, existing target detection models face significant challenges such as occlusion, blurring, and scale disparity, which are exacerbated by the dynamic and complex nature of classroom settings. Furthermore, these models must adeptly handle multiple target detection. To overcome these obstacles, we introduce the Student Learning Behavior Detection with Multi-Scale Deformable Transformers (SCB-DETR), an innovative approach that utilizes large convolutional kernels for upstream feature extraction, and multi-scale feature fusion. This technique significantly improves the detection capabilities for multi-scale and occluded targets, offering a robust solution for analyzing student behavior. SCB-DETR establishes an end-to-end framework that simplifies the detection process and consistently outperforms other deep learning methods. Employing our custom Student Classroom Behavior (SCBehavior) Dataset, SCB-DETR achieves a mean Average Precision (mAP) of 0.626, which is a 1.5% improvement over the baseline model's mAP and a 6% increase in AP50. These results demonstrate SCB-DETR's superior performance in handling the uneven distribution of student behaviors and ensuring precise detection in dynamic classroom environments.
format Preprint
id arxiv_https___arxiv_org_abs_2410_07834
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Multi-Scale Deformable Transformers for Student Learning Behavior Detection in Smart Classroom
Wang, Zhifeng
Wang, Minghui
Zeng, Chunyan
Li, Longlong
Computer Vision and Pattern Recognition
The integration of Artificial Intelligence into the modern educational system is rapidly evolving, particularly in monitoring student behavior in classrooms, a task traditionally dependent on manual observation. This conventional method is notably inefficient, prompting a shift toward more advanced solutions like computer vision. However, existing target detection models face significant challenges such as occlusion, blurring, and scale disparity, which are exacerbated by the dynamic and complex nature of classroom settings. Furthermore, these models must adeptly handle multiple target detection. To overcome these obstacles, we introduce the Student Learning Behavior Detection with Multi-Scale Deformable Transformers (SCB-DETR), an innovative approach that utilizes large convolutional kernels for upstream feature extraction, and multi-scale feature fusion. This technique significantly improves the detection capabilities for multi-scale and occluded targets, offering a robust solution for analyzing student behavior. SCB-DETR establishes an end-to-end framework that simplifies the detection process and consistently outperforms other deep learning methods. Employing our custom Student Classroom Behavior (SCBehavior) Dataset, SCB-DETR achieves a mean Average Precision (mAP) of 0.626, which is a 1.5% improvement over the baseline model's mAP and a 6% increase in AP50. These results demonstrate SCB-DETR's superior performance in handling the uneven distribution of student behaviors and ensuring precise detection in dynamic classroom environments.
title Multi-Scale Deformable Transformers for Student Learning Behavior Detection in Smart Classroom
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2410.07834