AI-based Multimodal Biometrics for Detecting Smartphone Distractions: Application to Online Learning
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866913909251768320 |
|---|---|
| author | Becerra, Alvaro Daza, Roberto Cobos, Ruth Morales, Aythami Cukurova, Mutlu Fierrez, Julian |
| author_facet | Becerra, Alvaro Daza, Roberto Cobos, Ruth Morales, Aythami Cukurova, Mutlu Fierrez, Julian |
| contents | This work investigates the use of multimodal biometrics to detect distractions caused by smartphone use during tasks that require sustained attention, with a focus on computer-based online learning. Although the methods are applicable to various domains, such as autonomous driving, we concentrate on the challenges learners face in maintaining engagement amid internal (e.g., motivation), system-related (e.g., course design) and contextual (e.g., smartphone use) factors. Traditional learning platforms often lack detailed behavioral data, but Multimodal Learning Analytics (MMLA) and biosensors provide new insights into learner attention. We propose an AI-based approach that leverages physiological signals and head pose data to detect phone use. Our results show that single biometric signals, such as brain waves or heart rate, offer limited accuracy, while head pose alone achieves 87%. A multimodal model combining all signals reaches 91% accuracy, highlighting the benefits of integration. We conclude by discussing the implications and limitations of deploying these models for real-time support in online learning environments. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2506_17364 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | AI-based Multimodal Biometrics for Detecting Smartphone Distractions: Application to Online Learning Becerra, Alvaro Daza, Roberto Cobos, Ruth Morales, Aythami Cukurova, Mutlu Fierrez, Julian Computers and Society Artificial Intelligence Computer Vision and Pattern Recognition Human-Computer Interaction This work investigates the use of multimodal biometrics to detect distractions caused by smartphone use during tasks that require sustained attention, with a focus on computer-based online learning. Although the methods are applicable to various domains, such as autonomous driving, we concentrate on the challenges learners face in maintaining engagement amid internal (e.g., motivation), system-related (e.g., course design) and contextual (e.g., smartphone use) factors. Traditional learning platforms often lack detailed behavioral data, but Multimodal Learning Analytics (MMLA) and biosensors provide new insights into learner attention. We propose an AI-based approach that leverages physiological signals and head pose data to detect phone use. Our results show that single biometric signals, such as brain waves or heart rate, offer limited accuracy, while head pose alone achieves 87%. A multimodal model combining all signals reaches 91% accuracy, highlighting the benefits of integration. We conclude by discussing the implications and limitations of deploying these models for real-time support in online learning environments. |
| title | AI-based Multimodal Biometrics for Detecting Smartphone Distractions: Application to Online Learning |
| topic | Computers and Society Artificial Intelligence Computer Vision and Pattern Recognition Human-Computer Interaction |
| url | https://arxiv.org/abs/2506.17364 |