ClassComet: Exploring and Designing AI-generated Danmaku in Educational Videos to Enhance Online Learning

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Ji, Zipeng, An, Pengcheng, Zhao, Jian
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866910918844088320
author Ji, Zipeng
An, Pengcheng
Zhao, Jian
author_facet Ji, Zipeng
An, Pengcheng
Zhao, Jian
contents Danmaku, users' live comments synchronized with, and overlaying on videos, has recently shown potential in promoting online video-based learning. However, user-generated danmaku can be scarce-especially in newer or less viewed videos and its quality is unpredictable, limiting its educational impact. This paper explores how large multimodal models (LMM) can be leveraged to automatically generate effective, high-quality danmaku. We first conducted a formative study to identify the desirable characteristics of content- and emotion-related danmaku in educational videos. Based on the obtained insights, we developed ClassComet, an educational video platform with novel LMM-driven techniques for generating relevant types of danmaku to enhance video-based learning. Through user studies, we examined the quality of generated danmaku and their influence on learning experiences. The results indicate that our generated danmaku is comparable to human-created ones, and videos with both content- and emotion-related danmaku showed significant improvement in viewers' engagement and learning outcome.
format Preprint
id arxiv_https___arxiv_org_abs_2504_18189
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle ClassComet: Exploring and Designing AI-generated Danmaku in Educational Videos to Enhance Online Learning
Ji, Zipeng
An, Pengcheng
Zhao, Jian
Human-Computer Interaction
Danmaku, users' live comments synchronized with, and overlaying on videos, has recently shown potential in promoting online video-based learning. However, user-generated danmaku can be scarce-especially in newer or less viewed videos and its quality is unpredictable, limiting its educational impact. This paper explores how large multimodal models (LMM) can be leveraged to automatically generate effective, high-quality danmaku. We first conducted a formative study to identify the desirable characteristics of content- and emotion-related danmaku in educational videos. Based on the obtained insights, we developed ClassComet, an educational video platform with novel LMM-driven techniques for generating relevant types of danmaku to enhance video-based learning. Through user studies, we examined the quality of generated danmaku and their influence on learning experiences. The results indicate that our generated danmaku is comparable to human-created ones, and videos with both content- and emotion-related danmaku showed significant improvement in viewers' engagement and learning outcome.
title ClassComet: Exploring and Designing AI-generated Danmaku in Educational Videos to Enhance Online Learning
topic Human-Computer Interaction
url https://arxiv.org/abs/2504.18189