Awaking the Slides: A Tuning-free and Knowledge-regulated AI Tutoring System via Language Model Coordination

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Zhang-Li, Daniel, Zhang, Zheyuan, Yu, Jifan, Yin, Joy Lim Jia, Tu, Shangqing, Gong, Linlu, Wang, Haohua, Liu, Zhiyuan, Liu, Huiqin, Hou, Lei, Li, Juanzi
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866916389416075264
author Zhang-Li, Daniel
Zhang, Zheyuan
Yu, Jifan
Yin, Joy Lim Jia
Tu, Shangqing
Gong, Linlu
Wang, Haohua
Liu, Zhiyuan
Liu, Huiqin
Hou, Lei
Li, Juanzi
author_facet Zhang-Li, Daniel
Zhang, Zheyuan
Yu, Jifan
Yin, Joy Lim Jia
Tu, Shangqing
Gong, Linlu
Wang, Haohua
Liu, Zhiyuan
Liu, Huiqin
Hou, Lei
Li, Juanzi
contents The vast pre-existing slides serve as rich and important materials to carry lecture knowledge. However, effectively leveraging lecture slides to serve students is difficult due to the multi-modal nature of slide content and the heterogeneous teaching actions. We study the problem of discovering effective designs that convert a slide into an interactive lecture. We develop Slide2Lecture, a tuning-free and knowledge-regulated intelligent tutoring system that can (1) effectively convert an input lecture slide into a structured teaching agenda consisting of a set of heterogeneous teaching actions; (2) create and manage an interactive lecture that generates responsive interactions catering to student learning demands while regulating the interactions to follow teaching actions. Slide2Lecture contains a complete pipeline for learners to obtain an interactive classroom experience to learn the slide. For teachers and developers, Slide2Lecture enables customization to cater to personalized demands. The evaluation rated by annotators and students shows that Slide2Lecture is effective in outperforming the remaining implementation. Slide2Lecture's online deployment has made more than 200K interaction with students in the 3K lecture sessions. We open source Slide2Lecture's implementation in https://anonymous.4open.science/r/slide2lecture-4210/.
format Preprint
id arxiv_https___arxiv_org_abs_2409_07372
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Awaking the Slides: A Tuning-free and Knowledge-regulated AI Tutoring System via Language Model Coordination
Zhang-Li, Daniel
Zhang, Zheyuan
Yu, Jifan
Yin, Joy Lim Jia
Tu, Shangqing
Gong, Linlu
Wang, Haohua
Liu, Zhiyuan
Liu, Huiqin
Hou, Lei
Li, Juanzi
Computation and Language
Artificial Intelligence
Human-Computer Interaction
The vast pre-existing slides serve as rich and important materials to carry lecture knowledge. However, effectively leveraging lecture slides to serve students is difficult due to the multi-modal nature of slide content and the heterogeneous teaching actions. We study the problem of discovering effective designs that convert a slide into an interactive lecture. We develop Slide2Lecture, a tuning-free and knowledge-regulated intelligent tutoring system that can (1) effectively convert an input lecture slide into a structured teaching agenda consisting of a set of heterogeneous teaching actions; (2) create and manage an interactive lecture that generates responsive interactions catering to student learning demands while regulating the interactions to follow teaching actions. Slide2Lecture contains a complete pipeline for learners to obtain an interactive classroom experience to learn the slide. For teachers and developers, Slide2Lecture enables customization to cater to personalized demands. The evaluation rated by annotators and students shows that Slide2Lecture is effective in outperforming the remaining implementation. Slide2Lecture's online deployment has made more than 200K interaction with students in the 3K lecture sessions. We open source Slide2Lecture's implementation in https://anonymous.4open.science/r/slide2lecture-4210/.
title Awaking the Slides: A Tuning-free and Knowledge-regulated AI Tutoring System via Language Model Coordination
topic Computation and Language
Artificial Intelligence
Human-Computer Interaction
url https://arxiv.org/abs/2409.07372