Gespeichert in:
| Hauptverfasser: | , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | https://arxiv.org/abs/2508.14395 |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866908495656255488 |
|---|---|
| author | Zhao, Running Jiang, Zhihan Zhang, Xinchen Chang, Chirui Chen, Handi Deng, Weipeng Jin, Luyao Qi, Xiaojuan Qian, Xun Ngai, Edith C. H. |
| author_facet | Zhao, Running Jiang, Zhihan Zhang, Xinchen Chang, Chirui Chen, Handi Deng, Weipeng Jin, Luyao Qi, Xiaojuan Qian, Xun Ngai, Edith C. H. |
| contents | Users often take notes for instructional videos to access key knowledge later without revisiting long videos. Automated note generation tools enable users to obtain informative notes efficiently. However, notes generated by existing research or off-the-shelf tools fail to preserve the information conveyed in the original videos comprehensively, nor can they satisfy users' expectations for diverse presentation formats and interactive features when using notes digitally. In this work, we present NoteIt, a system, which automatically converts instructional videos to interactable notes using a novel pipeline that faithfully extracts hierarchical structure and multimodal key information from videos. With NoteIt's interface, users can interact with the system to further customize the content and presentation formats of the notes according to their preferences. We conducted both a technical evaluation and a comparison user study (N=36). The solid performance in objective metrics and the positive user feedback demonstrated the effectiveness of the pipeline and the overall usability of NoteIt. Project website: https://zhaorunning.github.io/NoteIt/ |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2508_14395 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | NoteIt: A System Converting Instructional Videos to Interactable Notes Through Multimodal Video Understanding Zhao, Running Jiang, Zhihan Zhang, Xinchen Chang, Chirui Chen, Handi Deng, Weipeng Jin, Luyao Qi, Xiaojuan Qian, Xun Ngai, Edith C. H. Human-Computer Interaction Artificial Intelligence Users often take notes for instructional videos to access key knowledge later without revisiting long videos. Automated note generation tools enable users to obtain informative notes efficiently. However, notes generated by existing research or off-the-shelf tools fail to preserve the information conveyed in the original videos comprehensively, nor can they satisfy users' expectations for diverse presentation formats and interactive features when using notes digitally. In this work, we present NoteIt, a system, which automatically converts instructional videos to interactable notes using a novel pipeline that faithfully extracts hierarchical structure and multimodal key information from videos. With NoteIt's interface, users can interact with the system to further customize the content and presentation formats of the notes according to their preferences. We conducted both a technical evaluation and a comparison user study (N=36). The solid performance in objective metrics and the positive user feedback demonstrated the effectiveness of the pipeline and the overall usability of NoteIt. Project website: https://zhaorunning.github.io/NoteIt/ |
| title | NoteIt: A System Converting Instructional Videos to Interactable Notes Through Multimodal Video Understanding |
| topic | Human-Computer Interaction Artificial Intelligence |
| url | https://arxiv.org/abs/2508.14395 |