SciCapenter: Supporting Caption Composition for Scientific Figures with Machine-Generated Captions and Ratings

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Hsu, Ting-Yao, Huang, Chieh-Yang, Huang, Shih-Hong, Rossi, Ryan, Kim, Sungchul, Yu, Tong, Giles, C. Lee, Huang, Ting-Hao K.
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866911814531416064
author Hsu, Ting-Yao
Huang, Chieh-Yang
Huang, Shih-Hong
Rossi, Ryan
Kim, Sungchul
Yu, Tong
Giles, C. Lee
Huang, Ting-Hao K.
author_facet Hsu, Ting-Yao
Huang, Chieh-Yang
Huang, Shih-Hong
Rossi, Ryan
Kim, Sungchul
Yu, Tong
Giles, C. Lee
Huang, Ting-Hao K.
contents Crafting effective captions for figures is important. Readers heavily depend on these captions to grasp the figure's message. However, despite a well-developed set of AI technologies for figures and captions, these have rarely been tested for usefulness in aiding caption writing. This paper introduces SciCapenter, an interactive system that puts together cutting-edge AI technologies for scientific figure captions to aid caption composition. SciCapenter generates a variety of captions for each figure in a scholarly article, providing scores and a comprehensive checklist to assess caption quality across multiple critical aspects, such as helpfulness, OCR mention, key takeaways, and visual properties reference. Users can directly edit captions in SciCapenter, resubmit for revised evaluations, and iteratively refine them. A user study with Ph.D. students indicates that SciCapenter significantly lowers the cognitive load of caption writing. Participants' feedback further offers valuable design insights for future systems aiming to enhance caption writing.
format Preprint
id arxiv_https___arxiv_org_abs_2403_17784
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle SciCapenter: Supporting Caption Composition for Scientific Figures with Machine-Generated Captions and Ratings
Hsu, Ting-Yao
Huang, Chieh-Yang
Huang, Shih-Hong
Rossi, Ryan
Kim, Sungchul
Yu, Tong
Giles, C. Lee
Huang, Ting-Hao K.
Human-Computer Interaction
Artificial Intelligence
Crafting effective captions for figures is important. Readers heavily depend on these captions to grasp the figure's message. However, despite a well-developed set of AI technologies for figures and captions, these have rarely been tested for usefulness in aiding caption writing. This paper introduces SciCapenter, an interactive system that puts together cutting-edge AI technologies for scientific figure captions to aid caption composition. SciCapenter generates a variety of captions for each figure in a scholarly article, providing scores and a comprehensive checklist to assess caption quality across multiple critical aspects, such as helpfulness, OCR mention, key takeaways, and visual properties reference. Users can directly edit captions in SciCapenter, resubmit for revised evaluations, and iteratively refine them. A user study with Ph.D. students indicates that SciCapenter significantly lowers the cognitive load of caption writing. Participants' feedback further offers valuable design insights for future systems aiming to enhance caption writing.
title SciCapenter: Supporting Caption Composition for Scientific Figures with Machine-Generated Captions and Ratings
topic Human-Computer Interaction
Artificial Intelligence
url https://arxiv.org/abs/2403.17784