Making Short-Form Videos Accessible with Hierarchical Video Summaries

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Van Daele, Tess, Iyer, Akhil, Zhang, Yuning, Derry, Jalyn C., Huh, Mina, Pavel, Amy
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866911778221326336
author Van Daele, Tess
Iyer, Akhil
Zhang, Yuning
Derry, Jalyn C.
Huh, Mina
Pavel, Amy
author_facet Van Daele, Tess
Iyer, Akhil
Zhang, Yuning
Derry, Jalyn C.
Huh, Mina
Pavel, Amy
contents Short videos on platforms such as TikTok, Instagram Reels, and YouTube Shorts (i.e. short-form videos) have become a primary source of information and entertainment. Many short-form videos are inaccessible to blind and low vision (BLV) viewers due to their rapid visual changes, on-screen text, and music or meme-audio overlays. In our formative study, 7 BLV viewers who regularly watched short-form videos reported frequently skipping such inaccessible content. We present ShortScribe, a system that provides hierarchical visual summaries of short-form videos at three levels of detail to support BLV viewers in selecting and understanding short-form videos. ShortScribe allows BLV users to navigate between video descriptions based on their level of interest. To evaluate ShortScribe, we assessed description accuracy and conducted a user study with 10 BLV participants comparing ShortScribe to a baseline interface. When using ShortScribe, participants reported higher comprehension and provided more accurate summaries of video content.
format Preprint
id arxiv_https___arxiv_org_abs_2402_10382
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Making Short-Form Videos Accessible with Hierarchical Video Summaries
Van Daele, Tess
Iyer, Akhil
Zhang, Yuning
Derry, Jalyn C.
Huh, Mina
Pavel, Amy
Human-Computer Interaction
Short videos on platforms such as TikTok, Instagram Reels, and YouTube Shorts (i.e. short-form videos) have become a primary source of information and entertainment. Many short-form videos are inaccessible to blind and low vision (BLV) viewers due to their rapid visual changes, on-screen text, and music or meme-audio overlays. In our formative study, 7 BLV viewers who regularly watched short-form videos reported frequently skipping such inaccessible content. We present ShortScribe, a system that provides hierarchical visual summaries of short-form videos at three levels of detail to support BLV viewers in selecting and understanding short-form videos. ShortScribe allows BLV users to navigate between video descriptions based on their level of interest. To evaluate ShortScribe, we assessed description accuracy and conducted a user study with 10 BLV participants comparing ShortScribe to a baseline interface. When using ShortScribe, participants reported higher comprehension and provided more accurate summaries of video content.
title Making Short-Form Videos Accessible with Hierarchical Video Summaries
topic Human-Computer Interaction
url https://arxiv.org/abs/2402.10382