ADCanvas: Accessible and Conversational Audio Description Authoring for Blind and Low Vision Creators

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Li, Franklin Mingzhe, Liu, Michael Xieyang, Bennett, Cynthia L., Kane, Shaun K.
Format: Preprint
Veröffentlicht: 2026
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866917255274561536
author Li, Franklin Mingzhe
Liu, Michael Xieyang
Bennett, Cynthia L.
Kane, Shaun K.
author_facet Li, Franklin Mingzhe
Liu, Michael Xieyang
Bennett, Cynthia L.
Kane, Shaun K.
contents Audio Description (AD) provides essential access to visual media for blind and low vision (BLV) audiences. Yet current AD production tools remain largely inaccessible to BLV video creators, who possess valuable expertise but face barriers due to visually-driven interfaces. We present ADCanvas, a multimodal authoring system that supports non-visual control over audio description (AD) creation. ADCanvas combines conversational interaction with keyboard-based playback control and a plain-text, screen reader-accessible editor to support end-to-end AD authoring and visual question answering (VQA). Combining screen-reader-friendly controls with a multimodal LLM agent, ADCanvas supports live VQA, script generation, and AD modification. Through a user study with 12 BLV video creators, we find that users adopt the conversational agent as an informational aide and drafting assistant, while maintaining agency through verification and editing. For example, participants saw themselves as curators who received information from the model and filtered it down for their audience. Our findings offer design implications for accessible media tools, including precise editing controls, accessibility support for creative ideation, and configurable rules for human-AI collaboration.
format Preprint
id arxiv_https___arxiv_org_abs_2602_07266
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle ADCanvas: Accessible and Conversational Audio Description Authoring for Blind and Low Vision Creators
Li, Franklin Mingzhe
Liu, Michael Xieyang
Bennett, Cynthia L.
Kane, Shaun K.
Human-Computer Interaction
H.5.2; K.4.2
Audio Description (AD) provides essential access to visual media for blind and low vision (BLV) audiences. Yet current AD production tools remain largely inaccessible to BLV video creators, who possess valuable expertise but face barriers due to visually-driven interfaces. We present ADCanvas, a multimodal authoring system that supports non-visual control over audio description (AD) creation. ADCanvas combines conversational interaction with keyboard-based playback control and a plain-text, screen reader-accessible editor to support end-to-end AD authoring and visual question answering (VQA). Combining screen-reader-friendly controls with a multimodal LLM agent, ADCanvas supports live VQA, script generation, and AD modification. Through a user study with 12 BLV video creators, we find that users adopt the conversational agent as an informational aide and drafting assistant, while maintaining agency through verification and editing. For example, participants saw themselves as curators who received information from the model and filtered it down for their audience. Our findings offer design implications for accessible media tools, including precise editing controls, accessibility support for creative ideation, and configurable rules for human-AI collaboration.
title ADCanvas: Accessible and Conversational Audio Description Authoring for Blind and Low Vision Creators
topic Human-Computer Interaction
H.5.2; K.4.2
url https://arxiv.org/abs/2602.07266