Playing telephone with generative models: "verification disability," "compelled reliance," and accessibility in data visualization

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Elavsky, Frank, Bearfield, Cindy Xiong
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913995322032128
author Elavsky, Frank
Bearfield, Cindy Xiong
author_facet Elavsky, Frank
Bearfield, Cindy Xiong
contents This paper is a collaborative piece between two worlds of expertise in the field of data visualization: accessibility and bias. In particular, the rise of generative models playing a role in accessibility is a worrying trend for data visualization. These models are increasingly used to help author visualizations as well as generate descriptions of existing visualizations for people who are blind, low vision, or use assistive technologies such as screen readers. Sighted human-to-human bias has already been established as an area of concern for theory, research, and design in data visualization. But what happens when someone is unable to verify the model output or adequately interrogate algorithmic bias, such as a context where a blind person asks a model to describe a chart for them? In such scenarios, trust from the user is not earned, rather reliance is compelled by the model-to-human relationship. In this work, we explored the dangers of AI-generated descriptions for accessibility, playing a game of telephone between models, observing bias production in model interpretation, and re-interpretation of a data visualization. We unpack ways that model failure in visualization is especially problematic for users with visual impairments, and suggest directions forward for three distinct readers of this piece: technologists who build model-assisted interfaces for end users, users with disabilities leveraging models for their own purposes, and researchers concerned with bias, accessibility, or visualization.
format Preprint
id arxiv_https___arxiv_org_abs_2508_12192
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Playing telephone with generative models: "verification disability," "compelled reliance," and accessibility in data visualization
Elavsky, Frank
Bearfield, Cindy Xiong
Human-Computer Interaction
H.5.2; I.2.6; I.3.3; J.4; K.4.2; I.2.10
This paper is a collaborative piece between two worlds of expertise in the field of data visualization: accessibility and bias. In particular, the rise of generative models playing a role in accessibility is a worrying trend for data visualization. These models are increasingly used to help author visualizations as well as generate descriptions of existing visualizations for people who are blind, low vision, or use assistive technologies such as screen readers. Sighted human-to-human bias has already been established as an area of concern for theory, research, and design in data visualization. But what happens when someone is unable to verify the model output or adequately interrogate algorithmic bias, such as a context where a blind person asks a model to describe a chart for them? In such scenarios, trust from the user is not earned, rather reliance is compelled by the model-to-human relationship. In this work, we explored the dangers of AI-generated descriptions for accessibility, playing a game of telephone between models, observing bias production in model interpretation, and re-interpretation of a data visualization. We unpack ways that model failure in visualization is especially problematic for users with visual impairments, and suggest directions forward for three distinct readers of this piece: technologists who build model-assisted interfaces for end users, users with disabilities leveraging models for their own purposes, and researchers concerned with bias, accessibility, or visualization.
title Playing telephone with generative models: "verification disability," "compelled reliance," and accessibility in data visualization
topic Human-Computer Interaction
H.5.2; I.2.6; I.3.3; J.4; K.4.2; I.2.10
url https://arxiv.org/abs/2508.12192