Cover Image

TouchScribe: Augmenting Non-Visual Hand-Object Interactions with Automated Live Visual Descriptions

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Chang, Ruei-Che, Natalie, Rosiana, Xu, Wenqian, Yap, Jovan Zheng Feng, Luo, Tiange, Potluri, Venkatesh, Guo, Anhong
Format:	Preprint
Published:	2026
Subjects:	Human-Computer Interaction
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Probing the Gaps in ChatGPT Live Video Chat for Real-World Assistance for People who are Blind or Visually Impaired
by: Chang, Ruei-Che, et al.
Published: (2025)

WorldScribe: Towards Context-Aware Live Visual Descriptions
by: Chang, Ruei-Che, et al.
Published: (2024)

Not There Yet: Evaluating Vision Language Models in Simulating the Visual Perception of People with Low Vision
by: Natalie, Rosiana, et al.
Published: (2025)

Audio Description Customization
by: Natalie, Rosiana, et al.
Published: (2024)

EditScribe: Non-Visual Image Editing with Natural Language Verification Loops
by: Chang, Ruei-Che, et al.
Published: (2024)

StateScribe: Towards Accessible Change Awareness Across Real-World Revisits
by: Chang, Ruei-Che, et al.
Published: (2026)

A11y-CUA Dataset: Characterizing the Accessibility Gap in Computer Use Agents
by: Mohanbabu, Ananya Gubbi, et al.
Published: (2026)

SoundShift: Exploring Sound Manipulations for Accessible Mixed-Reality Awareness
by: Chang, Ruei-Che, et al.
Published: (2024)

HandProxy: Expanding the Affordances of Speech Interfaces in Immersive Environments with a Virtual Proxy Hand
by: Liang, Chen, et al.
Published: (2025)

Divisi: Interactive Search and Visualization for Scalable Exploratory Subgroup Analysis
by: Sivaraman, Venkatesh, et al.
Published: (2025)

Magical Touch: Transforming Raw Capacitive Streams into Expressive Hand-Touchscreen Interaction
by: Guo, Yuanlei, et al.
Published: (2026)

MatplotAlt: A Python Library for Adding Alt Text to Matplotlib Figures in Computational Notebooks
by: Nylund, Kai, et al.
Published: (2025)

WhatsAI: Transforming Meta Ray-Bans into an Extensible Generative AI Platform for Accessibility
by: Zaman, Nasif, et al.
Published: (2025)

Py maidr: Bridging Visual and Non-Visual Data Experiences Through a Unified Python Framework
by: Seo, JooYoung, et al.
Published: (2025)

Substantial, Decomposable, and Invisible: Visual Context Misalignment in Instructional Videos for Physical Tasks
by: Li, Yayuan, et al.
Published: (2026)

SpatialTouch: Exploring Spatial Data Visualizations in Cross-reality
by: Zhao, Lixiang, et al.
Published: (2024)

ProgramAlly: Creating Custom Visual Access Programs via Multi-Modal End-User Programming
by: Herskovitz, Jaylin, et al.
Published: (2024)

ReaWristic: Remote Touch Sensation to Fingers from a Wristband via Visually Augmented Electro-Tactile Feedback
by: Tanaka, Yudai, et al.
Published: (2024)

Three Modalities, Two Design Probes, One Prototype, and No Vision: Experience-Based Co-Design of a Multi-modal 3D Data Visualization Tool
by: Kamath, Sanchita S., et al.
Published: (2026)

RAVEN: Realtime Accessibility in Virtual ENvironments for Blind and Low-Vision People
by: Cao, Xinyun, et al.
Published: (2025)

TouchFusion: Multimodal Wristband Sensing for Ubiquitous Touch Interactions
by: Whitmire, Eric, et al.
Published: (2026)

WeldAR: Augmenting Live Hands-On Training with In-Situ Guidance for Novice Learners
by: Xu, Chuhan, et al.
Published: (2026)

Demonstrating Visual Information Manipulation Attacks in Augmented Reality: A Hands-On Miniature City-Based Setup
by: Xiu, Yanming, et al.
Published: (2025)

From Vision to Touch: Bridging Visual and Tactile Principles for Accessible Data Representation
by: Marriott, Kim, et al.
Published: (2025)

Mirror Skin: In Situ Visualization of Robot Touch Intent on Robotic Skin
by: Wagmann, David, et al.
Published: (2025)

GuideTouch: An Obstacle Avoidance Device with Tactile Feedback for Visually Impaired
by: Kozlov, Timofei, et al.
Published: (2026)

Enhancing Safety in Automated Ports: A Virtual Reality Study of Pedestrian-Autonomous Vehicle Interactions under Time Pressure, Visual Constraints, and Varying Vehicle Size
by: Che, Yuan, et al.
Published: (2026)

MapIO: Embodied Interaction for the Accessibility of Tactile Maps Through Augmented Touch Exploration and Conversation
by: Manzoni, Matteo, et al.
Published: (2024)

ObjectFinder: An Open-Vocabulary Assistive System for Interactive Object Search by Blind People
by: Liu, Ruiping, et al.
Published: (2024)

InteractOut: Leveraging Interaction Proxies as Input Manipulation Strategies for Reducing Smartphone Overuse
by: Lu, Tao, et al.
Published: (2024)

Exploration and Exploitation in Consumer Automation: Visualizing IoT Interactions with Topological Data Analysis
by: Novak, Thomas P., et al.
Published: (2024)

Playing with Data: An Augmented Reality Approach to Interact with Visualizations of Industrial Process Tomography
by: Zhang, Yuchong, et al.
Published: (2023)

ChartA11y: Designing Accessible Touch Experiences of Visualizations with Blind Smartphone Users
by: Zhang, Zhuohao Jerry, et al.
Published: (2024)

Counterpoint: Orchestrating Large-Scale Custom Animated Visualizations
by: Sivaraman, Venkatesh, et al.
Published: (2024)

HaloTouch: Using IR Multi-path Interference to Support Touch Interactions With General Surfaces
by: Xia, Ziyi, et al.
Published: (2025)

Semantic Reality: Interactive Context-Aware Visualization of Inter-Object Relationships in Augmented Reality
by: Liu, Xiaoan, et al.
Published: (2026)

RealityEffects: Augmenting 3D Volumetric Videos with Object-Centric Annotation and Dynamic Visual Effects
by: Liao, Jian, et al.
Published: (2024)

Interactive Augmented Reality-enabled Outdoor Scene Visualization For Enhanced Real-time Disaster Response
by: Apostolakis, Dimitrios, et al.
Published: (2026)

SpriteHand: Real-Time Versatile Hand-Object Interaction with Autoregressive Video Generation
by: Li, Zisu, et al.
Published: (2025)

Feelings, Not Feel: Affective Audio-Visual Pseudo-Haptics in Hand-Tracked XR
by: David, Kristian Paolo, et al.
Published: (2026)