Cover Image

Evaluating Multimodal Language Models as Visual Assistants for Visually Impaired Users

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Karamolegkou, Antonia, Nikandrou, Malvina, Pantazopoulos, Georgios, Villegas, Danae Sanchez, Rust, Phillip, Dhar, Ruchira, Hershcovich, Daniel, Søgaard, Anders
Format:	Preprint
Published:	2025
Subjects:	Human-Computer Interaction Artificial Intelligence Computation and Language Computers and Society Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Beyond Technocratic XAI: The Who, What & How in Explanation Design
by: Dhar, Ruchira, et al.
Published: (2025)

Beyond Visual Perception: Insights from Smartphone Interaction of Visually Impaired Users with Large Multimodal Models
by: Xie, Jingyi, et al.
Published: (2025)

An AI-Based Shopping Assistant System to Support the Visually Impaired
by: Shibata, Larissa R. de S., et al.
Published: (2025)

Vision-Language Models under Cultural and Inclusive Considerations
by: Karamolegkou, Antonia, et al.
Published: (2024)

AngleSizer: Enhancing Spatial Scale Perception for the Visually Impaired with an Interactive Smartphone Assistant
by: Jing, Xiaoqing, et al.
Published: (2024)

Learning To See But Forgetting To Follow: Visual Instruction Tuning Makes LLMs More Prone To Jailbreak Attacks
by: Pantazopoulos, Georgios, et al.
Published: (2024)

AIDEN: Design and Pilot Study of an AI Assistant for the Visually Impaired
by: Marquez-Carpintero, Luis, et al.
Published: (2025)

Enhancing Continual Learning in Visual Question Answering with Modality-Aware Feature Distillation
by: Nikandrou, Malvina, et al.
Published: (2024)

"They Aren't Built For Me": A Replication Study of Visual Graphical Perception with Tactile Representations of Data for Visually Impaired Users
by: Khalaila, Areen, et al.
Published: (2024)

Navigation beyond Wayfinding: Robots Collaborating with Visually Impaired Users for Environmental Interactions
by: Cai, Shaojun, et al.
Published: (2026)

Insight: Enhancing Mobile Accessibility for Blind and Visually Impaired Users with LLMs
by: Ansah, Joshua Owusu, et al.
Published: (2026)

Trick or Neat: Adversarial Ambiguity and Language Model Evaluation
by: Karamolegkou, Antonia, et al.
Published: (2025)

Understanding How Visually Impaired Players Socialize in Mobile Games
by: Ran, Zihe, et al.
Published: (2025)

Navigating Independence: A Survey of Visually Impaired People's Experiences and Needs
by: Bamdad, Banafshe Marziyeh, et al.
Published: (2026)

Navigation Framework for Blind and Visually Impaired Persons based on Sensor Fusion
by: Silva, Chathurika S., et al.
Published: (2025)

Grating haptic perception through touchscreen: Sighted vs. Visually Impaired
by: Gao, Yichen, et al.
Published: (2025)

Understanding Visually Impaired Tramway Passengers Interaction with Public Transport Systems
by: Mimra, Dominik, et al.
Published: (2025)

Beyond Benchmarks: How Users Evaluate AI Chat Assistants
by: Awan, Moiz Sadiq, et al.
Published: (2026)

Evaluation Revisited: A Taxonomy of Evaluation Concerns in Natural Language Processing
by: Dhar, Ruchira, et al.
Published: (2026)

PyGWalker: On-the-fly Assistant for Exploratory Visual Data Analysis
by: Yu, Yue, et al.
Published: (2024)

Rethinking Accessible Prototyping Methods for Blind and Visually Impaired Passengers in Highly Automated Vehicles
by: Meinhardt, Luca-Maxim, et al.
Published: (2025)

The Impact of Generative AI Coding Assistants on Developers Who Are Visually Impaired
by: Flores-Saviaga, Claudia, et al.
Published: (2025)

Immersed in my Ideas: Using Virtual Reality and Multimodal Interactions to Visualize Users' Ideas and Thoughts
by: Xing, Yunhao, et al.
Published: (2024)

Acceptability of AI Assistants for Privacy: Perceptions of Experts and Users on Personalized Privacy Assistants
by: Xu, Meihe, et al.
Published: (2025)

A Preliminary Roadmap for LLMs as Assistants in Exploring, Analyzing, and Visualizing Knowledge Graphs
by: Li, Harry, et al.
Published: (2024)

NavVI: A Telerobotic Simulation with Multimodal Feedback for Visually Impaired Navigation in Warehouse Environments
by: Maimuna, Maisha, et al.
Published: (2025)

Real-Time Assistive Navigation for the Visually Impaired: A Scalable Approach for Indoor and Outdoor Mobility
by: Das, Dabbrata, et al.
Published: (2025)

Haptic Color Patterns for Visually Impaired People-Pilot Study for a Learning Color Wheel
by: Chao, Hsin-Yi, et al.
Published: (2024)

The Visualization JUDGE : Can Multimodal Foundation Models Guide Visualization Design Through Visual Perception?
by: Berger, Matthew, et al.
Published: (2024)

GuideTouch: An Obstacle Avoidance Device with Tactile Feedback for Visually Impaired
by: Kozlov, Timofei, et al.
Published: (2026)

The Ambivalent Experience of Eye Contact for People with Visual Impairments: Mechanisms and Design Challenges
by: Wieland, Markus, et al.
Published: (2026)

PISHYAR: A Socially Intelligent Smart Cane for Indoor Social Navigation and Multimodal Human-Robot Interaction for Visually Impaired People
by: Joo, Mahdi Haghighat, et al.
Published: (2026)

Towards an Inclusive Digital Society: Digital Accessibility Framework for Visually Impaired Citizens in Swiss Public Administration
by: Werren, Sabina, et al.
Published: (2025)

AIris: An AI-powered Wearable Assistive Device for the Visually Impaired
by: Brilli, Dionysia Danai, et al.
Published: (2024)

From Words to Worlds: Compositionality for Cognitive Architectures
by: Dhar, Ruchira, et al.
Published: (2024)

Lower Quantity, Higher Quality: Auditing News Content and User Perceptions on Twitter/X Algorithmic versus Chronological Timelines
by: Wang, Stephanie, et al.
Published: (2024)

Interactive Augmented Reality-enabled Outdoor Scene Visualization For Enhanced Real-time Disaster Response
by: Apostolakis, Dimitrios, et al.
Published: (2026)

Exploring Spatial Hybrid User Interface for Visual Sensemaking
by: Tong, Wai, et al.
Published: (2025)

Does Motion Intensity Impair Cognition in HCI? The Critical Role of Physical Motion-Visual Target Directional Congruency
by: Wang, Jianshu, et al.
Published: (2026)

Toward Accessible Mobile Money: A Voice-Driven, Biometrically Secured USSD Automation Framework for Visually Impaired Users
by: Ajayi, Sunday, et al.
Published: (2026)