A Dataset for Crucial Object Recognition in Blind and Low-Vision Individuals' Navigation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Islam, Md Touhidul, Kabir, Imran, Pearce, Elena Ariel, Reza, Md Alimoor, Billah, Syed Masum
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908857205260288
author Islam, Md Touhidul
Kabir, Imran
Pearce, Elena Ariel
Reza, Md Alimoor
Billah, Syed Masum
author_facet Islam, Md Touhidul
Kabir, Imran
Pearce, Elena Ariel
Reza, Md Alimoor
Billah, Syed Masum
contents This paper introduces a dataset for improving real-time object recognition systems to aid blind and low-vision (BLV) individuals in navigation tasks. The dataset comprises 21 videos of BLV individuals navigating outdoor spaces, and a taxonomy of 90 objects crucial for BLV navigation, refined through a focus group study. We also provide object labeling for the 90 objects across 31 video segments created from the 21 videos. A deeper analysis reveals that most contemporary datasets used in training computer vision models contain only a small subset of the taxonomy in our dataset. Preliminary evaluation of state-of-the-art computer vision models on our dataset highlights shortcomings in accurately detecting key objects relevant to BLV navigation, emphasizing the need for specialized datasets. We make our dataset publicly available, offering valuable resources for developing more inclusive navigation systems for BLV individuals.
format Preprint
id arxiv_https___arxiv_org_abs_2407_16777
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle A Dataset for Crucial Object Recognition in Blind and Low-Vision Individuals' Navigation
Islam, Md Touhidul
Kabir, Imran
Pearce, Elena Ariel
Reza, Md Alimoor
Billah, Syed Masum
Computer Vision and Pattern Recognition
Human-Computer Interaction
This paper introduces a dataset for improving real-time object recognition systems to aid blind and low-vision (BLV) individuals in navigation tasks. The dataset comprises 21 videos of BLV individuals navigating outdoor spaces, and a taxonomy of 90 objects crucial for BLV navigation, refined through a focus group study. We also provide object labeling for the 90 objects across 31 video segments created from the 21 videos. A deeper analysis reveals that most contemporary datasets used in training computer vision models contain only a small subset of the taxonomy in our dataset. Preliminary evaluation of state-of-the-art computer vision models on our dataset highlights shortcomings in accurately detecting key objects relevant to BLV navigation, emphasizing the need for specialized datasets. We make our dataset publicly available, offering valuable resources for developing more inclusive navigation systems for BLV individuals.
title A Dataset for Crucial Object Recognition in Blind and Low-Vision Individuals' Navigation
topic Computer Vision and Pattern Recognition
Human-Computer Interaction
url https://arxiv.org/abs/2407.16777