Saved in:
Bibliographic Details
Main Authors: Haghighi, Yasaman, Demonsant, Celine, Chalimourdas, Panagiotis, Naeini, Maryam Tavasoli, Munoz, Jhon Kevin, Bacca, Bladimir, Suter, Silvan, Gani, Matthieu, Alahi, Alexandre
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2409.20324
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913523429277696
author Haghighi, Yasaman
Demonsant, Celine
Chalimourdas, Panagiotis
Naeini, Maryam Tavasoli
Munoz, Jhon Kevin
Bacca, Bladimir
Suter, Silvan
Gani, Matthieu
Alahi, Alexandre
author_facet Haghighi, Yasaman
Demonsant, Celine
Chalimourdas, Panagiotis
Naeini, Maryam Tavasoli
Munoz, Jhon Kevin
Bacca, Bladimir
Suter, Silvan
Gani, Matthieu
Alahi, Alexandre
contents In this paper, we introduce HEADS-UP, the first egocentric dataset collected from head-mounted cameras, designed specifically for trajectory prediction in blind assistance systems. With the growing population of blind and visually impaired individuals, the need for intelligent assistive tools that provide real-time warnings about potential collisions with dynamic obstacles is becoming critical. These systems rely on algorithms capable of predicting the trajectories of moving objects, such as pedestrians, to issue timely hazard alerts. However, existing datasets fail to capture the necessary information from the perspective of a blind individual. To address this gap, HEADS-UP offers a novel dataset focused on trajectory prediction in this context. Leveraging this dataset, we propose a semi-local trajectory prediction approach to assess collision risks between blind individuals and pedestrians in dynamic environments. Unlike conventional methods that separately predict the trajectories of both the blind individual (ego agent) and pedestrians, our approach operates within a semi-local coordinate system, a rotated version of the camera's coordinate system, facilitating the prediction process. We validate our method on the HEADS-UP dataset and implement the proposed solution in ROS, performing real-time tests on an NVIDIA Jetson GPU through a user study. Results from both dataset evaluations and live tests demonstrate the robustness and efficiency of our approach.
format Preprint
id arxiv_https___arxiv_org_abs_2409_20324
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle HEADS-UP: Head-Mounted Egocentric Dataset for Trajectory Prediction in Blind Assistance Systems
Haghighi, Yasaman
Demonsant, Celine
Chalimourdas, Panagiotis
Naeini, Maryam Tavasoli
Munoz, Jhon Kevin
Bacca, Bladimir
Suter, Silvan
Gani, Matthieu
Alahi, Alexandre
Computer Vision and Pattern Recognition
In this paper, we introduce HEADS-UP, the first egocentric dataset collected from head-mounted cameras, designed specifically for trajectory prediction in blind assistance systems. With the growing population of blind and visually impaired individuals, the need for intelligent assistive tools that provide real-time warnings about potential collisions with dynamic obstacles is becoming critical. These systems rely on algorithms capable of predicting the trajectories of moving objects, such as pedestrians, to issue timely hazard alerts. However, existing datasets fail to capture the necessary information from the perspective of a blind individual. To address this gap, HEADS-UP offers a novel dataset focused on trajectory prediction in this context. Leveraging this dataset, we propose a semi-local trajectory prediction approach to assess collision risks between blind individuals and pedestrians in dynamic environments. Unlike conventional methods that separately predict the trajectories of both the blind individual (ego agent) and pedestrians, our approach operates within a semi-local coordinate system, a rotated version of the camera's coordinate system, facilitating the prediction process. We validate our method on the HEADS-UP dataset and implement the proposed solution in ROS, performing real-time tests on an NVIDIA Jetson GPU through a user study. Results from both dataset evaluations and live tests demonstrate the robustness and efficiency of our approach.
title HEADS-UP: Head-Mounted Egocentric Dataset for Trajectory Prediction in Blind Assistance Systems
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2409.20324