Descriptor: Face Detection Dataset for Programmable Threshold-Based Sparse-Vision

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Islam, Riadul, Tummala, Sri Ranga Sai Krishna, Mulé, Joey, Kankipati, Rohith, Jalapally, Suraj, Challagundla, Dhandeep, Howard, Chad, Robucci, Ryan
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914961331060736
author Islam, Riadul
Tummala, Sri Ranga Sai Krishna
Mulé, Joey
Kankipati, Rohith
Jalapally, Suraj
Challagundla, Dhandeep
Howard, Chad
Robucci, Ryan
author_facet Islam, Riadul
Tummala, Sri Ranga Sai Krishna
Mulé, Joey
Kankipati, Rohith
Jalapally, Suraj
Challagundla, Dhandeep
Howard, Chad
Robucci, Ryan
contents Smart focal-plane and in-chip image processing has emerged as a crucial technology for vision-enabled embedded systems with energy efficiency and privacy. However, the lack of special datasets providing examples of the data that these neuromorphic sensors compute to convey visual information has hindered the adoption of these promising technologies. Neuromorphic imager variants, including event-based sensors, produce various representations such as streams of pixel addresses representing time and locations of intensity changes in the focal plane, temporal-difference data, data sifted/thresholded by temporal differences, image data after applying spatial transformations, optical flow data, and/or statistical representations. To address the critical barrier to entry, we provide an annotated, temporal-threshold-based vision dataset specifically designed for face detection tasks derived from the same videos used for Aff-Wild2. By offering multiple threshold levels (e.g., 4, 8, 12, and 16), this dataset allows for comprehensive evaluation and optimization of state-of-the-art neural architectures under varying conditions and settings compared to traditional methods. The accompanying tool flow for generating event data from raw videos further enhances accessibility and usability. We anticipate that this resource will significantly support the development of robust vision systems based on smart sensors that can process based on temporal-difference thresholds, enabling more accurate and efficient object detection and localization and ultimately promoting the broader adoption of low-power, neuromorphic imaging technologies. To support further research, we publicly released the dataset at \url{https://dx.doi.org/10.21227/bw2e-dj78}.
format Preprint
id arxiv_https___arxiv_org_abs_2410_00368
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Descriptor: Face Detection Dataset for Programmable Threshold-Based Sparse-Vision
Islam, Riadul
Tummala, Sri Ranga Sai Krishna
Mulé, Joey
Kankipati, Rohith
Jalapally, Suraj
Challagundla, Dhandeep
Howard, Chad
Robucci, Ryan
Computer Vision and Pattern Recognition
Image and Video Processing
Smart focal-plane and in-chip image processing has emerged as a crucial technology for vision-enabled embedded systems with energy efficiency and privacy. However, the lack of special datasets providing examples of the data that these neuromorphic sensors compute to convey visual information has hindered the adoption of these promising technologies. Neuromorphic imager variants, including event-based sensors, produce various representations such as streams of pixel addresses representing time and locations of intensity changes in the focal plane, temporal-difference data, data sifted/thresholded by temporal differences, image data after applying spatial transformations, optical flow data, and/or statistical representations. To address the critical barrier to entry, we provide an annotated, temporal-threshold-based vision dataset specifically designed for face detection tasks derived from the same videos used for Aff-Wild2. By offering multiple threshold levels (e.g., 4, 8, 12, and 16), this dataset allows for comprehensive evaluation and optimization of state-of-the-art neural architectures under varying conditions and settings compared to traditional methods. The accompanying tool flow for generating event data from raw videos further enhances accessibility and usability. We anticipate that this resource will significantly support the development of robust vision systems based on smart sensors that can process based on temporal-difference thresholds, enabling more accurate and efficient object detection and localization and ultimately promoting the broader adoption of low-power, neuromorphic imaging technologies. To support further research, we publicly released the dataset at \url{https://dx.doi.org/10.21227/bw2e-dj78}.
title Descriptor: Face Detection Dataset for Programmable Threshold-Based Sparse-Vision
topic Computer Vision and Pattern Recognition
Image and Video Processing
url https://arxiv.org/abs/2410.00368