Optimising Graph Representation for Hardware Implementation of Graph Convolutional Networks for Event-based Vision
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866913404161097728 |
|---|---|
| author | Jeziorek, Kamil Wzorek, Piotr Blachut, Krzysztof Pinna, Andrea Kryjak, Tomasz |
| author_facet | Jeziorek, Kamil Wzorek, Piotr Blachut, Krzysztof Pinna, Andrea Kryjak, Tomasz |
| contents | Event-based vision is an emerging research field involving processing data generated by Dynamic Vision Sensors (neuromorphic cameras). One of the latest proposals in this area are Graph Convolutional Networks (GCNs), which allow to process events in its original sparse form while maintaining high detection and classification performance. In this paper, we present the hardware implementation of a~graph generation process from an event camera data stream, taking into account both the advantages and limitations of FPGAs. We propose various ways to simplify the graph representation and use scaling and quantisation of values. We consider both undirected and directed graphs that enable the use of PointNet convolution. The results obtained show that by appropriately modifying the graph representation, it is possible to create a~hardware module for graph generation. Moreover, the proposed modifications have no significant impact on object detection performance, only 0.08% mAP less for the base model and the N-Caltech data set.Finally, we describe the proposed hardware architecture of the graph generation module. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2401_04988 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Optimising Graph Representation for Hardware Implementation of Graph Convolutional Networks for Event-based Vision Jeziorek, Kamil Wzorek, Piotr Blachut, Krzysztof Pinna, Andrea Kryjak, Tomasz Computer Vision and Pattern Recognition Image and Video Processing Event-based vision is an emerging research field involving processing data generated by Dynamic Vision Sensors (neuromorphic cameras). One of the latest proposals in this area are Graph Convolutional Networks (GCNs), which allow to process events in its original sparse form while maintaining high detection and classification performance. In this paper, we present the hardware implementation of a~graph generation process from an event camera data stream, taking into account both the advantages and limitations of FPGAs. We propose various ways to simplify the graph representation and use scaling and quantisation of values. We consider both undirected and directed graphs that enable the use of PointNet convolution. The results obtained show that by appropriately modifying the graph representation, it is possible to create a~hardware module for graph generation. Moreover, the proposed modifications have no significant impact on object detection performance, only 0.08% mAP less for the base model and the N-Caltech data set.Finally, we describe the proposed hardware architecture of the graph generation module. |
| title | Optimising Graph Representation for Hardware Implementation of Graph Convolutional Networks for Event-based Vision |
| topic | Computer Vision and Pattern Recognition Image and Video Processing |
| url | https://arxiv.org/abs/2401.04988 |