Fast Generation of Custom Floating-Point Spatial Filters on FPGAs

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Campos, Nelson, Edirisinghe, Eran, Chesnokov, Salva, Larkin, Daniel
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912019177799680
author Campos, Nelson
Edirisinghe, Eran
Chesnokov, Salva
Larkin, Daniel
author_facet Campos, Nelson
Edirisinghe, Eran
Chesnokov, Salva
Larkin, Daniel
contents Convolutional Neural Networks (CNNs) have been utilised in many image and video processing applications. The convolution operator, also known as a spatial filter, is usually a linear operation, but this linearity compromises essential features and details inherent in the non-linearity present in many applications. However, due to its slow processing, the use of a nonlinear spatial filter is a significant bottleneck in many software applications. Further, due to their complexity, they are difficult to accelerate in FPGA or VLSI architectures. This paper presents novel FPGA implementations of linear and nonlinear spatial filters. More specifically, the arithmetic computations are carried out in custom floating-point, enabling a tradeoff of precision and hardware compactness, reducing algorithm development time. Further, we show that it is possible to process video at a resolution of 1080p with a frame rate of 60 frames per second, using a low-cost FPGA board. Finally, we show that using a domain-specific language will allow the rapid prototyping of image processing algorithms in custom floating-point arithmetic, allowing non-experts to quickly develop real-time video processing applications.
format Preprint
id arxiv_https___arxiv_org_abs_2409_05837
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Fast Generation of Custom Floating-Point Spatial Filters on FPGAs
Campos, Nelson
Edirisinghe, Eran
Chesnokov, Salva
Larkin, Daniel
Hardware Architecture
Convolutional Neural Networks (CNNs) have been utilised in many image and video processing applications. The convolution operator, also known as a spatial filter, is usually a linear operation, but this linearity compromises essential features and details inherent in the non-linearity present in many applications. However, due to its slow processing, the use of a nonlinear spatial filter is a significant bottleneck in many software applications. Further, due to their complexity, they are difficult to accelerate in FPGA or VLSI architectures. This paper presents novel FPGA implementations of linear and nonlinear spatial filters. More specifically, the arithmetic computations are carried out in custom floating-point, enabling a tradeoff of precision and hardware compactness, reducing algorithm development time. Further, we show that it is possible to process video at a resolution of 1080p with a frame rate of 60 frames per second, using a low-cost FPGA board. Finally, we show that using a domain-specific language will allow the rapid prototyping of image processing algorithms in custom floating-point arithmetic, allowing non-experts to quickly develop real-time video processing applications.
title Fast Generation of Custom Floating-Point Spatial Filters on FPGAs
topic Hardware Architecture
url https://arxiv.org/abs/2409.05837