Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2409.19772 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914960179724288 |
|---|---|
| author | Song, Chen Liang, Zhenxiao Sun, Bo Huang, Qixing |
| author_facet | Song, Chen Liang, Zhenxiao Sun, Bo Huang, Qixing |
| contents | We present Parametric Piecewise Linear Networks (PPLNs) for temporal vision inference. Motivated by the neuromorphic principles that regulate biological neural behaviors, PPLNs are ideal for processing data captured by event cameras, which are built to simulate neural activities in the human retina. We discuss how to represent the membrane potential of an artificial neuron by a parametric piecewise linear function with learnable coefficients. This design echoes the idea of building deep models from learnable parametric functions recently popularized by Kolmogorov-Arnold Networks (KANs). Experiments demonstrate the state-of-the-art performance of PPLNs in event-based and image-based vision applications, including steering prediction, human pose estimation, and motion deblurring. The source code of our implementation is available at https://github.com/chensong1995/PPLN. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2409_19772 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | PPLNs: Parametric Piecewise Linear Networks for Event-Based Temporal Modeling and Beyond Song, Chen Liang, Zhenxiao Sun, Bo Huang, Qixing Computer Vision and Pattern Recognition We present Parametric Piecewise Linear Networks (PPLNs) for temporal vision inference. Motivated by the neuromorphic principles that regulate biological neural behaviors, PPLNs are ideal for processing data captured by event cameras, which are built to simulate neural activities in the human retina. We discuss how to represent the membrane potential of an artificial neuron by a parametric piecewise linear function with learnable coefficients. This design echoes the idea of building deep models from learnable parametric functions recently popularized by Kolmogorov-Arnold Networks (KANs). Experiments demonstrate the state-of-the-art performance of PPLNs in event-based and image-based vision applications, including steering prediction, human pose estimation, and motion deblurring. The source code of our implementation is available at https://github.com/chensong1995/PPLN. |
| title | PPLNs: Parametric Piecewise Linear Networks for Event-Based Temporal Modeling and Beyond |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2409.19772 |