Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2402.03497 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909858033303552 |
|---|---|
| author | Colburn, Benjamin Giraldo, Luis G. Sanchez Li, Kan Principe, Jose C. |
| author_facet | Colburn, Benjamin Giraldo, Luis G. Sanchez Li, Kan Principe, Jose C. |
| contents | Unlike the conventional kernel adaptive filtering (KAF) approach of using a fixed kernel to define the Reproducing Kernel Hilbert Space (RKHS), this paper embeds the statistics of the input data in the kernel definition, obtaining a closed-form solution for nonlinear adaptive filtering. We call this solution the Functional Wiener Filter (FWF), and it is formally an extension of Parzen's work on the autocorrelation RKHS to nonlinear functional spaces. We present a method for approximating the FWF in an explicit, finite-dimensional RKHS to model time series directly from realizations, which is less computationally demanding at test time than other KAF methods. We show that FWF outperforms KAF on a synthetic dataset that meets the conditions of the theory, and is comparable to other KAF algorithms for both a chaotic and real-world time series. We demonstrate how the difference equation learned by the FWF can be extracted, leading to possible applications in system identification. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2402_03497 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | A Closed-Form Solution for Kernel Adaptive Filtering Colburn, Benjamin Giraldo, Luis G. Sanchez Li, Kan Principe, Jose C. Signal Processing Unlike the conventional kernel adaptive filtering (KAF) approach of using a fixed kernel to define the Reproducing Kernel Hilbert Space (RKHS), this paper embeds the statistics of the input data in the kernel definition, obtaining a closed-form solution for nonlinear adaptive filtering. We call this solution the Functional Wiener Filter (FWF), and it is formally an extension of Parzen's work on the autocorrelation RKHS to nonlinear functional spaces. We present a method for approximating the FWF in an explicit, finite-dimensional RKHS to model time series directly from realizations, which is less computationally demanding at test time than other KAF methods. We show that FWF outperforms KAF on a synthetic dataset that meets the conditions of the theory, and is comparable to other KAF algorithms for both a chaotic and real-world time series. We demonstrate how the difference equation learned by the FWF can be extracted, leading to possible applications in system identification. |
| title | A Closed-Form Solution for Kernel Adaptive Filtering |
| topic | Signal Processing |
| url | https://arxiv.org/abs/2402.03497 |