Entropy-based convergence rates of greedy algorithms

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Li, Yuwen, Siegel, Jonathan
Format: Preprint
Published: 2023
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929561451626496
author Li, Yuwen
Siegel, Jonathan
author_facet Li, Yuwen
Siegel, Jonathan
contents We present convergence estimates of two types of greedy algorithms in terms of the metric entropy of underlying compact sets. In the first part, we measure the error of a standard greedy reduced basis method for parametric PDEs by the metric entropy of the solution manifold in Banach spaces. This contrasts with the classical analysis based on the Kolmogorov n-widths and enables us to obtain direct comparisons between the greedy algorithm error and the entropy numbers, where the multiplicative constants are explicit and simple. The entropy-based convergence estimate is sharp and improves upon the classical width-based analysis of reduced basis methods for elliptic model problems. In the second part, we derive a novel and simple convergence analysis of the classical orthogonal greedy algorithm for nonlinear dictionary approximation using the metric entropy of the symmetric convex hull of the dictionary. This also improves upon existing results by giving a direct comparison between the algorithm error and the metric entropy.
format Preprint
id arxiv_https___arxiv_org_abs_2304_13332
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Entropy-based convergence rates of greedy algorithms
Li, Yuwen
Siegel, Jonathan
Numerical Analysis
41A25, 41A46, 41A65, 65M12, 65N15
We present convergence estimates of two types of greedy algorithms in terms of the metric entropy of underlying compact sets. In the first part, we measure the error of a standard greedy reduced basis method for parametric PDEs by the metric entropy of the solution manifold in Banach spaces. This contrasts with the classical analysis based on the Kolmogorov n-widths and enables us to obtain direct comparisons between the greedy algorithm error and the entropy numbers, where the multiplicative constants are explicit and simple. The entropy-based convergence estimate is sharp and improves upon the classical width-based analysis of reduced basis methods for elliptic model problems. In the second part, we derive a novel and simple convergence analysis of the classical orthogonal greedy algorithm for nonlinear dictionary approximation using the metric entropy of the symmetric convex hull of the dictionary. This also improves upon existing results by giving a direct comparison between the algorithm error and the metric entropy.
title Entropy-based convergence rates of greedy algorithms
topic Numerical Analysis
41A25, 41A46, 41A65, 65M12, 65N15
url https://arxiv.org/abs/2304.13332