Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2402.07356 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916439296835584 |
|---|---|
| author | Akhtiamov, Danil Bosch, David Ghane, Reza Varma, K Nithin Hassibi, Babak |
| author_facet | Akhtiamov, Danil Bosch, David Ghane, Reza Varma, K Nithin Hassibi, Babak |
| contents | A celebrated result by Gordon allows one to compare the min-max behavior of two Gaussian processes if certain inequality conditions are met. The consequences of this result include the Gaussian min-max (GMT) and convex Gaussian min-max (CGMT) theorems which have had far-reaching implications in high-dimensional statistics, machine learning, non-smooth optimization, and signal processing. Both theorems rely on a pair of Gaussian processes, first identified by Slepian, that satisfy Gordon's comparison inequalities. In this paper, we identify such a new pair. The resulting theorems extend the classical GMT and CGMT Theorems from the case where the underlying Gaussian matrix in the primary process has iid rows to where it has independent but non-identically-distributed ones. The new CGMT is applied to the problems of multi-source Gaussian regression, as well as to binary classification of general Gaussian mixture models. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2402_07356 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | A Novel Gaussian Min-Max Theorem and its Applications Akhtiamov, Danil Bosch, David Ghane, Reza Varma, K Nithin Hassibi, Babak Machine Learning A celebrated result by Gordon allows one to compare the min-max behavior of two Gaussian processes if certain inequality conditions are met. The consequences of this result include the Gaussian min-max (GMT) and convex Gaussian min-max (CGMT) theorems which have had far-reaching implications in high-dimensional statistics, machine learning, non-smooth optimization, and signal processing. Both theorems rely on a pair of Gaussian processes, first identified by Slepian, that satisfy Gordon's comparison inequalities. In this paper, we identify such a new pair. The resulting theorems extend the classical GMT and CGMT Theorems from the case where the underlying Gaussian matrix in the primary process has iid rows to where it has independent but non-identically-distributed ones. The new CGMT is applied to the problems of multi-source Gaussian regression, as well as to binary classification of general Gaussian mixture models. |
| title | A Novel Gaussian Min-Max Theorem and its Applications |
| topic | Machine Learning |
| url | https://arxiv.org/abs/2402.07356 |