How many samples are needed to train a deep neural network?
Fuente:
arXiv
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866911121221353472 |
|---|---|
| author | Golestaneh, Pegah Taheri, Mahsa Lederer, Johannes |
| author_facet | Golestaneh, Pegah Taheri, Mahsa Lederer, Johannes |
| contents | Neural networks have become standard tools in many areas, yet many important statistical questions remain open. This paper studies the question of how much data are needed to train a ReLU feed-forward neural network. Our theoretical and empirical results suggest that the generalization error of ReLU feed-forward neural networks scales at the rate $1/\sqrt{n}$ in the sample size $n$ rather than the usual "parametric rate" $1/n$. Thus, broadly speaking, our results underpin the common belief that neural networks need "many" training samples. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2405_16696 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | How many samples are needed to train a deep neural network? Golestaneh, Pegah Taheri, Mahsa Lederer, Johannes Statistics Theory Machine Learning Neural networks have become standard tools in many areas, yet many important statistical questions remain open. This paper studies the question of how much data are needed to train a ReLU feed-forward neural network. Our theoretical and empirical results suggest that the generalization error of ReLU feed-forward neural networks scales at the rate $1/\sqrt{n}$ in the sample size $n$ rather than the usual "parametric rate" $1/n$. Thus, broadly speaking, our results underpin the common belief that neural networks need "many" training samples. |
| title | How many samples are needed to train a deep neural network? |
| topic | Statistics Theory Machine Learning |
| url | https://arxiv.org/abs/2405.16696 |