Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2512.00757 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909934705180672 |
|---|---|
| author | Han, Zongjian Liang, Yiran Wang, Ruiwen Luo, Yiwei Huang, Yilin Song, Xiaotong Wei, Dongqing |
| author_facet | Han, Zongjian Liang, Yiran Wang, Ruiwen Luo, Yiwei Huang, Yilin Song, Xiaotong Wei, Dongqing |
| contents | This paper presents a neural network filter method based on contraction operators to address model collapse in recursive training of generative models. Unlike \cite{xu2024probabilistic}, which requires superlinear sample growth ($O(t^{1+s})$), our approach completely eliminates the dependence on increasing sample sizes within an unbiased estimation framework by designing a neural filter that learns to satisfy contraction conditions. We develop specialized neural network architectures and loss functions that enable the filter to actively learn contraction conditions satisfying Assumption 2.3 in exponential family distributions, thereby ensuring practical application of our theoretical results. Theoretical analysis demonstrates that when the learned contraction conditions are satisfied, estimation errors converge probabilistically even with constant sample sizes, i.e., $\limsup_{t\to\infty}\mathbb{P}(\|\mathbf{e}_t\|>δ)=0$ for any $δ>0$. Experimental results show that our neural network filter effectively learns contraction conditions and prevents model collapse under fixed sample size settings, providing an end-to-end solution for practical applications. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2512_00757 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Preventing Model Collapse via Contraction-Conditioned Neural Filters Han, Zongjian Liang, Yiran Wang, Ruiwen Luo, Yiwei Huang, Yilin Song, Xiaotong Wei, Dongqing Machine Learning Artificial Intelligence This paper presents a neural network filter method based on contraction operators to address model collapse in recursive training of generative models. Unlike \cite{xu2024probabilistic}, which requires superlinear sample growth ($O(t^{1+s})$), our approach completely eliminates the dependence on increasing sample sizes within an unbiased estimation framework by designing a neural filter that learns to satisfy contraction conditions. We develop specialized neural network architectures and loss functions that enable the filter to actively learn contraction conditions satisfying Assumption 2.3 in exponential family distributions, thereby ensuring practical application of our theoretical results. Theoretical analysis demonstrates that when the learned contraction conditions are satisfied, estimation errors converge probabilistically even with constant sample sizes, i.e., $\limsup_{t\to\infty}\mathbb{P}(\|\mathbf{e}_t\|>δ)=0$ for any $δ>0$. Experimental results show that our neural network filter effectively learns contraction conditions and prevents model collapse under fixed sample size settings, providing an end-to-end solution for practical applications. |
| title | Preventing Model Collapse via Contraction-Conditioned Neural Filters |
| topic | Machine Learning Artificial Intelligence |
| url | https://arxiv.org/abs/2512.00757 |