Rate of Model Collapse in Recursive Training

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Suresh, Ananda Theertha, Thangaraj, Andrew, Khandavally, Aditya Nanda Kishore
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Information Theory
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

The importance of feature preprocessing for differentially private linear optimization
by: Sun, Ziteng, et al.
Published: (2023)

On Robust Hypothesis Testing with respect to the Hellinger Distance
by: Modak, Eeshan, et al.
Published: (2025)

Asymptotics of Language Model Alignment
by: Yang, Joy Qiping, et al.
Published: (2024)

Mean estimation in the add-remove model of differential privacy
by: Kulesza, Alex, et al.
Published: (2023)

Subset-Based Instance Optimality in Private Estimation
by: Dick, Travis, et al.
Published: (2023)

Multi-Group Fairness Evaluation via Conditional Value-at-Risk Testing
by: Paes, Lucas Monteiro, et al.
Published: (2023)

Theoretical guarantees on the best-of-n alignment policy
by: Beirami, Ahmad, et al.
Published: (2024)

SpecTr: Fast Speculative Decoding via Optimal Transport
by: Sun, Ziteng, et al.
Published: (2023)

Just Wing It: Near-Optimal Estimation of Missing Mass in a Markovian Sequence
by: Pananjady, Ashwin, et al.
Published: (2024)

Block Verification Accelerates Speculative Decoding
by: Sun, Ziteng, et al.
Published: (2024)

InfAlign: Inference-aware language model alignment
by: Balashankar, Ananth, et al.
Published: (2024)

Hierarchical Retrieval: The Geometry and a Pretrain-Finetune Recipe
by: You, Chong, et al.
Published: (2025)

Training-Free Rate-Distortion-Perception Traversal With Diffusion
by: Wang, Yuhan, et al.
Published: (2026)

Distributed and Rate-Adaptive Feature Compression
by: Deshmukh, Aditya, et al.
Published: (2024)

Multi-Mixer Models: Flexible Sequence Modeling with Shared Representations
by: Li, Kevin Y., et al.
Published: (2026)

Coupling without Communication and Drafter-Invariant Speculative Decoding
by: Daliri, Majid, et al.
Published: (2024)

Exploring and Improving Drafts in Blockwise Parallel Decoding
by: Kim, Taehyeon, et al.
Published: (2024)

Improved Sample Complexity Bounds for Diffusion Model Training
by: Gupta, Shivam, et al.
Published: (2023)

A Constrained BA Algorithm for Rate-Distortion and Distortion-Rate Functions
by: Chen, Lingyi, et al.
Published: (2023)

Distribution Estimation with Side Information
by: Balasundaram, Haricharan, et al.
Published: (2026)

Rate-Distortion Optimization for Transformer Inference
by: de Andrade, Anderson, et al.
Published: (2026)

Rate-Distortion-Perception Theory for the Quadratic Wasserstein Space
by: Qu, Xiqiang, et al.
Published: (2025)

Fast Rate Information-theoretic Bounds on Generalization Errors
by: Wu, Xuetong, et al.
Published: (2023)

Code Rate Optimization via Neural Polar Decoders
by: Aharoni, Ziv, et al.
Published: (2025)

Optimal Neural Compressors for the Rate-Distortion-Perception Tradeoff
by: Lei, Eric, et al.
Published: (2025)

Robust Estimation Under Heterogeneous Corruption Rates
by: Chaudhuri, Syomantak, et al.
Published: (2025)

The Rate-Distortion-Perception Trade-off: The Role of Private Randomness
by: Hamdi, Yassine, et al.
Published: (2024)

Deep Adaptive Rate Allocation in Volatile Heterogeneous Wireless Networks
by: Maglione, Gregorio, et al.
Published: (2026)

Rate-Distortion-Perception Tradeoff Based on the Conditional-Distribution Perception Measure
by: Salehkalaibar, Sadaf, et al.
Published: (2024)

Gaussian Rate-Distortion-Perception Coding and Entropy-Constrained Scalar Quantization
by: Xie, Li, et al.
Published: (2024)

Neural Estimation of the Rate-Distortion Function With Applications to Operational Source Coding
by: Lei, Eric, et al.
Published: (2022)

Can Kernel Methods Explain How the Data Affects Neural Collapse?
by: Kothapalli, Vignesh, et al.
Published: (2024)

Output-Constrained Lossy Source Coding With Application to Rate-Distortion-Perception Theory
by: Xie, Li, et al.
Published: (2024)

Mixture-of-Experts under Finite-Rate Gating: Communication--Generalization Trade-offs
by: Khalesi, Ali, et al.
Published: (2026)

Standard Transformers Achieve the Minimax Rate in Nonparametric Regression with $C^{s,λ}$ Targets
by: Lai, Yanming, et al.
Published: (2026)

Sparse In-Network Learning via Shortest-Path Backpropagation and Finite-Rate Gating
by: Salehi, Mohammad Reza Deylam
Published: (2026)

Beyond Fixed False Discovery Rates: Post-Hoc Conformal Selection with E-Variables
by: Zhu, Meiyi, et al.
Published: (2026)

Property Inheritance for Subtensors in Tensor Train Decompositions
by: Cai, HanQin, et al.
Published: (2025)

Data-Driven Estimation of the False Positive Rate of the Bayes Binary Classifier via Soft Labels
by: Jeong, Minoh, et al.
Published: (2024)

Matching Rates and Optimal Allocation for Federated Probe-Logit Distillation under Heterogeneous Bandwidth Budgets
by: Dubey, Prasanjit, et al.
Published: (2026)