Cover Image

Towards Mitigating Architecture Overfitting on Distilled Datasets

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zhong, Xuyang, Liu, Chen
Format:	Preprint
Published:	2023
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

How to Mitigate Overfitting in Weak-to-strong Generalization?
by: Shi, Junhao, et al.
Published: (2025)

Mitigating Overfitting in Graph Neural Networks via Feature and Hyperplane Perturbation
by: Choi, Yoonhyuk, et al.
Published: (2022)

DualOptim: Enhancing Efficacy and Stability in Machine Unlearning with Dual Optimizers
by: Zhong, Xuyang, et al.
Published: (2025)

Fast Adversarial Training against Sparse Attacks Requires Loss Smoothing
by: Zhong, Xuyang, et al.
Published: (2025)

Provable Robust Overfitting Mitigation in Wasserstein Distributionally Robust Optimization
by: Liu, Shuang, et al.
Published: (2025)

mSFT: Addressing Dataset Mixtures Overfitting Heterogeneously in Multi-task SFT
by: Koh, Woosung, et al.
Published: (2026)

Iterative Data Smoothing: Mitigating Reward Overfitting and Overoptimization in RLHF
by: Zhu, Banghua, et al.
Published: (2024)

Mitigating Bias in Dataset Distillation
by: Cui, Justin, et al.
Published: (2024)

Control of Overfitting with Physics
by: Kozyrev, Sergei V., et al.
Published: (2024)

Residual Stream Analysis of Overfitting And Structural Disruptions
by: Liu, Quan, et al.
Published: (2026)

DNAD: Differentiable Neural Architecture Distillation
by: Rao, Xuan, et al.
Published: (2025)

Not All Instances Are Equally Valuable: Towards Influence-Weighted Dataset Distillation
by: Deng, Qiyan, et al.
Published: (2025)

Dataset Distillation for Offline Reinforcement Learning
by: Light, Jonathan, et al.
Published: (2024)

Friend or Foe? Harnessing Controllable Overfitting for Anomaly Detection
by: Qian, Long, et al.
Published: (2024)

TextReg: Mitigating Prompt Distributional Overfitting via Regularized Text-Space Optimization
by: Fu, Lucheng, et al.
Published: (2026)

Grounding and Enhancing Informativeness and Utility in Dataset Distillation
by: Wang, Shaobo, et al.
Published: (2026)

Benign Overfitting in Adversarial Training for Vision Transformers
by: Zhang, Jiaming, et al.
Published: (2026)

Path-Guided Flow Matching for Dataset Distillation
by: Li, Xuhui, et al.
Published: (2026)

Overcoming Overfitting in Reinforcement Learning via Gaussian Process Diffusion Policy
by: Horprasert, Amornyos, et al.
Published: (2025)

Prioritize Alignment in Dataset Distillation
by: Li, Zekai, et al.
Published: (2024)

On the Implicit Reward Overfitting and the Low-rank Dynamics in RLVR
by: Ye, Hao, et al.
Published: (2026)

Detecting Generative Parroting through Overfitting Masked Autoencoders
by: Taghanaki, Saeid Asgari, et al.
Published: (2024)

PRISM: Diversifying Dataset Distillation by Decoupling Architectural Priors
by: Moser, Brian B., et al.
Published: (2025)

LoRA Dropout as a Sparsity Regularizer for Overfitting Control
by: Lin, Yang, et al.
Published: (2024)

A Classical View on Benign Overfitting: The Role of Sample Size
by: Park, Junhyung, et al.
Published: (2025)

Class-Imbalanced-Aware Adaptive Dataset Distillation for Scalable Pretrained Model on Credit Scoring
by: Li, Xia, et al.
Published: (2025)

scDD: Latent Codes Based scRNA-seq Dataset Distillation with Foundation Model Knowledge
by: Yu, Zhen, et al.
Published: (2025)

Fairness Overfitting in Machine Learning: An Information-Theoretic Perspective
by: Laakom, Firas, et al.
Published: (2025)

Turning Black Box into White Box: Dataset Distillation Leaks
by: Chen, Huajie, et al.
Published: (2026)

Benign Overfitting for Regression with Trained Two-Layer ReLU Networks
by: Park, Junhyung, et al.
Published: (2024)

From Overfitting to Reliability: Introducing the Hierarchical Approximate Bayesian Neural Network
by: Amirkhanian, Hayk, et al.
Published: (2025)

Toward Student-Oriented Teacher Network Training For Knowledge Distillation
by: Dong, Chengyu, et al.
Published: (2022)

From Overfitting to Robustness: Quantity, Quality, and Variety Oriented Negative Sample Selection in Graph Contrastive Learning
by: Ali, Adnan, et al.
Published: (2024)

Revisiting Knowledge Distillation: The Hidden Role of Dataset Size
by: Lanzillotta, Giulia, et al.
Published: (2025)

Towards Mitigation of Hallucination for LLM-empowered Agents: Progressive Generalization Bound Exploration and Watchdog Monitor
by: Liu, Siyuan, et al.
Published: (2025)

Risk Phase Transitions in Spiked Regression: Alignment Driven Benign and Catastrophic Overfitting
by: Li, Jiping, et al.
Published: (2025)

Utilizing Strategic Pre-training to Reduce Overfitting: Baguan -- A Pre-trained Weather Forecasting Model
by: Niu, Peisong, et al.
Published: (2025)

DDTime: Dataset Distillation with Spectral Alignment and Information Bottleneck for Time-Series Forecasting
by: Li, Yuqi, et al.
Published: (2025)

Harmonizing Multi-Objective LLM Unlearning via Unified Domain Representation and Bidirectional Logit Distillation
by: Zhong, Yisheng, et al.
Published: (2026)

Towards Mitigating Excessive Forgetting in LLM Unlearning via Entanglement-Guidance with Proxy Constraint
by: Liu, Zhihao, et al.
Published: (2025)