Image de couverture de livre

Forget Me Not: Fighting Local Overfitting with Knowledge Fusion and Distillation

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Stern, Uri, Corn, Eli, Weinshall, Daphna
Format:	Preprint
Publié:	2025
Sujets:	Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

On Local Overfitting and Forgetting in Deep Neural Networks
par: Stern, Uri, et autres
Publié: (2024)

VISTA: Validation-Informed Trajectory Adaptation via Self-Distillation
par: Corn, Eli, et autres
Publié: (2026)

DCoM: Active Learning for All Learners
par: Mishal, Inbal, et autres
Publié: (2024)

Leveraging Complementary Embeddings for Replay Selection in Continual Learning with Small Buffers
par: Yanowsky, Danit, et autres
Publié: (2026)

TEAL: New Selection Strategy for Small Buffers in Experience Replay Class Incremental Learning
par: Shaul-Ariel, Shahar, et autres
Publié: (2024)

Active Learning with a Noisy Annotator
par: Shafir, Netta, et autres
Publié: (2025)

Malign Overfitting: Interpolation Can Provably Preclude Invariance
par: Wald, Yoav, et autres
Publié: (2022)

Towards Mitigating Architecture Overfitting on Distilled Datasets
par: Zhong, Xuyang, et autres
Publié: (2023)

Knowledge Accumulation in Continually Learned Representations and the Issue of Feature Forgetting
par: Hess, Timm, et autres
Publié: (2023)

Teach Me to Trick: Exploring Adversarial Transferability via Knowledge Distillation
par: Pradhan, Siddhartha, et autres
Publié: (2025)

Forgetting Has Neighbors: Localized Collateral Forgetting in Machine Unlearning
par: Dolgova, Polina, et autres
Publié: (2026)

Testing for Overfitting
par: Schmidt, James
Publié: (2023)

Mitigating Heterogeneous Token Overfitting in LLM Knowledge Editing
par: Liu, Tianci, et autres
Publié: (2025)

Adjusted Overfitting Regression
par: Wilson, Dylan
Publié: (2024)

Overfitting In Contrastive Learning?
par: Rabin, Zachary, et autres
Publié: (2024)

HSI Image Enhancement Classification Based on Knowledge Distillation: A Study on Forgetting
par: Zhu, Songfeng
Publié: (2026)

xTime: Extreme Event Prediction with Hierarchical Knowledge Distillation and Expert Fusion
par: Li, Quan, et autres
Publié: (2025)

Do LLMs Really Forget? Evaluating Unlearning with Knowledge Correlation and Confidence Awareness
par: Wei, Rongzhe, et autres
Publié: (2025)

Countering Overfitting with Counterfactual Examples
par: Giorgi, Flavio, et autres
Publié: (2025)

Harmful Overfitting in Sobolev Spaces
par: Karhadkar, Kedar, et autres
Publié: (2026)

PINNs Failure Modes are Overfitting
par: Andersen, Nigel T., et autres
Publié: (2026)

Control of Overfitting with Physics
par: Kozyrev, Sergei V., et autres
Publié: (2024)

Relative Overfitting and Accept-Reject Framework
par: Liu, Yanxin, et autres
Publié: (2025)

Benign Overfitting in Single-Head Attention
par: Magen, Roey, et autres
Publié: (2024)

Benign Overfitting with Quantum Kernels
par: Tomasi, Joachim, et autres
Publié: (2025)

Overfitting in Adaptive Robust Optimization
par: Zhu, Karl, et autres
Publié: (2025)

Benign Overfitting in Token Selection of Attention Mechanism
par: Sakamoto, Keitaro, et autres
Publié: (2024)

Revisiting Catastrophic Forgetting in Continual Knowledge Graph Embedding
par: Pons, Gerard, et autres
Publié: (2026)

Neural Tangent Knowledge Distillation for Optical Convolutional Networks
par: Xiang, Jinlin, et autres
Publié: (2025)

Policy Gradient with Tree Search: Avoiding Local Optimas through Lookahead
par: Koren, Uri, et autres
Publié: (2025)

Distill to Delete: Unlearning in Graph Networks with Knowledge Distillation
par: Sinha, Yash, et autres
Publié: (2023)

RAFT: Data Refinement and Adaptive Distillation for Domain Fine-Tuning with Alleviated Forgetting
par: Li, Yuduo, et autres
Publié: (2026)

Rethinking Benign Overfitting in Two-Layer Neural Networks
par: Xu, Ruichen, et autres
Publié: (2025)

Benign Overfitting in Linear Classifiers with a Bias Term
par: Kondo, Yuta
Publié: (2025)

An Agnostic View on the Cost of Overfitting in (Kernel) Ridge Regression
par: Zhou, Lijia, et autres
Publié: (2023)

Provable Weak-to-Strong Generalization via Benign Overfitting
par: Wu, David X., et autres
Publié: (2024)

Negotiated Representations to Prevent Overfitting in Machine Learning Applications
par: Korhan, Nuri, et autres
Publié: (2023)

Characterizing Overfitting in Kernel Ridgeless Regression Through the Eigenspectrum
par: Cheng, Tin Sum, et autres
Publié: (2024)

On the Over-Memorization During Natural, Robust and Catastrophic Overfitting
par: Lin, Runqi, et autres
Publié: (2023)

Benign Overfitting in Out-of-Distribution Generalization of Linear Models
par: Tang, Shange, et autres
Publié: (2024)