Cover Image

Memorization in Self-Supervised Learning Improves Downstream Generalization

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Wang, Wenhao, Kaleem, Muhammad Ahmad, Dziedzic, Adam, Backes, Michael, Papernot, Nicolas, Boenisch, Franziska
Format:	Preprint
Published:	2024
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Localizing Memorization in SSL Vision Encoders
by: Wang, Wenhao, et al.
Published: (2024)

Captured by Captions: On Memorization and its Mitigation in CLIP Models
by: Wang, Wenhao, et al.
Published: (2025)

Localizing and Mitigating Memorization in Image Autoregressive Models
by: Kasliwal, Aditya, et al.
Published: (2025)

On the Privacy Risk of In-context Learning
by: Duan, Haonan, et al.
Published: (2024)

Memorization in Graph Neural Networks
by: Jamadandi, Adarsh, et al.
Published: (2025)

Have it your way: Individualized Privacy Assignment for DP-SGD
by: Boenisch, Franziska, et al.
Published: (2023)

Finding NeMo: Localizing Neurons Responsible For Memorization in Diffusion Models
by: Hintersdorf, Dominik, et al.
Published: (2024)

ADAGE: Active Defenses Against GNN Extraction
by: Xu, Jing, et al.
Published: (2025)

Curation Leaks: Membership Inference Attacks against Data Curation for Machine Learning
by: Wahdany, Dariush, et al.
Published: (2026)

Regulation Games for Trustworthy Machine Learning
by: Yaghini, Mohammad, et al.
Published: (2024)

DP-GPL: Differentially Private Graph Prompt Learning
by: Xu, Jing, et al.
Published: (2025)

Efficient and Privacy-Preserving Soft Prompt Transfer for LLMs
by: Wang, Xun, et al.
Published: (2025)

Radioactive Watermarks in Diffusion and Autoregressive Image Generative Models
by: Meintz, Michel, et al.
Published: (2025)

Differentially Private Prototypes for Imbalanced Transfer Learning
by: Wahdany, Dariush, et al.
Published: (2024)

Open LLMs are Necessary for Current Private Adaptations and Outperform their Closed Alternatives
by: Hanke, Vincent, et al.
Published: (2024)

CDI: Copyrighted Data Identification in Diffusion Models
by: Dubiński, Jan, et al.
Published: (2024)

Unlocking Post-hoc Dataset Inference with Synthetic Data
by: Zhao, Bihe, et al.
Published: (2025)

Implementing Adaptations for Vision AutoRegressive Model
by: Shaikh, Kaif, et al.
Published: (2025)

Privacy Attacks on Image AutoRegressive Models
by: Kowalczuk, Antoni, et al.
Published: (2025)

Differentially Private Federated Learning With Time-Adaptive Privacy Spending
by: Kiani, Shahrzad, et al.
Published: (2025)

LLM Dataset Inference: Did you train on my dataset?
by: Maini, Pratyush, et al.
Published: (2024)

MUC: Machine Unlearning for Contrastive Learning with Black-box Evaluation
by: Wang, Yihan, et al.
Published: (2024)

Efficient Model-Stealing Attacks Against Inductive Graph Neural Networks
by: Podhajski, Marcin, et al.
Published: (2024)

On Stealing Graph Neural Network Models
by: Podhajski, Marcin, et al.
Published: (2025)

Augment then Smooth: Reconciling Differential Privacy with Certified Robustness
by: Wu, Jiapeng, et al.
Published: (2023)

Finding DoRI: Discovery of Retained Images in Diffusion Models
by: Kowalczuk, Antoni, et al.
Published: (2025)

Benchmarking Robust Self-Supervised Learning Across Diverse Downstream Tasks
by: Kowalczuk, Antoni, et al.
Published: (2024)

Decentralised, Collaborative, and Privacy-preserving Machine Learning for Multi-Hospital Data
by: Fang, Congyu, et al.
Published: (2024)

Demystifying Foreground-Background Memorization in Diffusion Models
by: Di, Jimmy Z., et al.
Published: (2025)

Selective Prediction via Training Dynamics
by: Rabanser, Stephan, et al.
Published: (2022)

Beautiful Images, Toxic Words: Understanding and Addressing Offensive Text in Generated Images
by: Kumar, Aditya, et al.
Published: (2025)

What Does It Take to Build a Performant Selective Classifier?
by: Rabanser, Stephan, et al.
Published: (2025)

Generating Less Certain Adversarial Examples Improves Robust Generalization
by: Zhang, Minxing, et al.
Published: (2023)

Synthetic Artifact Auditing: Tracing LLM-Generated Synthetic Data Usage in Downstream Applications
by: Wu, Yixin, et al.
Published: (2025)

Fairness Feedback Loops: Training on Synthetic Data Amplifies Bias
by: Wyllie, Sierra, et al.
Published: (2024)

Beyond Laplace and Gaussian: Exploring the Generalized Gaussian Mechanism for Private Machine Learning
by: Rinberg, Roy, et al.
Published: (2025)

Precise Parameter Localization for Textual Generation in Diffusion Models
by: Staniszewski, Łukasz, et al.
Published: (2025)

BitMark: Watermarking Bitwise Autoregressive Image Generative Models
by: Kerner, Louis, et al.
Published: (2025)

VARAN: Variational Inference for Self-Supervised Speech Models Fine-Tuning on Downstream Tasks
by: Diatlova, Daria, et al.
Published: (2025)

Task-tailored Pre-processing: Fair Downstream Supervised Learning
by: Sohn, Jinwon, et al.
Published: (2026)