Cover Image

Self-Supervised Dataset Distillation for Transfer Learning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Lee, Dong Bok, Lee, Seanie, Ko, Joonho, Kawaguchi, Kenji, Lee, Juho, Hwang, Sung Ju
Format:	Preprint
Published:	2023
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Set-based Meta-Interpolation for Few-Task Meta-Learning
by: Lee, Seanie, et al.
Published: (2022)

Drug Discovery with Dynamic Goal-aware Fragments
by: Lee, Seul, et al.
Published: (2023)

HarmAug: Effective Data Augmentation for Knowledge Distillation of Safety Guard Models
by: Lee, Seanie, et al.
Published: (2024)

FedSVD: Adaptive Orthogonalization for Private Federated Learning with LoRA
by: Lee, Seanie, et al.
Published: (2025)

Cost-Sensitive Multi-Fidelity Bayesian Optimization with Transfer of Learning Curve Extrapolation
by: Lee, Dong Bok, et al.
Published: (2024)

FedRand: Enhancing Privacy in Federated Learning with Randomized LoRA Subparameter Updates
by: Park, Sangwoo, et al.
Published: (2025)

DiffusionNAG: Predictor-guided Neural Architecture Generation with Diffusion Models
by: An, Sohyun, et al.
Published: (2023)

PCoreSet: Effective Active Learning through Knowledge Distillation from Vision-Language Models
by: Kang, Seongjae, et al.
Published: (2025)

Learning diverse attacks on large language models for robust red-teaming and safety tuning
by: Lee, Seanie, et al.
Published: (2024)

Simple yet Effective Semi-supervised Knowledge Distillation from Vision-Language Models via Dual-Head Optimization
by: Kang, Seongjae, et al.
Published: (2025)

It Takes Two: Complementary Self-Distillation for Contextual Integrity in LLMs
by: Park, Sangwoo, et al.
Published: (2026)

Efficient Real-time Refinement of Language Model Text Generation
by: Ko, Joonho, et al.
Published: (2025)

Cost-Sensitive Freeze-thaw Bayesian Optimization for Efficient Hyperparameter Tuning
by: Lee, Dong Bok, et al.
Published: (2025)

Bayesian Neural Scaling Law Extrapolation with Prior-Data Fitted Networks
by: Lee, Dongwoo, et al.
Published: (2025)

Soft Equivariance Regularization for Invariant Self-Supervised Learning
by: Lee, Joohyung, et al.
Published: (2026)

Riemannian Diffusion Models on General Manifolds via Physics-Informed Neural Networks
by: Ko, Gyeonghoon, et al.
Published: (2026)

Permutation-Symmetrized Diffusion for Unconditional Molecular Generation
by: Ko, Gyeonghoon, et al.
Published: (2026)

Geodesic Flow Kernels for Semi-Supervised Learning on Mixed-Variable Tabular Dataset
by: Hwang, Yoontae, et al.
Published: (2024)

Enhancing Transfer Learning with Flexible Nonparametric Posterior Sampling
by: Lee, Hyungi, et al.
Published: (2024)

Concept-skill Transferability-based Data Selection for Large Vision-Language Models
by: Lee, Jaewoo, et al.
Published: (2024)

SafeRoute: Adaptive Model Selection for Efficient and Accurate Safety Guardrails in Large Language Models
by: Lee, Seanie, et al.
Published: (2025)

Learning Infinitesimal Generators of Continuous Symmetries from Data
by: Ko, Gyeonghoon, et al.
Published: (2024)

GFlowPO: Generative Flow Network as a Language Model Prompt Optimizer
by: Cho, Junmo, et al.
Published: (2026)

(FL)$^2$: Overcoming Few Labels in Federated Semi-Supervised Learning
by: Lee, Seungjoo, et al.
Published: (2024)

Improving Constrained Language Generation via Self-Distilled Twisted Sequential Monte Carlo
by: Kim, Sooyeon, et al.
Published: (2025)

Active Learning with Selective Time-Step Acquisition for PDEs
by: Kim, Yegon, et al.
Published: (2025)

Delta Attention: Fast and Accurate Sparse Attention Inference by Delta Correction
by: Willette, Jeffrey, et al.
Published: (2025)

Geometric Embedding Alignment via Curvature Matching in Transfer Learning
by: Ko, Sung Moon, et al.
Published: (2025)

Mol-LLaMA: Towards General Understanding of Molecules in Large Molecular Language Model
by: Kim, Dongki, et al.
Published: (2025)

ES-Merging: Biological MLLM Merging via Embedding Space Signals
by: Lee, Wonbin, et al.
Published: (2026)

Understanding Self-supervised Contrastive Learning through Supervised Objectives
by: Lee, Byeongchan
Published: (2025)

Practical Dataset Distillation Based on Deep Support Vectors
by: Lee, Hyunho, et al.
Published: (2024)

Variational Bayesian Pseudo-Coreset
by: Lee, Hyungi, et al.
Published: (2025)

Visualizing the loss landscape of Self-supervised Vision Transformer
by: Lee, Youngwan, et al.
Published: (2024)

RL-BioAug: Label-Efficient Reinforcement Learning for Self-Supervised EEG Representation Learning
by: Lee, Cheol-Hui, et al.
Published: (2026)

SelfReplay: Adapting Self-Supervised Sensory Models via Adaptive Meta-Task Replay
by: Yoon, Hyungjun, et al.
Published: (2024)

Joint-Embedding Masked Autoencoder for Self-supervised Learning of Dynamic Functional Connectivity from the Human Brain
by: Choi, Jungwon, et al.
Published: (2024)

SAGE: Shaping Anchors for Guided Exploration in RLVR of LLMs
by: Lee, Chanuk, et al.
Published: (2026)

BECoTTA: Input-dependent Online Blending of Experts for Continual Test-time Adaptation
by: Lee, Daeun, et al.
Published: (2024)

HINT-SD: Targeted Hindsight Self-Distillation for Long-Horizon Agents
by: Yeo, Woongyeng, et al.
Published: (2026)