Cover Image

Self-Distillation of Hidden Layers for Self-Supervised Representation Learning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Lowe, Scott C., Fuller, Anthony, Oore, Sageev, Shelhamer, Evan, Taylor, Graham W.
Format:	Preprint
Published:	2026
Subjects:	Computer Vision and Pattern Recognition Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

An Empirical Study into Clustering of Unseen Datasets with Self-Supervised Encoders
by: Lowe, Scott C., et al.
Published: (2024)

DiffAug: A Diffuse-and-Denoise Augmentation for Training Robust Classifiers
by: Sastry, Chandramouli, et al.
Published: (2023)

LookWhen? Fast Video Recognition by Learning When, Where, and What to Compute
by: Salamatian, Ali, et al.
Published: (2026)

A Closer Look at In-Distribution vs. Out-of-Distribution Accuracy for Open-Set Test-time Adaptation
by: Li, Zefeng, et al.
Published: (2026)

Seeing Syntax: Uncovering Syntactic Learning Limitations in Vision-Language Models
by: Dumpala, Sri Harsha, et al.
Published: (2024)

LookWhere? Efficient Visual Recognition by Learning Where to Look and What to See from Self-Supervision
by: Fuller, Anthony, et al.
Published: (2025)

Sensitivity of Generative VLMs to Semantically and Lexically Altered Prompts
by: Dumpala, Sri Harsha, et al.
Published: (2024)

DOS: Distilling Observable Softmaps of Zipfian Prototypes for Self-Supervised Point Representation
by: Abdelsamad, Mohamed, et al.
Published: (2025)

Seeing the Whole in the Parts in Self-Supervised Representation Learning
by: Aubret, Arthur, et al.
Published: (2025)

Semantic Concentration for Self-Supervised Dense Representations Learning
by: Wen, Peisong, et al.
Published: (2025)

Can Generative Models Improve Self-Supervised Representation Learning?
by: Ayromlou, Sana, et al.
Published: (2024)

ProtoTTA: Prototype-Guided Test-Time Adaptation
by: Abootorabi, Mohammad Mahdi, et al.
Published: (2026)

DRESS: Disentangled Representation-based Self-Supervised Meta-Learning for Diverse Tasks
by: Cui, Wei, et al.
Published: (2025)

Hyperbolic Multimodal Representation Learning for Biological Taxonomies
by: Gong, ZeMing, et al.
Published: (2025)

ADROIT: A Self-Supervised Framework for Learning Robust Representations for Active Learning
by: Banerjee, Soumya, et al.
Published: (2025)

S-JEA: Stacked Joint Embedding Architectures for Self-Supervised Visual Representation Learning
by: Manová, Alžběta, et al.
Published: (2023)

IConE: Batch Independent Collapse Prevention for Self-Supervised Representation Learning
by: Almpanakis, Konstantinos, et al.
Published: (2026)

Extracting Symbolic Sequences from Visual Representations via Self-Supervised Learning
by: Pozos, Victor Sebastian Martinez, et al.
Published: (2025)

Variational Self-Supervised Learning
by: Yavuz, Mehmet Can, et al.
Published: (2025)

Self-Supervised Quantization-Aware Knowledge Distillation
by: Zhao, Kaiqi, et al.
Published: (2024)

ProFeAT: Projected Feature Adversarial Training for Self-Supervised Learning of Robust Representations
by: Addepalli, Sravanti, et al.
Published: (2024)

Self-Supervised Learning by Curvature Alignment
by: Ghojogh, Benyamin, et al.
Published: (2025)

Multi-Level Knowledge Distillation and Dynamic Self-Supervised Learning for Continual Learning
by: Kim, Taeheon, et al.
Published: (2025)

Self-Supervised Learning Using Nonlinear Dependence
by: Sepanj, M. Hadi, et al.
Published: (2025)

On the Generalization and Causal Explanation in Self-Supervised Learning
by: Qiang, Wenwen, et al.
Published: (2024)

Transfer Learning with Self-Supervised Vision Transformers for Snake Identification
by: Miyaguchi, Anthony, et al.
Published: (2024)

Generalized Semi-Supervised Learning via Self-Supervised Feature Adaptation
by: Liang, Jiachen, et al.
Published: (2024)

Self-Supervised Learning of Color Constancy
by: Ernst, Markus R., et al.
Published: (2024)

Dataset Distillation for Pre-Trained Self-Supervised Vision Models
by: Cazenavette, George, et al.
Published: (2025)

Self-Tuning Self-Supervised Image Anomaly Detection
by: Yoo, Jaemin, et al.
Published: (2023)

GrapHist: Graph Self-Supervised Learning for Histopathology
by: Öğüt, Sevda, et al.
Published: (2026)

Soft Equivariance Regularization for Invariant Self-Supervised Learning
by: Lee, Joohyung, et al.
Published: (2026)

Weak Augmentation Guided Relational Self-Supervised Learning
by: Zheng, Mingkai, et al.
Published: (2022)

Explicit Mutual Information Maximization for Self-Supervised Learning
by: Chang, Lele, et al.
Published: (2024)

Automated Measurement of Eczema Severity with Self-Supervised Learning
by: Kumar, Neelesh, et al.
Published: (2025)

Deconstructing Denoising Diffusion Models for Self-Supervised Learning
by: Chen, Xinlei, et al.
Published: (2024)

Dynamically Scaled Temperature in Self-Supervised Contrastive Learning
by: Manna, Siladittya, et al.
Published: (2023)

Zero-Shot Cross-City Generalization in End-to-End Autonomous Driving: Self-Supervised versus Supervised Representations
by: Naeinian, Fatemeh, et al.
Published: (2026)

SelfFed: Self-Supervised Federated Learning for Data Heterogeneity and Label Scarcity in Medical Images
by: Khowaja, Sunder Ali, et al.
Published: (2023)

Self-Supervised Siamese Autoencoders
by: Baier, Friederike, et al.
Published: (2023)