Cover Image

Retro: Reusing teacher projection head for efficient embedding distillation on Lightweight Models via Self-supervised Learning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Nguyen, Khanh-Binh, Park, Chae Jung
Format:	Preprint
Published:	2024
Subjects:	Computer Vision and Pattern Recognition Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Symmetric masking strategy enhances the performance of Masked Image Modeling
by: Nguyen, Khanh-Binh, et al.
Published: (2024)

SAVE: Segment Audio-Visual Easy way using Segment Anything Model
by: Nguyen, Khanh-Binh, et al.
Published: (2024)

SOUPLE: Enhancing Audio-Visual Localization and Segmentation with Learnable Prompt Contexts
by: Nguyen, Khanh Binh, et al.
Published: (2026)

MAESIL: Masked Autoencoder for Enhanced Self-supervised Medical Image Learning
by: Kim, Kyeonghun, et al.
Published: (2026)

Efficient and Concise Explanations for Object Detection with Gaussian-Class Activation Mapping Explainer
by: Nguyen, Quoc Khanh, et al.
Published: (2024)

Self-supervised learning of imaging and clinical signatures using a multimodal joint-embedding predictive architecture
by: Li, Thomas Z., et al.
Published: (2025)

FRDiff : Feature Reuse for Universal Training-free Acceleration of Diffusion Models
by: So, Junhyuk, et al.
Published: (2023)

Enhancing the Fairness and Performance of Edge Cameras with Explainable AI
by: Nguyen, Truong Thanh Hung, et al.
Published: (2024)

RetroMotion: Retrocausal Motion Forecasting Models are Instructable
by: Wagner, Royden, et al.
Published: (2025)

Lightweight Models for Emotional Analysis in Video
by: Nguyen, Quoc-Tien, et al.
Published: (2025)

Masked Modeling for Self-supervised Representation Learning on Vision and Beyond
by: Li, Siyuan, et al.
Published: (2023)

Multi-objective hybrid knowledge distillation for efficient deep learning in smart agriculture
by: Hoang, Phi-Hung, et al.
Published: (2025)

CSD-VAR: Content-Style Decomposition in Visual Autoregressive Models
by: Nguyen, Quang-Binh, et al.
Published: (2025)

Sample-efficient Unsupervised Policy Cloning from Ensemble Self-supervised Labeled Videos
by: Liu, Xin, et al.
Published: (2024)

Accelerating Conditional Prompt Learning via Masked Image Modeling for Vision-Language Models
by: Bui, Phuoc-Nguyen, et al.
Published: (2025)

Parallel Rescaling: Rebalancing Consistency Guidance for Personalized Diffusion Models
by: Chae, JungWoo, et al.
Published: (2025)

PointCG: Self-supervised Point Cloud Learning via Joint Completion and Generation
by: Liu, Yun, et al.
Published: (2024)

Spotlighting Partially Visible Cinematic Language for Video-to-Audio Generation via Self-distillation
by: Huang, Feizhen, et al.
Published: (2025)

LiteNeXt: A Novel Lightweight ConvMixer-based Model with Self-embedding Representation Parallel for Medical Image Segmentation
by: Tran, Ngoc-Du, et al.
Published: (2024)

Point Cloud Self-supervised Learning via 3D to Multi-view Masked Learner
by: Chen, Zhimin, et al.
Published: (2023)

PiPa++: Towards Unification of Domain Adaptive Semantic Segmentation via Self-supervised Learning
by: Chen, Mu, et al.
Published: (2024)

Semi-Supervised Semantic Segmentation using Redesigned Self-Training for White Blood Cells
by: Luu, Vinh Quoc, et al.
Published: (2024)

Learning from Pattern Completion: Self-supervised Controllable Generation
by: Chen, Zhiqiang, et al.
Published: (2024)

SPARE: Self-distillation for PARameter-Efficient Removal
by: Mola, Natnael, et al.
Published: (2026)

Structure-aware World Model for Probe Guidance via Large-scale Self-supervised Pre-train
by: Jiang, Haojun, et al.
Published: (2024)

Point-DAE: Denoising Autoencoders for Self-supervised Point Cloud Learning
by: Zhang, Yabin, et al.
Published: (2022)

A Review on Discriminative Self-supervised Learning Methods in Computer Vision
by: Giakoumoglou, Nikolaos, et al.
Published: (2024)

LAFS: Landmark-based Facial Self-supervised Learning for Face Recognition
by: Sun, Zhonglin, et al.
Published: (2024)

Federated Learning for Face Recognition via Intra-subject Self-supervised Learning
by: Kim, Hansol, et al.
Published: (2024)

Ilov3Splat: Instance-Level Open-Vocabulary 3D Scene Understanding in Gaussian Splatting
by: Nguyen, Binh Long, et al.
Published: (2026)

Efficient endometrial carcinoma screening via cross-modal synthesis and gradient distillation
by: Shan, Dongjing, et al.
Published: (2026)

Learning Shared RGB-D Fields: Unified Self-supervised Pre-training for Label-efficient LiDAR-Camera 3D Perception
by: Xu, Xiaohao, et al.
Published: (2024)

From Reusing to Forecasting: Accelerating Diffusion Models with TaylorSeers
by: Liu, Jiacheng, et al.
Published: (2025)

Fast Sampling Through The Reuse Of Attention Maps In Diffusion Models
by: Hunter, Rosco, et al.
Published: (2023)

Continual Self-supervised Learning Considering Medical Domain Knowledge in Chest CT Images
by: Tasai, Ren, et al.
Published: (2025)

Self-supervised Optimization of Hand Pose Estimation using Anatomical Features and Iterative Learning
by: Jauch, Christian, et al.
Published: (2023)

Visual Self-supervised Learning Scheme for Dense Prediction Tasks on X-ray Images
by: Halat, Shervin, et al.
Published: (2023)

MCAD: Multi-teacher Cross-modal Alignment Distillation for efficient image-text retrieval
by: Lei, Youbo, et al.
Published: (2023)

Self-supervised Learning for Hyperspectral Images of Trees
by: Rahman, Moqsadur, et al.
Published: (2025)

Self-supervised Transformation Learning for Equivariant Representations
by: Yu, Jaemyung, et al.
Published: (2025)