Cover Image

Multi-Level Feature Distillation of Joint Teachers Trained on Distinct Image Datasets

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Iordache, Adrian, Alexe, Bogdan, Ionescu, Radu Tudor
Format:	Preprint
Published:	2024
Subjects:	Computer Vision and Pattern Recognition Artificial Intelligence Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Curriculum Multi-Task Self-Supervision Improves Lightweight Architectures for Onboard Satellite Hyperspectral Image Segmentation
by: Carlesso, Hugo, et al.
Published: (2025)

Machine Unlearning in the Era of Quantum Machine Learning: An Empirical Study
by: Crivoi, Carla, et al.
Published: (2025)

PQPP: A Joint Benchmark for Text-to-Image Prompt and Query Performance Prediction
by: Poesina, Eduard, et al.
Published: (2024)

MTL-MAD: Multi-Task Learners are Effective Medical Anomaly Detectors
by: Bercean, Bogdan Alexandru, et al.
Published: (2026)

Weight Copy and Low-Rank Adaptation for Few-Shot Distillation of Vision Transformers
by: Grigore, Diana-Nicoleta, et al.
Published: (2024)

Towards Few-Call Model Stealing via Active Self-Paced Knowledge Distillation and Diffusion-Based Image Generation
by: Hondru, Vlad, et al.
Published: (2023)

CBM: Curriculum by Masking
by: Jarca, Andrei, et al.
Published: (2024)

ExDDV: A New Dataset for Explainable Deepfake Detection in Video
by: Hondru, Vlad, et al.
Published: (2025)

Masked Image Modeling: A Survey
by: Hondru, Vlad, et al.
Published: (2024)

GeMix: Conditional GAN-Based Mixup for Improved Medical Image Augmentation
by: Carlesso, Hugo, et al.
Published: (2025)

Curriculum-DPO++: Direct Preference Optimization via Data and Model Curricula for Text-to-Image Generation
by: Croitoru, Florinel-Alin, et al.
Published: (2026)

Diffusion Models in Vision: A Survey
by: Croitoru, Florinel-Alin, et al.
Published: (2022)

Lightning Fast Video Anomaly Detection via Adversarial Knowledge Distillation
by: Croitoru, Florinel-Alin, et al.
Published: (2022)

Curriculum Direct Preference Optimization for Diffusion and Consistency Models
by: Croitoru, Florinel-Alin, et al.
Published: (2024)

CL-MAE: Curriculum-Learned Masked Autoencoders
by: Madan, Neelu, et al.
Published: (2023)

MAVOS-DD: Multilingual Audio-Video Open-Set Deepfake Detection Benchmark
by: Croitoru, Florinel-Alin, et al.
Published: (2025)

SegMate: Asymmetric Attention-Based Lightweight Architecture for Efficient Multi-Organ Segmentation
by: Bunea, Andrei-Alexandru, et al.
Published: (2026)

SlotMatch: Distilling Object-Centric Representations for Unsupervised Video Segmentation
by: Grigore, Diana-Nicoleta, et al.
Published: (2025)

VQPP: Video Query Performance Prediction Benchmark
by: Lutu, Adrian Catalin, et al.
Published: (2026)

Dataset Distillation for Pre-Trained Self-Supervised Vision Models
by: Cazenavette, George, et al.
Published: (2025)

PHI-S: Distribution Balancing for Label-Free Multi-Teacher Distillation
by: Ranzinger, Mike, et al.
Published: (2024)

A Study in Dataset Distillation for Image Super-Resolution
by: Dietz, Tobias, et al.
Published: (2025)

On the Diversity and Realism of Distilled Dataset: An Efficient Dataset Distillation Paradigm
by: Sun, Peng, et al.
Published: (2023)

From Fewer Samples to Fewer Bits: Reframing Dataset Distillation as Joint Optimization of Precision and Compactness
by: Dinh, My H., et al.
Published: (2026)

DELT: A Simple Diversity-driven EarlyLate Training for Dataset Distillation
by: Shen, Zhiqiang, et al.
Published: (2024)

Hyperbolic Dataset Distillation
by: Li, Wenyuan, et al.
Published: (2025)

The Role of Teacher Calibration in Knowledge Distillation
by: Kim, Suyoung, et al.
Published: (2025)

DeiT-LT Distillation Strikes Back for Vision Transformer Training on Long-Tailed Datasets
by: Rangwani, Harsh, et al.
Published: (2024)

Generative Dataset Distillation Based on Self-knowledge Distillation
by: Li, Longzhen, et al.
Published: (2025)

Mitigating Bias in Dataset Distillation
by: Cui, Justin, et al.
Published: (2024)

Distilling Dataset into Neural Field
by: Shin, Donghyeok, et al.
Published: (2025)

Teacher as a Lenient Expert: Teacher-Agnostic Data-Free Knowledge Distillation
by: Shin, Hyunjune, et al.
Published: (2024)

Multi-Level Knowledge Distillation and Dynamic Self-Supervised Learning for Continual Learning
by: Kim, Taeheon, et al.
Published: (2025)

Self-Distilled Masked Auto-Encoders are Efficient Video Anomaly Detectors
by: Ristea, Nicolae-Catalin, et al.
Published: (2023)

Good Teachers Explain: Explanation-Enhanced Knowledge Distillation
by: Parchami-Araghi, Amin, et al.
Published: (2024)

Unlocking Dataset Distillation with Diffusion Models
by: Moser, Brian B., et al.
Published: (2024)

Dataset Distillation via the Wasserstein Metric
by: Liu, Haoyang, et al.
Published: (2023)

Importance-Aware Adaptive Dataset Distillation
by: Li, Guang, et al.
Published: (2024)

Masking Teacher and Reinforcing Student for Distilling Vision-Language Models
by: Lee, Byung-Kwan, et al.
Published: (2025)

PRNU-Bench: A Novel Benchmark and Model for PRNU-Based Camera Identification
by: Croitoru, Florinel Alin, et al.
Published: (2025)