Maximizing Discrimination Capability of Knowledge Distillation with Energy Function
Fuente:
arXiv
Saved in:
| Main Authors: | Kim, Seonghak, Ham, Gyeongdo, Lee, Suin, Jang, Donggon, Kim, Daeshik |
|---|---|
| Format: | Preprint |
| Published: |
2023
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
Robustness-Reinforced Knowledge Distillation with Correlation Distance and Network Pruning
by: Kim, Seonghak, et al.
Published: (2023)
by: Kim, Seonghak, et al.
Published: (2023)
Distilling Balanced Knowledge from a Biased Teacher
by: Kim, Seonghak
Published: (2025)
by: Kim, Seonghak
Published: (2025)
MMR: A Large-scale Benchmark Dataset for Multi-target and Multi-granularity Reasoning Segmentation
by: Jang, Donggon, et al.
Published: (2025)
by: Jang, Donggon, et al.
Published: (2025)
FiGKD: Fine-Grained Knowledge Distillation via High-Frequency Detail Transfer
by: Kim, Seonghak
Published: (2025)
by: Kim, Seonghak
Published: (2025)
Maximizing the Position Embedding for Vision Transformers with Global Average Pooling
by: Lee, Wonjun, et al.
Published: (2025)
by: Lee, Wonjun, et al.
Published: (2025)
Adaptive Teaching with Shared Classifier for Knowledge Distillation
by: Jang, Jaeyeon, et al.
Published: (2024)
by: Jang, Jaeyeon, et al.
Published: (2024)
Lightweight Wasserstein Audio-Visual Model for Unified Speech Enhancement and Separation
by: Park, Jisoo, et al.
Published: (2025)
by: Park, Jisoo, et al.
Published: (2025)
TexTailor: Customized Text-aligned Texturing via Effective Resampling
by: Lee, Suin, et al.
Published: (2025)
by: Lee, Suin, et al.
Published: (2025)
Moiré Zero: An Efficient and High-Performance Neural Architecture for Moiré Removal
by: Lee, Seungryong, et al.
Published: (2025)
by: Lee, Seungryong, et al.
Published: (2025)
Multi-aspect Knowledge Distillation with Large Language Model
by: Lee, Taegyeong, et al.
Published: (2025)
by: Lee, Taegyeong, et al.
Published: (2025)
Co-learning Single-Step Diffusion Upsampler and Downsampler with Two Discriminators and Distillation
by: Kim, Sohwi, et al.
Published: (2024)
by: Kim, Sohwi, et al.
Published: (2024)
LabelDistill: Label-guided Cross-modal Knowledge Distillation for Camera-based 3D Object Detection
by: Kim, Sanmin, et al.
Published: (2024)
by: Kim, Sanmin, et al.
Published: (2024)
CLIP-RD: Relative Distillation for Efficient CLIP Knowledge Distillation
by: Chung, Jeannie, et al.
Published: (2026)
by: Chung, Jeannie, et al.
Published: (2026)
CLR-Face: Conditional Latent Refinement for Blind Face Restoration Using Score-Based Diffusion Models
by: Suin, Maitreya, et al.
Published: (2024)
by: Suin, Maitreya, et al.
Published: (2024)
Scheduling Weight Transitions for Quantization-Aware Training
by: Lee, Junghyup, et al.
Published: (2024)
by: Lee, Junghyup, et al.
Published: (2024)
Stereo-Matching Knowledge Distilled Monocular Depth Estimation Filtered by Multiple Disparity Consistency
by: Ka, Woonghyun, et al.
Published: (2024)
by: Ka, Woonghyun, et al.
Published: (2024)
Distilling Vision-Language Pretraining for Efficient Cross-Modal Retrieval
by: Jang, Young Kyun, et al.
Published: (2024)
by: Jang, Young Kyun, et al.
Published: (2024)
Efficient Few-Shot Neural Architecture Search by Counting the Number of Nonlinear Functions
by: Oh, Youngmin, et al.
Published: (2024)
by: Oh, Youngmin, et al.
Published: (2024)
SDAKD: Student Discriminator Assisted Knowledge Distillation for Super-Resolution Generative Adversarial Networks
by: Kaparinos, Nikolaos, et al.
Published: (2025)
by: Kaparinos, Nikolaos, et al.
Published: (2025)
TIE-KD: Teacher-Independent and Explainable Knowledge Distillation for Monocular Depth Estimation
by: Choi, Sangwon, et al.
Published: (2024)
by: Choi, Sangwon, et al.
Published: (2024)
BridgeTA: Bridging the Representation Gap in Knowledge Distillation via Teacher Assistant for Bird's Eye View Map Segmentation
by: Kim, Beomjun, et al.
Published: (2025)
by: Kim, Beomjun, et al.
Published: (2025)
FYI: Flip Your Images for Dataset Distillation
by: Son, Byunggwan, et al.
Published: (2024)
by: Son, Byunggwan, et al.
Published: (2024)
Indirect Gradient Matching for Adversarial Robust Distillation
by: Lee, Hongsin, et al.
Published: (2023)
by: Lee, Hongsin, et al.
Published: (2023)
Long-tailed Adversarial Training with Self-Distillation
by: Cho, Seungju, et al.
Published: (2025)
by: Cho, Seungju, et al.
Published: (2025)
The Role of Teacher Calibration in Knowledge Distillation
by: Kim, Suyoung, et al.
Published: (2025)
by: Kim, Suyoung, et al.
Published: (2025)
Retrieval-Augmented Score Distillation for Text-to-3D Generation
by: Seo, Junyoung, et al.
Published: (2024)
by: Seo, Junyoung, et al.
Published: (2024)
Toward INT4 Fixed-Point Training via Exploring Quantization Error for Gradients
by: Kim, Dohyung, et al.
Published: (2024)
by: Kim, Dohyung, et al.
Published: (2024)
Energy-Efficient Plant Monitoring via Knowledge Distillation
by: Moummad, Ilyass, et al.
Published: (2026)
by: Moummad, Ilyass, et al.
Published: (2026)
Distribution Matching Distillation without Fake Score Network
by: Kim, Youngjoong, et al.
Published: (2026)
by: Kim, Youngjoong, et al.
Published: (2026)
AI-KD: Adversarial learning and Implicit regularization for self-Knowledge Distillation
by: Kim, Hyungmin, et al.
Published: (2022)
by: Kim, Hyungmin, et al.
Published: (2022)
U-Know-DiffPAN: An Uncertainty-aware Knowledge Distillation Diffusion Framework with Details Enhancement for PAN-Sharpening
by: Kim, Sungpyo, et al.
Published: (2024)
by: Kim, Sungpyo, et al.
Published: (2024)
Zero-Shot Personalization of Objects via Textual Inversion
by: Roy, Aniket, et al.
Published: (2026)
by: Roy, Aniket, et al.
Published: (2026)
RadarDistill: Boosting Radar-based Object Detection Performance via Knowledge Distillation from LiDAR Features
by: Bang, Geonho, et al.
Published: (2024)
by: Bang, Geonho, et al.
Published: (2024)
Diffusion-based Data Augmentation and Knowledge Distillation with Generated Soft Labels Solving Data Scarcity Problems of SAR Oil Spill Segmentation
by: Moon, Jaeho, et al.
Published: (2024)
by: Moon, Jaeho, et al.
Published: (2024)
ReffAKD: Resource-efficient Autoencoder-based Knowledge Distillation
by: Doshi, Divyang, et al.
Published: (2024)
by: Doshi, Divyang, et al.
Published: (2024)
Retrieve What's Missing: Coverage-Maximizing Retrieval for Consistent Long Video Generation
by: Joo, Minseok, et al.
Published: (2026)
by: Joo, Minseok, et al.
Published: (2026)
Generating Humanless Environment Walkthroughs from Egocentric Walking Tour Videos
by: Ham, Yujin, et al.
Published: (2026)
by: Ham, Yujin, et al.
Published: (2026)
Learning with Noisy Labels: Interconnection of Two Expectation-Maximizations
by: Kim, Heewon, et al.
Published: (2024)
by: Kim, Heewon, et al.
Published: (2024)
Decoder-Free Distillation for Quantized Image Restoration
by: Sharif, S. M. A., et al.
Published: (2026)
by: Sharif, S. M. A., et al.
Published: (2026)
Retaining and Enhancing Pre-trained Knowledge in Vision-Language Models with Prompt Ensembling
by: Kim, Donggeun, et al.
Published: (2024)
by: Kim, Donggeun, et al.
Published: (2024)
Similar Items
-
Robustness-Reinforced Knowledge Distillation with Correlation Distance and Network Pruning
by: Kim, Seonghak, et al.
Published: (2023) -
Distilling Balanced Knowledge from a Biased Teacher
by: Kim, Seonghak
Published: (2025) -
MMR: A Large-scale Benchmark Dataset for Multi-target and Multi-granularity Reasoning Segmentation
by: Jang, Donggon, et al.
Published: (2025) -
FiGKD: Fine-Grained Knowledge Distillation via High-Frequency Detail Transfer
by: Kim, Seonghak
Published: (2025) -
Maximizing the Position Embedding for Vision Transformers with Global Average Pooling
by: Lee, Wonjun, et al.
Published: (2025)