Dynamic Temperature Scheduler for Knowledge Distillation
Fuente:
arXiv
Saved in:
| Main Authors: | Islam, Sibgat Ul, Ahad, Jawad Ibn, Rahman, Fuad, Amin, Mohammad Ruhul, Mohammed, Nabeel, Rahman, Shafin |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
Beyond Labels: Aligning Large Language Models with Human-like Reasoning
by: Kabir, Muhammad Rafsan, et al.
Published: (2024)
by: Kabir, Muhammad Rafsan, et al.
Published: (2024)
BanglaDialecto: An End-to-End AI-Powered Regional Speech Standardization
by: Samin, Md. Nazmus Sadat, et al.
Published: (2024)
by: Samin, Md. Nazmus Sadat, et al.
Published: (2024)
Empowering Meta-Analysis: Leveraging Large Language Models for Scientific Synthesis
by: Ahad, Jawad Ibn, et al.
Published: (2024)
by: Ahad, Jawad Ibn, et al.
Published: (2024)
Teacher-Guided One-Shot Pruning via Context-Aware Knowledge Distillation
by: Alim, Md. Samiul, et al.
Published: (2025)
by: Alim, Md. Samiul, et al.
Published: (2025)
LAET: A Layer-wise Adaptive Ensemble Tuning Framework for Pretrained Language Models
by: Ahad, Jawad Ibn, et al.
Published: (2025)
by: Ahad, Jawad Ibn, et al.
Published: (2025)
LegalRAG: A Hybrid RAG System for Multilingual Legal Information Retrieval
by: Kabir, Muhammad Rafsan, et al.
Published: (2025)
by: Kabir, Muhammad Rafsan, et al.
Published: (2025)
Label Semantics for Robust Hyperspectral Image Classification
by: Hassan, Rafin, et al.
Published: (2025)
by: Hassan, Rafin, et al.
Published: (2025)
DiffGrad for Physics-Informed Neural Networks
by: Rahman, Jamshaid Ul, et al.
Published: (2024)
by: Rahman, Jamshaid Ul, et al.
Published: (2024)
Improved Bug Localization with AI Agents Leveraging Hypothesis and Dynamic Cognition
by: Samir, Asif Mohammed, et al.
Published: (2026)
by: Samir, Asif Mohammed, et al.
Published: (2026)
Parameter-Efficient Fine-Tuning for Low-Resource Languages: A Comparative Study of LLMs for Bengali Hate Speech Detection
by: Islam, Akif, et al.
Published: (2025)
by: Islam, Akif, et al.
Published: (2025)
VideoLights: Feature Refinement and Cross-Task Alignment Transformer for Joint Video Highlight Detection and Moment Retrieval
by: Paul, Dhiman, et al.
Published: (2024)
by: Paul, Dhiman, et al.
Published: (2024)
Dynamic Temperature Knowledge Distillation
by: Wei, Yukang, et al.
Published: (2024)
by: Wei, Yukang, et al.
Published: (2024)
Consistently Informative Soft-Label Temperature for Knowledge Distillation
by: Luong, Hoang-Chau, et al.
Published: (2026)
by: Luong, Hoang-Chau, et al.
Published: (2026)
Temporal Window Smoothing of Exogenous Variables for Improved Time Series Prediction
by: Kamal, Mustafa, et al.
Published: (2025)
by: Kamal, Mustafa, et al.
Published: (2025)
Enhancement of Bengali OCR by Specialized Models and Advanced Techniques for Diverse Document Types
by: Rabby, AKM Shahariar Azad, et al.
Published: (2024)
by: Rabby, AKM Shahariar Azad, et al.
Published: (2024)
Patient Similarity Computation for Clinical Decision Support: An Efficient Use of Data Transformation, Combining Static and Time Series Data
by: Sana, Joydeb Kumar, et al.
Published: (2025)
by: Sana, Joydeb Kumar, et al.
Published: (2025)
Federated Learning: A Survey on Privacy-Preserving Collaborative Intelligence
by: Rahman, Ratun
Published: (2025)
by: Rahman, Ratun
Published: (2025)
Instance Temperature Knowledge Distillation
by: Zhang, Zhengbo, et al.
Published: (2024)
by: Zhang, Zhengbo, et al.
Published: (2024)
Beyond Real Weights: Hypercomplex Representations for Stable Quantization
by: Ahad, Jawad Ibn, et al.
Published: (2025)
by: Ahad, Jawad Ibn, et al.
Published: (2025)
Predicting life satisfaction using machine learning and explainable AI
by: Khan, Alif Elham, et al.
Published: (2025)
by: Khan, Alif Elham, et al.
Published: (2025)
Feature-Aware Anisotropic Local Differential Privacy for Utility-Preserving Graph Representation Learning in Metal Additive Manufacturing
by: Islam, MD Shafikul, et al.
Published: (2026)
by: Islam, MD Shafikul, et al.
Published: (2026)
Relative Positioning Based Code Chunking Method For Rich Context Retrieval In Repository Level Code Completion Task With Code Language Model
by: Rahman, Imranur, et al.
Published: (2025)
by: Rahman, Imranur, et al.
Published: (2025)
Location Agnostic Adaptive Rain Precipitation Prediction using Deep Learning
by: Islam, Md Shazid, et al.
Published: (2024)
by: Islam, Md Shazid, et al.
Published: (2024)
Graph Neural Diffusion via Generalized Opinion Dynamics
by: Hevapathige, Asela, et al.
Published: (2025)
by: Hevapathige, Asela, et al.
Published: (2025)
Knowledge Distillation on Spatial-Temporal Graph Convolutional Network for Traffic Prediction
by: Izadi, Mohammad, et al.
Published: (2024)
by: Izadi, Mohammad, et al.
Published: (2024)
Reinforcement Learning-Guided Dynamic Multi-Graph Fusion for Evacuation Traffic Prediction
by: Rafi, Md Nafees Fuad, et al.
Published: (2026)
by: Rafi, Md Nafees Fuad, et al.
Published: (2026)
The Laminar Flow Hypothesis: Detecting Jailbreaks via Semantic Turbulence in Large Language Models
by: Rahman, Md. Hasib Ur
Published: (2025)
by: Rahman, Md. Hasib Ur
Published: (2025)
A Small Math Model: Recasting Strategy Choice Theory in an LLM-Inspired Architecture
by: Rahman, Roussel, et al.
Published: (2025)
by: Rahman, Roussel, et al.
Published: (2025)
Latent Variable Modeling in Multi-Agent Reinforcement Learning via Expectation-Maximization for UAV-Based Wildlife Protection
by: Taghavi, Mazyar, et al.
Published: (2025)
by: Taghavi, Mazyar, et al.
Published: (2025)
Detecting the Undetectable: Combining Kolmogorov-Arnold Networks and MLP for AI-Generated Image Detection
by: Anon, Taharim Rahman, et al.
Published: (2024)
by: Anon, Taharim Rahman, et al.
Published: (2024)
PPO-BR: Dual-Signal Entropy-Reward Adaptation for Trust Region Policy Optimization
by: Rahman, Ben
Published: (2025)
by: Rahman, Ben
Published: (2025)
GroundHog: Revolutionizing GLDAS Groundwater Storage Downscaling for Enhanced Recharge Estimation in Bangladesh
by: Ahmed, Saleh Sakib, et al.
Published: (2025)
by: Ahmed, Saleh Sakib, et al.
Published: (2025)
Enhancing IoT Intelligence: A Transformer-based Reinforcement Learning Methodology
by: Rjoub, Gaith, et al.
Published: (2024)
by: Rjoub, Gaith, et al.
Published: (2024)
A Fragile Number Sense: Probing the Elemental Limits of Numerical Reasoning in LLMs
by: Rahman, Roussel, et al.
Published: (2025)
by: Rahman, Roussel, et al.
Published: (2025)
Probabilistic Federated Learning on Uncertain and Heterogeneous Data with Model Personalization
by: Rahman, Ratun, et al.
Published: (2026)
by: Rahman, Ratun, et al.
Published: (2026)
LeMo-NADe: Multi-Parameter Neural Architecture Discovery with LLMs
by: Rahman, Md Hafizur, et al.
Published: (2024)
by: Rahman, Md Hafizur, et al.
Published: (2024)
Predictive Modeling of Homeless Service Assignment: A Representation Learning Approach
by: Rahman, Khandker Sadia, et al.
Published: (2024)
by: Rahman, Khandker Sadia, et al.
Published: (2024)
Mind the Gap: Missing Cyber Threat Coverage in NIDS Datasets for the Energy Sector
by: Tory, Adrita Rahman, et al.
Published: (2025)
by: Tory, Adrita Rahman, et al.
Published: (2025)
Catastrophic Forgetting in Kolmogorov-Arnold Networks
by: Rahman, Mohammad Marufur, et al.
Published: (2025)
by: Rahman, Mohammad Marufur, et al.
Published: (2025)
Importance Analysis for Dynamic Control of Balancing Parameter in a Simple Knowledge Distillation Setting
by: Kim, Seongmin, et al.
Published: (2025)
by: Kim, Seongmin, et al.
Published: (2025)
Similar Items
-
Beyond Labels: Aligning Large Language Models with Human-like Reasoning
by: Kabir, Muhammad Rafsan, et al.
Published: (2024) -
BanglaDialecto: An End-to-End AI-Powered Regional Speech Standardization
by: Samin, Md. Nazmus Sadat, et al.
Published: (2024) -
Empowering Meta-Analysis: Leveraging Large Language Models for Scientific Synthesis
by: Ahad, Jawad Ibn, et al.
Published: (2024) -
Teacher-Guided One-Shot Pruning via Context-Aware Knowledge Distillation
by: Alim, Md. Samiul, et al.
Published: (2025) -
LAET: A Layer-wise Adaptive Ensemble Tuning Framework for Pretrained Language Models
by: Ahad, Jawad Ibn, et al.
Published: (2025)