Imagen de Portada

Bayes Conditional Distribution Estimation for Knowledge Distillation Based on Conditional Mutual Information

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Ye, Linfeng, Hamidi, Shayan Mohajer, Tan, Renhao, Yang, En-Hui
Formato:	Preprint
Publicado:	2024
Materias:	Machine Learning Computer Vision and Pattern Recognition Information Theory 68T30 I.2.6
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Distributional Drift Adaptation with Temporal Conditional Variational Autoencoder for Multivariate Time Series Forecasting
por: He, Hui, et al.
Publicado: (2022)

A General Framework for Clustering and Distribution Matching with Bandit Feedback
por: Yavas, Recep Can, et al.
Publicado: (2024)

Fact Grounded Attention: Eliminating Hallucination in Large Language Models Through Attention Level Knowledge Integration
por: Gupta, Aayush
Publicado: (2025)

A Review on Knowledge Graphs for Healthcare: Resources, Applications, and Promises
por: Cui, Hejie, et al.
Publicado: (2023)

Evaluating Bivariate Causal Statements Based on Mutual Compatibility
por: Jahn, Erik, et al.
Publicado: (2026)

Integration of Deep Reinforcement Learning and Agent-based Simulation to Explore Strategies Counteracting Information Disorder
por: Lomasto, Luigi, et al.
Publicado: (2026)

Semantic Variational Bayes Based on Semantic Information G Theory for Solving Latent Variables
por: Lu, Chenguang
Publicado: (2024)

Knowledge Distillation for Low-Resource Open-source Text-to-SQL Model
por: Qiu, Tianhao, et al.
Publicado: (2026)

Factored Conditional Filtering: Tracking States and Estimating Parameters in High-Dimensional Spaces
por: Chen, Dawei, et al.
Publicado: (2022)

Contrastive Mutual Information Learning: Toward Robust Representations without Positive-Pair Augmentations
por: Livne, Micha
Publicado: (2025)

Realizing Scaling Laws in Recommender Systems: A Foundation-Expert Paradigm for Hyperscale Model Deployment
por: Li, Dai, et al.
Publicado: (2025)

Contrastive MIM: A Contrastive Mutual Information Framework for Unified Generative and Discriminative Representation Learning
por: Livne, Micha
Publicado: (2025)

Adaptive Weighting in Knowledge Distillation: An Axiomatic Framework for Multi-Scale Teacher Ensemble Optimization
por: Flouro, Aaron R., et al.
Publicado: (2026)

Multi-Teacher Ensemble Distillation: A Mathematical Framework for Probability-Domain Knowledge Aggregation
por: Flouro, Aaron R., et al.
Publicado: (2026)

Towards Undistillable Models by Minimizing Conditional Mutual Information
por: Ye, Linfeng, et al.
Publicado: (2025)

MAcPNN: Mutual Assisted Learning on Data Streams with Temporal Dependence
por: Giannini, Federico, et al.
Publicado: (2026)

STRIDE: A Self-Reflective Agent Framework for Reliable Automatic Equation Discovery
por: Su, Jiarui, et al.
Publicado: (2026)

A Knowledge Graph based Approach for Mobile Application Recommendation
por: Zhang, Mingwei, et al.
Publicado: (2020)

Client-Conditional Federated Learning via Local Training Data Statistics
por: Brännvall, Rickard
Publicado: (2026)

Rule Extraction in Machine Learning: Chat Incremental Pattern Constructor
por: Nwokocha, Caleb Princewill
Publicado: (2022)

Stochastic Estimation of the Layer-wise Hessian Trace for Monitoring Neural-network Training
por: Bolshim, Maxim, et al.
Publicado: (2026)

Mind the Metrics: Patterns for Telemetry-Aware In-IDE AI Application Development using the Model Context Protocol (MCP)
por: Koc, Vincent, et al.
Publicado: (2025)

Sentinel-2 for Crop Yield Estimation: A Systematic Review
por: Narimani, Mohammadreza, et al.
Publicado: (2026)

Gradient Descent as Implicit EM in Distance-Based Neural Models
por: Oursland, Alan
Publicado: (2025)

Predicting Traffic Accident Severity with Deep Neural Networks
por: Bibb, Meghan, et al.
Publicado: (2025)

An in-depth look at approximation via deep and narrow neural networks
por: Dommel, Joris, et al.
Publicado: (2025)

Error Detection and Constraint Recovery in Hierarchical Multi-Label Classification without Prior Knowledge
por: Kricheli, Joshua Shay, et al.
Publicado: (2024)

KDSTM: Neural Semi-supervised Topic Modeling with Knowledge Distillation
por: Xu, Weijie, et al.
Publicado: (2023)

Conditional Mutual Information Based Diffusion Posterior Sampling for Solving Inverse Problems
por: Hamidi, Shayan Mohajer, et al.
Publicado: (2025)

Structure and Destructure: Dual Forces in the Making of Knowledge Engines
por: Chen, Yihong
Publicado: (2025)

Rethinking Mutual Information for Language Conditioned Skill Discovery on Imitation Learning
por: Ju, Zhaoxun, et al.
Publicado: (2024)

LLM-supported document separation for printed reviews from zbMATH Open
por: Pluzhnikov, Ivan, et al.
Publicado: (2026)

From Prompt to Graph: Comparing LLM-Based Information Extraction Strategies in Domain-Specific Ontology Development
por: Liu, Xuan, et al.
Publicado: (2026)

Unlocking Advanced Graph Machine Learning Insights through Knowledge Completion on Neo4j Graph Database
por: Napoli, Rosario, et al.
Publicado: (2025)

Enhancing Large Language Models through Neuro-Symbolic Integration and Ontological Reasoning
por: Vsevolodovna, Ruslan Idelfonso Magana, et al.
Publicado: (2025)

Regime-Conditional Retrieval: Theory and a Transferable Router for Two-Hop QA
por: Bacellar, Andre
Publicado: (2026)

Deep Global Clustering for Hyperspectral Image Segmentation: Concepts, Applications, and Open Challenges
por: Chang, Yu-Tang, et al.
Publicado: (2025)

Spectra: Surprising Effectiveness of Pretraining Ternary Language Models at Scale
por: Kaushal, Ayush, et al.
Publicado: (2024)

Computational Hardness of Reinforcement Learning with Partial $q^π$-Realizability
por: Karimi, Shayan, et al.
Publicado: (2025)

Bayesian Learning-driven Prototypical Contrastive Loss for Class-Incremental Learning
por: Raichur, Nisha L., et al.
Publicado: (2024)