Cover Image

Towards Undistillable Models by Minimizing Conditional Mutual Information

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Ye, Linfeng, Hamidi, Shayan Mohajer, Yang, En-hui
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Artificial Intelligence E.4
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Adversarial Training via Adaptive Knowledge Amalgamation of an Ensemble of Teachers
by: Hamidi, Shayan Mohajer, et al.
Published: (2024)

AdaFed: Fair Federated Learning via Adaptive Common Descent Direction
by: Hamidi, Shayan Mohajer, et al.
Published: (2024)

Conditional Mutual Information Based Diffusion Posterior Sampling for Solving Inverse Problems
by: Hamidi, Shayan Mohajer, et al.
Published: (2025)

Bayes Conditional Distribution Estimation for Knowledge Distillation Based on Conditional Mutual Information
by: Ye, Linfeng, et al.
Published: (2024)

Coupled Data and Measurement Space Dynamics for Enhanced Diffusion Posterior Sampling
by: Hamidi, Shayan Mohajer, et al.
Published: (2025)

Coded Deep Learning: Framework and Algorithm
by: Yang, En-hui, et al.
Published: (2025)

Normalized Conditional Mutual Information Surrogate Loss for Deep Neural Classifiers
by: Ye, Linfeng, et al.
Published: (2026)

Distributed Quasi-Newton Method for Fair and Fast Federated Learning
by: Hamidi, Shayan Mohajer, et al.
Published: (2025)

Robustness Against Adversarial Attacks via Learning Confined Adversarial Polytopes
by: Hamidi, Shayan Mohajer, et al.
Published: (2024)

Thundernna: a white box adversarial attack
by: Ye, Linfeng, et al.
Published: (2021)

Enhancing Diffusion Models for Inverse Problems with Covariance-Aware Posterior Sampling
by: Hamidi, Shayan Mohajer, et al.
Published: (2024)

Information-Guided Diffusion Sampling for Dataset Distillation
by: Ye, Linfeng, et al.
Published: (2025)

Over-the-Air Fair Federated Learning via Multi-Objective Optimization
by: Hamidi, Shayan Mohajer, et al.
Published: (2025)

HA-RAG: Hotness-Aware RAG Acceleration via Mixed Precision and Data Placement
by: Ge, Danying, et al.
Published: (2025)

Rotation Invariant Quantization for Model Compression
by: Kampeas, Joseph, et al.
Published: (2023)

How to Train the Teacher Model for Effective Knowledge Distillation
by: Hamidi, Shayan Mohajer, et al.
Published: (2024)

Toward Storage-Aware Learning with Compressed Data An Empirical Exploratory Study on JPEG
by: Lee, Kichang, et al.
Published: (2025)

Rate-Constrained Quantization for Communication-Efficient Federated Learning
by: Hamidi, Shayan Mohajer, et al.
Published: (2024)

Towards Dynamic Feature Acquisition on Medical Time Series by Maximizing Conditional Mutual Information
by: Sergeev, Fedor, et al.
Published: (2024)

Regime-aware financial volatility forecasting via in-context learning
by: Asaad, Saba, et al.
Published: (2026)

Understanding The Effectiveness of Lossy Compression in Machine Learning Training Sets
by: Underwood, Robert, et al.
Published: (2024)

Fairness in Survival Analysis: A Novel Conditional Mutual Information Augmentation Approach
by: Xie, Tianyang, et al.
Published: (2025)

Navigating Potholes with Geometry-Aware Sharpness Minimization
by: Dufort-Labbé, Simon, et al.
Published: (2026)

An Efficient Learning Framework For Federated XGBoost Using Secret Sharing And Distributed Optimization
by: Xie, Lunchen, et al.
Published: (2021)

GP-FL: Model-Based Hessian Estimation for Second-Order Over-the-Air Federated Learning
by: Hamidi, Shayan Mohajer, et al.
Published: (2024)

On the Necessity of Metalearning: Learning Suitable Parameterizations for Learning Processes
by: Hamidi, Massinissa, et al.
Published: (2023)

Tensor Generalized Approximate Message Passing
by: Li, Yinchuan, et al.
Published: (2025)

TStore: Rethinking AI Model Hub with Tensor-Centric Compression
by: Lan, Tingfeng, et al.
Published: (2026)

UpSkill: Mutual Information Skill Learning for Structured Response Diversity in LLMs
by: Shah, Devan, et al.
Published: (2026)

Inductive Graph Alignment Prompt: Bridging the Gap between Graph Pre-training and Inductive Fine-tuning From Spectral Perspective
by: Yan, Yuchen, et al.
Published: (2024)

Robust Multi-Agent Reinforcement Learning by Mutual Information Regularization
by: Li, Simin, et al.
Published: (2023)

Nanoscaling Floating-Point (NxFP): NanoMantissa, Adaptive Microexponents, and Code Recycling for Direct-Cast Compression of Large Language Models
by: Lo, Yun-Chen, et al.
Published: (2024)

FedHypeVAE: Federated Learning with Hypernetwork Generated Conditional VAEs for Differentially Private Embedding Sharing
by: Gupta, Sunny, et al.
Published: (2026)

Mutual Information Regularized Offline Reinforcement Learning
by: Ma, Xiao, et al.
Published: (2022)

Fast Geometric Embedding for Node Influence Maximization
by: Kolpakov, Alexander, et al.
Published: (2025)

The Scaling Law for LoRA Base on Mutual Information Upper Bound
by: Zhang, Jing, et al.
Published: (2025)

Towards Understanding The Calibration Benefits of Sharpness-Aware Minimization
by: Tan, Chengli, et al.
Published: (2025)

Mutual-Taught for Co-adapting Policy and Reward Models
by: Shi, Tianyuan, et al.
Published: (2025)

The Minimal Search Space for Conditional Causal Bandits
by: Simoes, Francisco N. F. Q., et al.
Published: (2025)

Thermodynamic Diffusion Inference with Minimal Digital Conditioning
by: De, Aditi
Published: (2026)