Image de couverture de livre

Convex Distillation: Efficient Compression of Deep Networks via Convex Optimization

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Varshney, Prateek, Pilanci, Mert
Format:	Preprint
Publié:	2024
Sujets:	Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Black Boxes and Looking Glasses: Multilevel Symmetries, Reflection Planes, and Convex Optimization in Deep Networks
par: Zeger, Emi, et autres
Publié: (2024)

From Complexity to Clarity: Analytical Expressions of Deep Neural Network Weights via Clifford's Geometric Algebra and Convexity
par: Pilanci, Mert
Publié: (2023)

Analyzing Neural Network-Based Generative Diffusion Models through Convex Optimization
par: Zhang, Fangzhao, et autres
Publié: (2024)

Unveiling Hidden Convexity in Deep Learning: a Sparse Signal Processing Perspective
par: Zeger, Emi, et autres
Publié: (2026)

Adversarial Training of Two-Layer Polynomial and ReLU Activation Networks via Convex Optimization
par: Kuelbs, Daniel, et autres
Publié: (2024)

CRONOS: Enhancing Deep Learning with Scalable GPU Accelerated Convex Neural Networks
par: Feng, Miria, et autres
Publié: (2024)

Convex Relaxations of ReLU Neural Networks Approximate Global Optima in Polynomial Time
par: Kim, Sungyoon, et autres
Publié: (2024)

Fast Convex Optimization for Two-Layer ReLU Networks: Equivalent Model Classes and Cone Decompositions
par: Mishkin, Aaron, et autres
Publié: (2022)

Convex Optimization for Alignment and Preference Learning on a Single GPU
par: Feng, Miria, et autres
Publié: (2026)

Randomized Geometric Algebra Methods for Convex Neural Networks
par: Wang, Yifei, et autres
Publié: (2024)

Convex Low-resource Accent-Robust Language Detection in Speech Recognition
par: Feng, Miria, et autres
Publié: (2026)

Thinking While Listening: Simple Test Time Scaling For Audio Classification
par: Verma, Prateek, et autres
Publié: (2025)

Adaptive Large Language Models By Layerwise Attention Shortcuts
par: Verma, Prateek, et autres
Publié: (2024)

Towards Signal Processing In Large Language Models
par: Verma, Prateek, et autres
Publié: (2024)

Large Language Models Implicitly Learn to See and Hear Just By Reading
par: Verma, Prateek, et autres
Publié: (2025)

Active Learning of Deep Neural Networks via Gradient-Free Cutting Planes
par: Zhang, Erica, et autres
Publié: (2024)

ConvexECG: Lightweight and Explainable Neural Networks for Personalized, Continuous Cardiac Monitoring
par: Ansari, Rayan, et autres
Publié: (2024)

Optimal Sets and Solution Paths of ReLU Networks
par: Mishkin, Aaron, et autres
Publié: (2023)

A Library of Mirrors: Deep Neural Nets in Low Dimensions are Convex Lasso Models with Reflection Features
par: Zeger, Emi, et autres
Publié: (2024)

A Recovery Guarantee for Sparse Neural Networks
par: Fridovich-Keil, Sara, et autres
Publié: (2025)

AdaPTwin: Low-Cost Adaptive Compression of Product Twins in Transformers
par: Biju, Emil, et autres
Publié: (2024)

Exploring the loss landscape of regularized neural networks via convex duality
par: Kim, Sungyoon, et autres
Publié: (2024)

Spectral Adapter: Fine-Tuning in Spectral Space
par: Zhang, Fangzhao, et autres
Publié: (2024)

Are Convex Optimization Curves Convex?
par: Barzilai, Guy, et autres
Publié: (2025)

Riemannian Preconditioned LoRA for Fine-Tuning Foundation Models
par: Zhang, Fangzhao, et autres
Publié: (2024)

Distributed Online Convex Optimization with Compressed Communication: Optimal Regret and Applications
par: Yang, Sifan, et autres
Publié: (2026)

Newton Meets Marchenko-Pastur: Massively Parallel Second-Order Optimization with Hessian Sketching and Debiasing
par: Romanov, Elad, et autres
Publié: (2024)

Optimal and Efficient Algorithms for Decentralized Online Convex Optimization
par: Wan, Yuanyu, et autres
Publié: (2024)

An Efficient Unsupervised Framework for Convex Quadratic Programs via Deep Unrolling
par: Yang, Linxin, et autres
Publié: (2024)

Convex Is Back: Solving Belief MDPs With Convexity-Informed Deep Reinforcement Learning
par: Koutas, Daniel, et autres
Publié: (2025)

Faster Convergence of Stochastic Accelerated Gradient Descent under Interpolation
par: Mishkin, Aaron, et autres
Publié: (2024)

Deep Reinforcement Learning: A Convex Optimization Approach
par: Gattami, Ather
Publié: (2024)

MatRL: Provably Generalizable Iterative Algorithm Discovery via Monte-Carlo Tree Search
par: Kim, Sungyoon, et autres
Publié: (2025)

Probabilistic Circuits with Constraints via Convex Optimization
par: Ghandi, Soroush, et autres
Publié: (2024)

Stabilizing Policy Optimization via Logits Convexity
par: Chen, Hongzhan, et autres
Publié: (2026)

Compressed Proximal Federated Learning for Non-Convex Composite Optimization on Heterogeneous Data
par: Qiu, Pu, et autres
Publié: (2026)

Learning-Augmented Decentralized Online Convex Optimization in Networks
par: Li, Pengfei, et autres
Publié: (2023)

Private and Federated Stochastic Convex Optimization: Efficient Strategies for Centralized Systems
par: Reshef, Roie, et autres
Publié: (2024)

Alternating Regret for Online Convex Optimization
par: Hait, Soumita, et autres
Publié: (2025)

Compressing Large Language Models using Low Rank and Low Precision Decomposition
par: Saha, Rajarshi, et autres
Publié: (2024)