Cover Image

Efficient Deep Learning: A Survey on Making Deep Learning Models Smaller, Faster, and Better

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Menghani, Gaurav
Format:	Preprint
Published:	2021
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

LAuReL: Learned Augmented Residual Layer
by: Menghani, Gaurav, et al.
Published: (2024)

GUIDE: Guided Initialization and Distillation of Embeddings
by: Trinh, Khoa, et al.
Published: (2025)

FERRET: Private Deep Learning Faster And Better Than DPSGD
by: Zagardo, David
Published: (2025)

Smaller, Faster, Cheaper: Architectural Designs for Efficient Machine Learning
by: Walton, Steven
Published: (2025)

Smaller But Better: Unifying Layout Generation with Smaller Large Language Models
by: Zhang, Peirong, et al.
Published: (2025)

Resource-Efficient Deep Learning: A Survey on Model-, Arithmetic-, and Implementation-Level Techniques
by: Lee, JunKyu, et al.
Published: (2021)

Earthquake Damage Grades Prediction using An Ensemble Approach Integrating Advanced Machine and Deep Learning Models
by: Panda, Anurag, et al.
Published: (2025)

Deep Learning and Foundation Models for Weather Prediction: A Survey
by: Shi, Jimeng, et al.
Published: (2025)

Sig-DEG for Distillation: Making Diffusion Models Faster and Lighter
by: Jiang, Lei, et al.
Published: (2025)

Hyperbolic Deep Learning for Foundation Models: A Survey
by: He, Neil, et al.
Published: (2025)

Reward Models in Deep Reinforcement Learning: A Survey
by: Yu, Rui, et al.
Published: (2025)

Why and When Deep is Better than Shallow: Implementation-Agnostic State-Transition Model of Deep Learning
by: Sonoda, Sho, et al.
Published: (2025)

A Survey on Deep Tabular Learning
by: Somvanshi, Shriyank, et al.
Published: (2024)

FREE: Faster and Better Data-Free Meta-Learning
by: Wei, Yongxian, et al.
Published: (2024)

A Survey of Deep Learning and Foundation Models for Time Series Forecasting
by: Miller, John A., et al.
Published: (2024)

Faster, Smaller, and Smarter: Task-Aware Expert Merging for Online MoE Inference
by: Han, Ziyi, et al.
Published: (2025)

From Tiny Machine Learning to Tiny Deep Learning: A Survey
by: Somvanshi, Shriyank, et al.
Published: (2025)

A Survey on Uncertainty Quantification Methods for Deep Learning
by: He, Wenchong, et al.
Published: (2023)

Smaller Language Models are Better Black-box Machine-Generated Text Detectors
by: Mireshghallah, Niloofar, et al.
Published: (2023)

500+ Times Faster Than Deep Learning (A Case Study Exploring Faster Methods for Text Mining StackOverflow)
by: Majumder, Suvodeep, et al.
Published: (2018)

A Survey on Explainable Deep Reinforcement Learning
by: Cheng, Zelei, et al.
Published: (2025)

Higher Resolution, Better Generalization: Unlocking Visual Scaling in Deep Reinforcement Learning
by: Trumpp, Raphael, et al.
Published: (2026)

A Survey of State Representation Learning for Deep Reinforcement Learning
by: Echchahed, Ayoub, et al.
Published: (2025)

Efficient Deep Learning with Decorrelated Backpropagation
by: Dalm, Sander, et al.
Published: (2024)

A Survey on State-of-the-art Deep Learning Applications and Challenges
by: Noor, Mohd Halim Mohd, et al.
Published: (2024)

Deep Learning Advancements in Anomaly Detection: A Comprehensive Survey
by: Huang, Haoqi, et al.
Published: (2025)

Deep Reinforcement Learning for Autonomous Cyber Defence: A Survey
by: Palmer, Gregory, et al.
Published: (2023)

Late-to-Early Training: LET LLMs Learn Earlier, So Faster and Better
by: Zhao, Ji, et al.
Published: (2026)

Efficient Preference-Based Reinforcement Learning Using Learned Dynamics Models
by: Liu, Yi, et al.
Published: (2023)

Deep Generative Models in Robotics: A Survey on Learning from Multimodal Demonstrations
by: Urain, Julen, et al.
Published: (2024)

Deep Grokking: Would Deep Neural Networks Generalize Better?
by: Fan, Simin, et al.
Published: (2024)

The AdEMAMix Optimizer: Better, Faster, Older
by: Pagliardini, Matteo, et al.
Published: (2024)

Sparser, Better, Faster, Stronger: Sparsity Detection for Efficient Automatic Differentiation
by: Hill, Adrian, et al.
Published: (2025)

Making Batch Normalization Great in Federated Deep Learning
by: Zhong, Jike, et al.
Published: (2023)

Sample-Efficient Reinforcement Learning Controller for Deep Brain Stimulation in Parkinson's Disease
by: Ravivarapu, Harsh, et al.
Published: (2025)

A Survey Analyzing Generalization in Deep Reinforcement Learning
by: Korkmaz, Ezgi
Published: (2024)

A Survey of Deep Learning: From Activations to Transformers
by: Schneider, Johannes, et al.
Published: (2023)

Calibration in Deep Learning: A Survey of the State-of-the-Art
by: Wang, Cheng
Published: (2023)

Deep Learning for Time Series Forecasting: A Survey
by: Kong, Xiangjie, et al.
Published: (2025)

Plasticity Loss in Deep Reinforcement Learning: A Survey
by: Klein, Timo, et al.
Published: (2024)