Imagen de Portada

DeepSpeed Data Efficiency: Improving Deep Learning Model Quality and Training Efficiency via Efficient Data Sampling and Routing

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Li, Conglong, Yao, Zhewei, Wu, Xiaoxia, Zhang, Minjia, Holmes, Connor, Li, Cheng, He, Yuxiong
Formato:	Preprint
Publicado:	2022
Materias:	Machine Learning Artificial Intelligence
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

DeepSpeed-FastGen: High-throughput Text Generation for LLMs via MII and DeepSpeed-Inference
por: Holmes, Connor, et al.
Publicado: (2024)

Scaling Vision Transformers: Evaluating DeepSpeed for Image-Centric Workloads
por: Trinh, Huy, et al.
Publicado: (2026)

Computational, Label, and Data Efficiency in Deep Learning for Sparse 3D Data
por: Li, Lanxiao
Publicado: (2024)

MedOrch: Medical Diagnosis with Tool-Augmented Reasoning Agents for Flexible Extensibility
por: He, Yexiao, et al.
Publicado: (2025)

DARE-bench: Evaluating Modeling and Instruction Fidelity of LLMs in Data Science
por: Shu, Fan, et al.
Publicado: (2026)

Deep Learning HASTE for Upper Abdominal MRI: Improved Image Quality, Speed, and Energy Efficiency in a Prospective Study
por: Jennifer Gotta, et al.
Publicado: (2025)

SwiftKV: Fast Prefill-Optimized Inference with Knowledge-Preserving Model Transformation
por: Qiao, Aurick, et al.
Publicado: (2024)

ExCoT: Optimizing Reasoning for Text-to-SQL with Execution Feedback
por: Zhai, Bohan, et al.
Publicado: (2025)

Arctic Long Sequence Training: Scalable And Efficient Training For Multi-Million Token Sequences
por: Bekman, Stas, et al.
Publicado: (2025)

Learning to Hint for Reinforcement Learning
por: Xia, Yu, et al.
Publicado: (2026)

Data-Efficient Training by Evolved Sampling
por: Cheng, Ziheng, et al.
Publicado: (2025)

Symmetric Replay Training: Enhancing Sample Efficiency in Deep Reinforcement Learning for Combinatorial Optimization
por: Kim, Hyeonah, et al.
Publicado: (2023)

Learning to Self-Evolve
por: Chen, Xiaoyin, et al.
Publicado: (2026)

On Improving the Algorithm-, Model-, and Data- Efficiency of Self-Supervised Learning
por: Cao, Yun-Hao, et al.
Publicado: (2024)

FastPersist: Accelerating Model Checkpointing in Deep Learning
por: Wang, Guanhua, et al.
Publicado: (2024)

Energy-Efficient Prediction in Textile Manufacturing: Enhancing Accuracy and Data Efficiency With Ensemble Deep Transfer Learning
por: Chen, Yan-Chen, et al.
Publicado: (2026)

R$^3$-SQL: Ranking Reward and Resampling for Text-to-SQL
por: Han, Hojae, et al.
Publicado: (2026)

Efficiency Robustness of Dynamic Deep Learning Systems
por: Rathnasuriya, Ravishka, et al.
Publicado: (2025)

Deep Learning for Data-Driven Districting-and-Routing
por: Ferraz, Arthur, et al.
Publicado: (2024)

One Sample to Rule Them All: Extreme Data Efficiency in Multidiscipline Reasoning with Reinforcement Learning
por: Li, Yiyuan, et al.
Publicado: (2026)

Improving Sampling Efficiency in RLVR through Adaptive Rollout and Response Reuse
por: Zhang, Yuheng, et al.
Publicado: (2025)

Data-Aware Training Quality Monitoring and Certification for Reliable Deep Learning
por: Yeganegi, Farhang, et al.
Publicado: (2024)

Training Data Efficiency in Multimodal Process Reward Models
por: Li, Jinyuan, et al.
Publicado: (2026)

Improving Memory Efficiency for Training KANs via Meta Learning
por: Zhao, Zhangchi, et al.
Publicado: (2025)

Applying Action Masking and Curriculum Learning Techniques to Improve Data Efficiency and Overall Performance in Operational Technology Cyber Security using Reinforcement Learning
por: Wilson, Alec, et al.
Publicado: (2024)

To Train or Not to Train: Balancing Efficiency and Training Cost in Deep Reinforcement Learning for Mobile Edge Computing
por: Boscaro, Maddalena, et al.
Publicado: (2024)

Deep Reinforcement Learning‐Driven Cooperative Routing for Energy Efficiency in Wireless Multimedia Sensor Networks
por: M. Nagalingayya, et al.
Publicado: (2025)

Agent World Model: Infinity Synthetic Environments for Agentic Reinforcement Learning
por: Wang, Zhaoyang, et al.
Publicado: (2026)

Concept Influence: Leveraging Interpretability to Improve Performance and Efficiency in Training Data Attribution
por: Kowal, Matthew, et al.
Publicado: (2026)

Low-Overhead Receiver Design for Data-Dependent Superimposed Training via Deep Learning
por: Li, Xinjie, et al.
Publicado: (2026)

Safety Filtering While Training: Improving the Performance and Sample Efficiency of Reinforcement Learning Agents
por: Bejarano, Federico Pizarro, et al.
Publicado: (2024)

Improving the Trade-off Between Watermark Strength and Speculative Sampling Efficiency for Language Models
por: He, Weiqing, et al.
Publicado: (2026)

Optical Routing via High Efficiency Composite Acoustic Diffraction
por: Zhao, Yuxiang, et al.
Publicado: (2024)

Quality over Quantity: Boosting Data Efficiency Through Ensembled Multimodal Data Curation
por: Xu, Jinda, et al.
Publicado: (2025)

Training a General Spiking Neural Network with Improved Efficiency and Minimum Latency
por: Yao, Yunpeng, et al.
Publicado: (2024)

Data Efficiency for Large Recommendation Models
por: Jain, Kshitij, et al.
Publicado: (2024)

An Empirical Investigation of Speed Patterns on S‐Curves Using Naturalistic Driving Data and Mixed Logit Model
por: Cailin Lei, et al.
Publicado: (2025)

Advancing Training Efficiency of Deep Spiking Neural Networks through Rate-based Backpropagation
por: Yu, Chengting, et al.
Publicado: (2024)

Biological Neurons Compete with Deep Reinforcement Learning in Sample Efficiency in a Simulated Gameworld
por: Khajehnejad, Moein, et al.
Publicado: (2024)

CrossQ: Batch Normalization in Deep Reinforcement Learning for Greater Sample Efficiency and Simplicity
por: Bhatt, Aditya, et al.
Publicado: (2019)