Imagen de Portada

Scaling Up Data Parallelism in Decentralized Deep Learning

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Xie, Bing, Yin, Junqi, Zhou, Zhenyu, Oral, Sarp, Wang, Feiyi
Formato:	Preprint
Publicado:	2025
Materias:	Machine Learning Artificial Intelligence
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Data Readiness for Scientific AI at Scale
por: Brewer, Wesley, et al.
Publicado: (2025)

Piper: Efficient Large-Scale MoE Training via Resource Modeling and Pipelined Hybrid Parallelism
por: Dash, Sajal, et al.
Publicado: (2026)

CUER: Corrected Uniform Experience Replay for Off-Policy Continuous Deep Reinforcement Learning Algorithms
por: Yenicesu, Arda Sarp, et al.
Publicado: (2024)

Tula: Optimizing Time, Cost, and Generalization in Distributed Large-Batch Training
por: Tyagi, Sahil, et al.
Publicado: (2026)

Meta-Learning for Speeding Up Large Model Inference in Decentralized Environments
por: Du, Yipeng, et al.
Publicado: (2025)

SimBa: Simplicity Bias for Scaling Up Parameters in Deep Reinforcement Learning
por: Lee, Hojoon, et al.
Publicado: (2024)

The Impact of On-Policy Parallelized Data Collection on Deep Reinforcement Learning Networks
por: Mayor, Walter, et al.
Publicado: (2025)

Scalable Artificial Intelligence for Science: Perspectives, Methods and Exemplars
por: Brewer, Wesley, et al.
Publicado: (2024)

Overcoming Data and Model Heterogeneities in Decentralized Federated Learning via Synthetic Anchors
por: Huang, Chun-Yin, et al.
Publicado: (2024)

Intelligent Sampling of Extreme-Scale Turbulence Datasets for Accurate and Efficient Spatiotemporal Model Training
por: Brewer, Wesley, et al.
Publicado: (2025)

SciTrust 2.0: A Comprehensive Framework for Evaluating Trustworthiness of Large Language Models in Scientific Applications
por: Herron, Emily, et al.
Publicado: (2025)

Beyond Model Collapse: Scaling Up with Synthesized Data Requires Verification
por: Feng, Yunzhen, et al.
Publicado: (2024)

UA-PDFL: A Personalized Approach for Decentralized Federated Learning
por: Zhu, Hangyu, et al.
Publicado: (2024)

Generalizing Differentially Private Decentralized Deep Learning with Multi-Agent Consensus
por: Bayrooti, Jasmine, et al.
Publicado: (2023)

OledFL: Unleashing the Potential of Decentralized Federated Learning via Opposite Lookahead Enhancement
por: Li, Qinglun, et al.
Publicado: (2024)

Model Parallelism With Subnetwork Data Parallelism
por: Singh, Vaibhav, et al.
Publicado: (2025)

dFLMoE: Decentralized Federated Learning via Mixture of Experts for Medical Data Analysis
por: Xie, Luyuan, et al.
Publicado: (2025)

Position: AI Scaling: From Up to Down and Out
por: Wang, Yunke, et al.
Publicado: (2025)

Efficient Learning of Fuzzy Logic Systems for Large-Scale Data Using Deep Learning
por: Koklu, Ata, et al.
Publicado: (2024)

Exploring Adversarial Robustness of Deep State Space Models
por: Qi, Biqing, et al.
Publicado: (2024)

Scaling Up Bayesian DAG Sampling
por: Nikzad, Daniele, et al.
Publicado: (2025)

Few-Shot Class-Incremental Learning with Non-IID Decentralized Data
por: Liu, Cuiwei, et al.
Publicado: (2024)

Scaling Decentralized Learning with FLock
por: Cheng, Zehua, et al.
Publicado: (2025)

Accelerating Large-Scale Dataset Distillation via Exploration-Exploitation Optimization
por: Alahmadi, Muhammad J., et al.
Publicado: (2026)

Automated Discovery of Integral with Deep Learning
por: Yin, Xiaoxin
Publicado: (2024)

Generalized Parallel Scaling with Interdependent Generations
por: Dong, Harry, et al.
Publicado: (2025)

Abstracting Geo-specific Terrains to Scale Up Reinforcement Learning
por: Ustun, Volkan, et al.
Publicado: (2025)

MultiConfederated Learning: Inclusive Non-IID Data handling with Decentralized Federated Learning
por: Duchesne, Michael, et al.
Publicado: (2024)

Guided Model Merging for Hybrid Data Learning: Leveraging Centralized Data to Refine Decentralized Models
por: Zhu, Junyi, et al.
Publicado: (2025)

Decentralized Structural-RNN for Robot Crowd Navigation with Deep Reinforcement Learning
por: Liu, Shuijing, et al.
Publicado: (2020)

MIDUS: Memory-Infused Depth Up-Scaling
por: Kim, Taero, et al.
Publicado: (2025)

Asymmetric Advantage Modulation Calibrates Entropy Dynamics in RLVR
por: Gu, Hengrui, et al.
Publicado: (2026)

Meta-Learning for Speeding Up Large Model Inference in Decentralized Environments
por: Yang, Yuzhe, et al.
Publicado: (2024)

FedMABench: Benchmarking Mobile Agents on Decentralized Heterogeneous User Data
por: Wang, Wenhao, et al.
Publicado: (2025)

Parallel Structures in Pre-training Data Yield In-Context Learning
por: Chen, Yanda, et al.
Publicado: (2024)

A priori Estimates for Deep Residual Network in Continuous-time Reinforcement Learning
por: Yin, Shuyu, et al.
Publicado: (2024)

DyC-STG: Dynamic Causal Spatio-Temporal Graph Network for Real-time Data Credibility Analysis in IoT
por: Cheng, Guanjie, et al.
Publicado: (2025)

Scaling Up Probabilistic Circuits by Latent Variable Distillation
por: Liu, Anji, et al.
Publicado: (2022)

Robust Counterfactual Explanations in Machine Learning: A Survey
por: Jiang, Junqi, et al.
Publicado: (2024)

Network Sparsity Unlocks the Scaling Potential of Deep Reinforcement Learning
por: Ma, Guozheng, et al.
Publicado: (2025)