Imagen de Portada

SeedFlood: A Step Toward Scalable Decentralized Training of LLMs

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Kim, Jihun, Lee, Namhoon
Formato:	Preprint
Publicado:	2026
Materias:	Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

MemEIC: A Step Toward Continual and Compositional Knowledge Editing
por: Seong, Jin, et al.
Publicado: (2025)

Towards Decentralized and Sustainable Foundation Model Training with the Edge
por: Xue, Leyang, et al.
Publicado: (2025)

TT-FSI: Scalable Faithful Shapley Interactions via Tensor-Train
por: Kim, Ungsik, et al.
Publicado: (2026)

SAFE: Finding Sparse and Flat Minima to Improve Pruning
por: Lee, Dongyeop, et al.
Publicado: (2025)

SASSHA: Sharpness-aware Adaptive Second-order Optimization with Stable Hessian Approximation
por: Shin, Dahun, et al.
Publicado: (2025)

Critical Influence of Overparameterization on Sharpness-aware Minimization
por: Shin, Sungbin, et al.
Publicado: (2023)

Rethinking Pruning Large Language Models: Benefits and Pitfalls of Reconstruction Error Minimization
por: Shin, Sungbin, et al.
Publicado: (2024)

ZIP: An Efficient Zeroth-order Prompt Tuning for Black-box Vision-Language Models
por: Park, Seonghwan, et al.
Publicado: (2025)

Decentralized Arena: Towards Democratic and Scalable Automatic Evaluation of Language Models
por: Yin, Yanbin, et al.
Publicado: (2025)

Generalized Gaussian Temporal Difference Error for Uncertainty-aware Reinforcement Learning
por: Kim, Seyeon, et al.
Publicado: (2024)

Modular MeanFlow: Towards Stable and Scalable One-Step Generative Modeling
por: You, Haochen, et al.
Publicado: (2025)

The Unseen Frontier: Pushing the Limits of LLM Sparsity with Surrogate-Free ADMM
por: Lee, Kwanhee, et al.
Publicado: (2025)

An Analysis of Concept Bottleneck Models: Measuring, Understanding, and Mitigating the Impact of Noisy Annotations
por: Park, Seonghwan, et al.
Publicado: (2025)

The Role of Masking for Efficient Supervised Knowledge Distillation of Vision Transformers
por: Son, Seungwoo, et al.
Publicado: (2023)

Mitigating Staleness in Asynchronous Pipeline Parallelism via Basis Rotation
por: Jung, Hyunji, et al.
Publicado: (2026)

Scalable Decentralized Learning with Teleportation
por: Takezawa, Yuki, et al.
Publicado: (2025)

A Passivity-Based Method for Accelerated Convex Optimisation
por: Cho, Namhoon, et al.
Publicado: (2023)

Optimisation of Structured Neural Controller Based on Continuous-Time Policy Gradient
por: Cho, Namhoon, et al.
Publicado: (2022)

Unveiling the Power of Multiple Gossip Steps: A Stability-Based Generalization Analysis in Decentralized Training
por: Li, Qinglun, et al.
Publicado: (2025)

ORFit: One-Pass Learning via Bridging Orthogonal Gradient Descent and Recursive Least-Squares
por: Min, Youngjae, et al.
Publicado: (2022)

Towards Scalable Handwriting Communication via EEG Decoding and Latent Embedding Integration
por: Kim, Jun-Young, et al.
Publicado: (2024)

Coverage Improvement and Fast Convergence of On-policy Preference Learning
por: Kim, Juno, et al.
Publicado: (2026)

Towards Scalable One-Step Generative Modeling for Autoregressive Dynamical System Forecasting
por: Yang, Tianyue, et al.
Publicado: (2026)

NGDB-Zoo: Towards Efficient and Scalable Neural Graph Databases Training
por: Xie, Zhongwei, et al.
Publicado: (2026)

Towards Scalable Automated Alignment of LLMs: A Survey
por: Cao, Boxi, et al.
Publicado: (2024)

A Survey on Hypergraph Neural Networks: An In-Depth and Step-By-Step Guide
por: Kim, Sunwoo, et al.
Publicado: (2024)

Embracing Unknown Step by Step: Towards Reliable Sparse Training in Real World
por: Lei, Bowen, et al.
Publicado: (2024)

Accelerating Decentralized Optimization via Overlapping Local Steps
por: Zhou, Yijie, et al.
Publicado: (2026)

Active Learning with Selective Time-Step Acquisition for PDEs
por: Kim, Yegon, et al.
Publicado: (2025)

ZeroFlood: Flood Hazard Mapping from Single-Modality SAR Using Geo-Foundation Models
por: Kim, Hyeongkyun, et al.
Publicado: (2025)

Health-SCORE: Towards Scalable Rubrics for Improving Health-LLMs
por: Yang, Zhichao, et al.
Publicado: (2026)

Towards Scalable Topological Regularizers
por: Wong, Hiu-Tung, et al.
Publicado: (2025)

MAGNET: Autonomous Expert Model Generation via Decentralized Autoresearch and BitNet Training
por: Kim, Yongwan, et al.
Publicado: (2026)

Dynamic Deep-Reinforcement-Learning Algorithm in Partially Observable Markov Decision Processes
por: Omi, Saki, et al.
Publicado: (2023)

Toward an Operational GNN-Based Multimesh Surrogate for Fast Flood Forecasting
por: Mercier, Valentin, et al.
Publicado: (2026)

Opportunities in deep learning methods development for computational biology
por: Lee, Alex Jihun, et al.
Publicado: (2024)

Training LLMs for Multi-Step Tool Orchestration with Constrained Data Synthesis and Graduated Rewards
por: Jiayang, Cheng, et al.
Publicado: (2026)

Decentralized Neural Networks for Robust and Scalable Eigenvalue Computation
por: Katende, Ronald
Publicado: (2024)

Fixed Point Neural Acceleration and Inverse Surrogate Model for Battery Parameter Identification
por: Cheon, Hojin, et al.
Publicado: (2025)

AdaGossip: Adaptive Consensus Step-size for Decentralized Deep Learning with Communication Compression
por: Aketi, Sai Aparna, et al.
Publicado: (2024)