Imagen de Portada

Automatically Planning Optimal Parallel Strategy for Large Language Models

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Li, Zongbiao, Li, Xiezhao, Cui, Yinghao, Chen, Yijun, Gu, Zhixuan, Liu, Yuxuan, Zhu, Wenbo, Jia, Fei, Liu, Ke, Li, Qifeng, Zhan, Junyao, Zhou, Jiangtao, Zhang, Chenxi, Liu, Qike
Formato:	Preprint
Publicado:	2024
Materias:	Artificial Intelligence Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Cerberus: Efficient Inference with Adaptive Parallel Decoding and Sequential Knowledge Enhancement
por: Liu, Yuxuan, et al.
Publicado: (2024)

A conditional normalizing flow for domain decomposed uncertainty quantification
por: Li, Sen, et al.
Publicado: (2024)

Automatic Operator-level Parallelism Planning for Distributed Deep Learning -- A Mixed-Integer Programming Approach
por: She, Ruifeng, et al.
Publicado: (2025)

Deep Learning-Enabled Invisible Electromagnetic Scattering Amplifier
por: Xie, Qike, et al.
Publicado: (2026)

Astra: Efficient and Money-saving Automatic Parallel Strategies Search on Heterogeneous GPUs
por: Wang, Peiran, et al.
Publicado: (2025)

Adaptive high-precision sound source localization at low frequencies based on convolutional neural network
por: Ma, Wenbo, et al.
Publicado: (2024)

UniAP: Unifying Inter- and Intra-Layer Automatic Parallelism by Mixed Integer Quadratic Programming
por: Lin, Hao, et al.
Publicado: (2023)

Diving into 3D Parallelism with Heterogeneous Spot Instance GPUs: Design and Implications
por: Wang, Yuxiao, et al.
Publicado: (2025)

Tautomerization Makes Topological Phase Transition in 2D Organometallic Lattices
por: Junyao Li, et al.
Publicado: (2024)

TAPAS: Fast and Automatic Derivation of Tensor Parallel Strategies for Large Neural Networks
por: Shi, Ziji, et al.
Publicado: (2023)

Model-Informed Generative Adversarial Network (MI-GAN) for Learning Optimal Power Flow
por: Li, Yuxuan, et al.
Publicado: (2022)

Parallelized Planning-Acting for Efficient LLM-based Multi-Agent Systems in Minecraft
por: Li, Yaoru, et al.
Publicado: (2025)

Efficient and Optimal Policy Gradient Algorithm for Corrupted Multi-armed Bandits
por: Liu, Jiayuan, et al.
Publicado: (2025)

RMFA-Net: A Neural ISP for Real RAW to RGB Image Reconstruction
por: Li, Fei, et al.
Publicado: (2024)

CHESS: Context-aware Hierarchical Efficient Semantic Selection for Long-Context LLM Inference
por: Fei, Chao, et al.
Publicado: (2026)

Protein–Protein Interaction Prediction via Structure‐Based Deep Learning
por: Yucong Liu, et al.
Publicado: (2024)

BLADE: Box-Level Supervised Amodal Segmentation through Directed Expansion
por: Liu, Zhaochen, et al.
Publicado: (2024)

SAEN-BGS: Energy-Efficient Spiking AutoEncoder Network for Background Subtraction
por: Zhang, Zhixuan, et al.
Publicado: (2025)

Optimal designs of heterogeneous grid transit networks
por: Fan, Wenbo, et al.
Publicado: (2026)

CVLUE: A New Benchmark Dataset for Chinese Vision-Language Understanding Evaluation
por: Wang, Yuxuan, et al.
Publicado: (2024)

Parallel Graver Basis Extraction for Nonlinear Integer Optimization
por: Liu, Wenbo, et al.
Publicado: (2024)

Time-Optimal Planning for Long-Range Quadrotor Flights: An Automatic Optimal Synthesis Approach
por: Qin, Chao, et al.
Publicado: (2024)

Automatic Network Planning with Digital Radio Twin
por: Li, Xiaomeng, et al.
Publicado: (2025)

SEGA: A Transferable Signed Ensemble Gaussian Black-Box Attack against No-Reference Image Quality Assessment Models
por: Liu, Yujia, et al.
Publicado: (2025)

Graph bundles and Ricci-flatness
por: Li, Wenbo, et al.
Publicado: (2023)

A Data-embedded Solution Paradigm for Nonconvex Probable Event Constrained Optimization
por: Li, Qifeng
Publicado: (2026)

Probable Event Constrained Optimization and A Data-embedded Solution Paradigm
por: Li, Qifeng
Publicado: (2022)

UltraLight VM-UNet: Parallel Vision Mamba Significantly Reduces Parameters for Skin Lesion Segmentation
por: Wu, Renkai, et al.
Publicado: (2024)

The Inhibitory Effects and Its Action Mechanism of Carvone Against Botryosphaeria Dothidea
por: Yawen Li, et al.
Publicado: (2026)

Fe 3+ Oxidation Strategy Enhances the Nonradiative Transition Ability of a Near‐Infrared BODIPY Photosensitizer for Photothermal Therapy
por: Fei Cheng, et al.
Publicado: (2025)

Hydrochemical processes and inorganic nitrogen sources of shallow groundwater in the Sanjiang Plain, northeast China
por: Tingwen Wu, et al.
Publicado: (2024)

A Hybrid Defense Strategy for Boosting Adversarial Robustness in Vision-Language Models
por: Liang, Yuhan, et al.
Publicado: (2024)

A Parallelization Strategy for GRAND with Optimality Guarantee by Exploiting Error Pattern Tree Representation
por: Wan, Li, et al.
Publicado: (2025)

Strategies to Express Soluble Recombinant Apostichopus japonicus Phospholipase A 2 in Escherichia coli and Its Activities
por: Jia Li, et al.
Publicado: (2025)

AIR: Complex Instruction Generation via Automatic Iterative Refinement
por: Liu, Wei, et al.
Publicado: (2025)

FlashEvaluator: Expanding Search Space with Parallel Evaluation
por: Feng, Chao, et al.
Publicado: (2026)

CRepair: CVAE-based Automatic Vulnerability Repair Technology
por: Liu, Penghui, et al.
Publicado: (2024)

The topology of the set of multiple zeta-star values
por: Li, Jiangtao
Publicado: (2023)

On the tangent flow to the collapsing Kähler-Ricci flow on Hirzebruch surfaces
por: Li, Jiangtao
Publicado: (2025)

A generalized Frankel conjecture via the Yang-Mills flow
por: Li, Jiangtao
Publicado: (2025)