Gespeichert in:
| Hauptverfasser: | , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | https://arxiv.org/abs/2507.09955 |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866915388290236416 |
|---|---|
| author | Xiong, Luolin Wang, Haofen Chen, Xi Sheng, Lu Xiong, Yun Liu, Jingping Xiao, Yanghua Chen, Huajun Han, Qing-Long Tang, Yang |
| author_facet | Xiong, Luolin Wang, Haofen Chen, Xi Sheng, Lu Xiong, Yun Liu, Jingping Xiao, Yanghua Chen, Huajun Han, Qing-Long Tang, Yang |
| contents | DeepSeek, a Chinese Artificial Intelligence (AI) startup, has released their V3 and R1 series models, which attracted global attention due to their low cost, high performance, and open-source advantages. This paper begins by reviewing the evolution of large AI models focusing on paradigm shifts, the mainstream Large Language Model (LLM) paradigm, and the DeepSeek paradigm. Subsequently, the paper highlights novel algorithms introduced by DeepSeek, including Multi-head Latent Attention (MLA), Mixture-of-Experts (MoE), Multi-Token Prediction (MTP), and Group Relative Policy Optimization (GRPO). The paper then explores DeepSeek engineering breakthroughs in LLM scaling, training, inference, and system-level optimization architecture. Moreover, the impact of DeepSeek models on the competitive AI landscape is analyzed, comparing them to mainstream LLMs across various fields. Finally, the paper reflects on the insights gained from DeepSeek innovations and discusses future trends in the technical and engineering development of large AI models, particularly in data, training, and reasoning. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2507_09955 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | DeepSeek: Paradigm Shifts and Technical Evolution in Large AI Models Xiong, Luolin Wang, Haofen Chen, Xi Sheng, Lu Xiong, Yun Liu, Jingping Xiao, Yanghua Chen, Huajun Han, Qing-Long Tang, Yang Artificial Intelligence DeepSeek, a Chinese Artificial Intelligence (AI) startup, has released their V3 and R1 series models, which attracted global attention due to their low cost, high performance, and open-source advantages. This paper begins by reviewing the evolution of large AI models focusing on paradigm shifts, the mainstream Large Language Model (LLM) paradigm, and the DeepSeek paradigm. Subsequently, the paper highlights novel algorithms introduced by DeepSeek, including Multi-head Latent Attention (MLA), Mixture-of-Experts (MoE), Multi-Token Prediction (MTP), and Group Relative Policy Optimization (GRPO). The paper then explores DeepSeek engineering breakthroughs in LLM scaling, training, inference, and system-level optimization architecture. Moreover, the impact of DeepSeek models on the competitive AI landscape is analyzed, comparing them to mainstream LLMs across various fields. Finally, the paper reflects on the insights gained from DeepSeek innovations and discusses future trends in the technical and engineering development of large AI models, particularly in data, training, and reasoning. |
| title | DeepSeek: Paradigm Shifts and Technical Evolution in Large AI Models |
| topic | Artificial Intelligence |
| url | https://arxiv.org/abs/2507.09955 |