Copertina

SambaNova SN40L: Scaling the AI Memory Wall with Dataflow and Composition of Experts

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Prabhakar, Raghu, Sivaramakrishnan, Ram, Gandhi, Darshan, Du, Yun, Wang, Mingran, Song, Xiangyu, Zhang, Kejie, Gao, Tianren, Wang, Angela, Li, Karen, Sheng, Yongning, Brot, Joshua, Sokolov, Denis, Vivek, Apurv, Leung, Calvin, Sabnis, Arjun, Bai, Jiayu, Zhao, Tuowen, Gottscho, Mark, Jackson, David, Luttrell, Mark, Shah, Manish K., Chen, Edison, Liang, Kaizhao, Jain, Swayambhoo, Thakker, Urmish, Huang, Dawei, Jairath, Sumti, Brown, Kevin J., Olukotun, Kunle
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Hardware Architecture Artificial Intelligence C.1.3; C.0
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

SSM-RDU: A Reconfigurable Dataflow Unit for Long-Sequence State-Space Models
di: Ko, Sho, et al.
Pubblicazione: (2025)

Implementing and Optimizing the Scaled Dot-Product Attention on Streaming Dataflow
di: Sohn, Gina, et al.
Pubblicazione: (2024)

Constructing Domain-Specific Evaluation Sets for LLM-as-a-judge
di: Raju, Ravi, et al.
Pubblicazione: (2024)

Revet: A Language and Compiler for Dataflow Threads
di: Rucker, Alexander, et al.
Pubblicazione: (2023)

Composition of Experts: A Modular Compound AI System Leveraging Large Language Models
di: Jain, Swayambhoo, et al.
Pubblicazione: (2024)

SnapStream: Efficient Long Sequence Decoding on Dataflow Accelerators
di: Li, Jonathan, et al.
Pubblicazione: (2025)

DFModel: Design Space Optimization of Large-Scale Systems Exploiting Dataflow Mappings
di: Ko, Sho, et al.
Pubblicazione: (2024)

FuseFlow: A Fusion-Centric Compilation Framework for Sparse Deep Learning on Streaming Dataflow
di: Lacouture, Rubens, et al.
Pubblicazione: (2025)

SambaLingo: Teaching Large Language Models New Languages
di: Csaki, Zoltan, et al.
Pubblicazione: (2024)

Training Domain Draft Models for Speculative Decoding: Best Practices and Insights
di: Hong, Fenglu, et al.
Pubblicazione: (2025)

Agentic Context Engineering: Evolving Contexts for Self-Improving Language Models
di: Zhang, Qizheng, et al.
Pubblicazione: (2025)

LowRA: Accurate and Efficient LoRA Fine-Tuning of LLMs under 2 Bits
di: Zhou, Zikai, et al.
Pubblicazione: (2025)

Adaptive Self-improvement LLM Agentic System for ML Library Development
di: Zhang, Genghan, et al.
Pubblicazione: (2025)

Agentic Plan Caching: Test-Time Memory for Fast and Cost-Efficient LLM Agents
di: Zhang, Qizheng, et al.
Pubblicazione: (2025)

LLMs Know What to Drop: Self-Attention Guided KV Cache Eviction for Efficient Long-Context Inference
di: Wang, Guangtao, et al.
Pubblicazione: (2025)

The Limits of Long-Context Reasoning in Automated Bug Fixing
di: Raju, Ravi, et al.
Pubblicazione: (2026)

Cyclotron: Compilation of Recurrences to Distributed and Systolic Architectures
di: Sundram, Shiv, et al.
Pubblicazione: (2025)

On maximum graphs in Tutte polynomial posets
di: Kahl, Nathan, et al.
Pubblicazione: (2024)

SubgoalXL: Subgoal-based Expert Learning for Theorem Proving
di: Zhao, Xueliang, et al.
Pubblicazione: (2024)

Conservation State of the Deep-water Fish Fauna of the Dutch ABC-islands
di: DeBrot, Dolfi
Pubblicazione: (2025)

Synthetic Document Question Answering in Hungarian
di: Li, Jonathan, et al.
Pubblicazione: (2025)

Test-Time Adaptation via Many-Shot Prompting: Benefits, Limits, and Pitfalls
di: Upasani, Shubhangi, et al.
Pubblicazione: (2026)

Theory Of Smoothpath where it connects to various branches
di: Sarangi, Apurv
Pubblicazione: (2025)

Differentially Private High Dimensional Bandits
di: Shukla, Apurv
Pubblicazione: (2024)

Sieve: Dynamic Expert-Aware PIM Acceleration for Evolving Mixture-of-Experts Models
di: Kim, Jungwoo, et al.
Pubblicazione: (2026)

Streaming Tensor Programs: A Streaming Abstraction for Dynamic Parallelism
di: Sohn, Gina, et al.
Pubblicazione: (2025)

Cross-Family Speculative Prefill: Training-Free Long-Context Compression with Small Draft Models
di: Upasani, Shubhangi, et al.
Pubblicazione: (2026)

New Polynomial Identities and Some Consequences
di: Adegoke, Kunle
Pubblicazione: (2025)

Binomial Transforms and the Binomial Convolution of Sequences
di: Adegoke, Kunle
Pubblicazione: (2025)

A Short Proof of Knuth's Old Sum
di: Adegoke, Kunle
Pubblicazione: (2024)

On Touchard's Identity: Generalizations and Related Results
di: Adegoke, Kunle
Pubblicazione: (2026)

On Series Involving Cubed Catalan Numbers
di: Adegoke, Kunle
Pubblicazione: (2026)

Prevention Programmes for Urban Violence Exposure and Their Impact on Mental Health and Academic Performance Among Nigerian Youth
di: Olukotun, Folasade, et al.
Pubblicazione: (2008)

Dynamical 4-D Gauss-Bonnet action from matter-graviton interactions in a curved background
di: Keer, Apurv, et al.
Pubblicazione: (2026)

Does culture matter in corporate cash holdings?
di: Yongning Deng, et al.
Pubblicazione: (2024)

Pericardial hydatid cysts presenting with atrial flutter and mitral regurgitation
di: Bhavik Sandip Shah, et al.
Pubblicazione: (2024)

AccelOpt: A Self-Improving LLM Agentic System for AI Accelerator Kernel Optimization
di: Zhang, Genghan, et al.
Pubblicazione: (2025)

Observer Time from Causality in Perturbative Quantum Gravity
di: Sivaramakrishnan, Allic
Pubblicazione: (2025)

Correlators of Worldline Proper Length
di: Sivaramakrishnan, Allic
Pubblicazione: (2024)

Data-driven robust Markov decision processes on Borel spaces: performance guarantees via an axiomatic approach
di: Ramani, Sivaramakrishnan
Pubblicazione: (2026)