WebLLM: A High-Performance In-Browser LLM Inference Engine

Documenti analoghi

• XGrammar: Flexible and Efficient Structured Generation Engine for Large Language Models
  di: Dong, Yixin, et al.
  Pubblicazione: (2024)
• FlashInfer: Efficient and Customizable Attention Engine for LLM Inference Serving
  di: Ye, Zihao, et al.
  Pubblicazione: (2025)
• Productively Deploying Emerging Models on Emerging Platforms: A Top-Down Approach for Testing and Debugging
  di: Feng, Siyuan, et al.
  Pubblicazione: (2024)
• PithTrain: A Compact and Agent-Native MoE Training System
  di: Lai, Ruihang, et al.
  Pubblicazione: (2026)
• FlashInfer-Bench: Building the Virtuous Cycle for AI-driven LLM Systems
  di: Xing, Shanli, et al.
  Pubblicazione: (2026)