HMI: Hierarchical Knowledge Management for Efficient Multi-Tenant Inference in Pretrained Language Models

Documenti analoghi

• Train Small, Infer Large: Memory-Efficient LoRA Training for Large Language Models
  di: Zhang, Jun, et al.
  Pubblicazione: (2025)
• Draft & Verify: Lossless Large Language Model Acceleration via Self-Speculative Decoding
  di: Zhang, Jun, et al.
  Pubblicazione: (2023)
• Efficient Inference for Large Vision-Language Models: Bottlenecks, Techniques, and Prospects
  di: Zhang, Jun, et al.
  Pubblicazione: (2026)
• See the Forest for the Trees: Loosely Speculative Decoding via Visual-Semantic Guidance for Efficient Inference of Video LLMs
  di: Ji, Yicheng, et al.
  Pubblicazione: (2026)
• KcMF: A Knowledge-compliant Framework for Schema and Entity Matching with Fine-tuning-free LLMs
  di: Xu, Yongqin, et al.
  Pubblicazione: (2024)