NLI:Non-uniform Linear Interpolation Approximation of Nonlinear Operations for Efficient LLMs Inference

Documenti analoghi

• I-LLM: Efficient Integer-Only Inference for Fully-Quantized Low-Bit Large Language Models
  di: Hu, Xing, et al.
  Pubblicazione: (2024)
• Pushing the Limits of BFP on Narrow Precision LLM Inference
  di: Wang, Hui, et al.
  Pubblicazione: (2025)
• OstQuant: Refining Large Language Model Quantization with Orthogonal and Scaling Transformations for Better Distribution Fitting
  di: Hu, Xing, et al.
  Pubblicazione: (2025)
• MoEQuant: Enhancing Quantization for Mixture-of-Experts Large Language Models via Expert-Balanced Sampling and Affinity Guidance
  di: Hu, Xing, et al.
  Pubblicazione: (2025)
• FQ-PETR: Fully Quantized Position Embedding Transformation for Multi-View 3D Object Detection
  di: Yu, Jiangyong, et al.
  Pubblicazione: (2025)