Song, M., Tang, X., Hou, F., Li, J., Wei, W., Ma, Y., . . . Long, G. (2024). Tackling the Dynamicity in a Production LLM Serving System with SOTA Optimizations via Hybrid Prefill/Decode/Verify Scheduling on Efficient Meta-kernels.
Chicago-Zitierstil (17. Ausg.)Song, Mingcong, et al. Tackling the Dynamicity in a Production LLM Serving System with SOTA Optimizations via Hybrid Prefill/Decode/Verify Scheduling on Efficient Meta-kernels. 2024.
MLA-Zitierstil (9. Ausg.)Song, Mingcong, et al. Tackling the Dynamicity in a Production LLM Serving System with SOTA Optimizations via Hybrid Prefill/Decode/Verify Scheduling on Efficient Meta-kernels. 2024.
Achtung: Diese Zitate sind unter Umständen nicht zu 100% korrekt.