Home » Uncategorized » Page 158

Category: Uncategorized

LightLLM v1. zero. 1 supports single-machine and multi-machine tensor parallel deployment intended for DeepSeek-R1 (FP8/BF16) plus provides mixed-precision deployment, with more quantization modes continuously integrated. Additionally, LightLLM gives PD-disaggregation deployment for DeepSeek-V2, and the implementation of PD-disaggregation for DeepSeek-V3 will…

Back to top