DeepSeek-V4 on Day 0: From Fast Inference to Verified RL with SGLang and Miles
The SGLang; Miles Team
DeepSeek-V4 on Day 0: From Fast Inference to Verified RL with SGLang and Miles
We are thrilled to announce Day-0 support for DeepSeek-V4 across both inference and RL training. SGLang and Miles form the first open-source stack to serve and train DeepSeek-V4 on launch day — with systems purpose-built for its hybrid sparse-attention architecture, manifold-constrained hyper-connections (mHC), and FP4 expert weights.
Figure 1. Decode throughput of SGLang vs the other OSS engine on a 30K-token prompt.