vllm 6
- Serving MoE Models: A Deep Dive into Parallelism Strategies (TP, EP, DP)
- Mixture-of-Experts Across the Stack: From a 20-Line Reference to Wide Expert Parallelism
- Where gpu_memory_utilization Actually Goes: vLLM's Memory Budget, Line by Line
- GRPO from First Principles, and How verl Implements It
- How vLLM's `torch.compile` Backend Handles Dynamic Batch Sizes — A Code Walkthrough
- vLLM v1 Deep Dive: How LLM(...) and the Server Boot and Generate