blog posts

PD-Multiplexing: Unlocking High-Goodput LLM Serving with GreenContext - LMSYS Blog | LMSYS Org

By Weihao Cui, Yukang Chen, Xiaoze Fan, Han Zhao, Ziyi Xu, Xusheng Chen, Bingsheng He, Quan Chen

This post highlights our initial efforts to support a new serving paradigm, PD-Multiplexing, in SGLang. It is designed to deliver higher goodput in LLM serving. PD-Multiplexing leverages GreenContext,...

7 min read   ·   September 28, 2025   ·   LMSYS BLOG