blog posts

PD-Multiplexing: Unlocking High-Goodput LLM Serving with GreenContext | LMSYS Org

By Weihao Cui, Yukang Chen, Xiaoze Fan, Han Zhao, Ziyi Xu, Xusheng Chen, Bingsheng He, Quan Chen

This post highlights our initial efforts to support a new serving paradigm, PD-Multiplexing, in SGLang. It is designed t...

7 min read   ·   September 28, 2025   ·   LMSYS BLOG