NewYour coding agent can read the release notes before it upgrades.Set up the MCP server →
PyPI, #3266 most downloaded on PyPI
SGLang is a fast serving framework for large language models and vision language models.
Latest stable
0.5.23
Last release 23 days ago
30 Oct 2026
Ships on a steady schedule
a new release about every 2 weeks
Some releases are documented
notes for 29 of the last 60 stable releases
Nothing withdrawn
no release was ever pulled
3 years old
160 releases · first in 2024
Drag across the ruler to compare, or tap a release to open it.
Nothing published for this version
Nothing published for this version
We recently released a blog. Compared to TensorRT-LLM and vLLM, SGLang Runtime consistently delivers superior or competitive performance in both onlin
We recently released a blog. Compared to TensorRT-LLM and vLLM, SGLang Runtime consistently delivers superior or competitive performance in both online and offline scenarios, handling models from Llama-8B to Llama-405B, and on A100 and H100 GPUs, using FP8 and FP16. SGLang consistently outperforms vLLM, achieving up to 3.1x higher throughput on Llama-70B. It also often matches or sometimes outperforms TensorRT-LLM.
We have now automated the release processes for PyPI, Docker, and Release using GitHub workflows. Previously, because Release was not automated, GitHub Tags were not updated in time, leading to a jump from v0.2.0 directly to v0.2.5.
Welcome everyone to try using https://github.com/sgl-project/sglang, and also welcome everyone to actively participate in the community, including but not limited to issues, PRs, and discussions. Cheers!
Your coding agent can read these notes before it upgrades. Set up the MCP server →
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
We performed extensive engineering to improve the base performance. Compared to TensorRT-LLM and vLLM, SGLang now consistently delivers superior or co
global_server_args_dict by @hnyls2002 in https://github.com/sgl-project/sglang/pull/642TokenizerManager.context_len should inherit from `server_args.conte… by @shrirajh in https://github.com/sgl-project/sglang/pull/654Full Changelog: https://github.com/sgl-project/sglang/compare/v0.1.20...v0.2.0
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Code clean up: Remove deprecated prefill move InputMetadata to infer_batch.py by @merrymercy in https://github.com/sgl-project/sglang/pull/609
--enable-p2p-check option by @hnyls2002 in https://github.com/sgl-project/sglang/pull/599LogitsMetadata by @hnyls2002 in https://github.com/sgl-project/sglang/pull/604sgl.gen API by @huyiwen in https://github.com/sgl-project/sglang/pull/503Full Changelog: https://github.com/sgl-project/sglang/compare/v0.1.18...v0.1.20
Nothing published for this version
2x large batch prefill improvement with the new flashinfer kernels #579
Full Changelog: https://github.com/sgl-project/sglang/compare/v0.1.17...v0.1.18
Add speculative execution for OpenAI API #250
--disable-radix-cache by @hnyls2002 in https://github.com/sgl-project/sglang/pull/451Full Changelog: https://github.com/sgl-project/sglang/compare/v0.1.16...v0.1.17
Support more models: DBRX, Command-R, Gemma
model_rpc style improvement by @hnyls2002 in https://github.com/sgl-project/sglang/pull/293model_runner simplify by @hnyls2002 in https://github.com/sgl-project/sglang/pull/329DBRX support by @hnyls2002 in https://github.com/sgl-project/sglang/pull/337command-r by @ZhouXingg in https://github.com/sgl-project/sglang/pull/369fork(1) by @hnyls2002 in https://github.com/sgl-project/sglang/pull/375.isort.cfg by @hnyls2002 in https://github.com/sgl-project/sglang/pull/378sync() when fork(1) by @hnyls2002 in https://github.com/sgl-project/sglang/pull/412input_ids in the input of the /generate endpoint by @lolipopshock in https://github.com/sgl-project/sglang/pull/363Full Changelog: https://github.com/sgl-project/sglang/compare/v0.1.13...v0.1.16
Nothing published for this version
Nothing published for this version
Gemma Support by @hnyls2002 in https://github.com/sgl-project/sglang/pull/256
get_var(var_name) in text iter when stream is not enabled by @exceedzhang in https://github.com/sgl-project/sglang/pull/198agent_calls.jsonl download link by @hnyls2002 in https://github.com/sgl-project/sglang/pull/226set_var to interpreter.py by @1024th in https://github.com/sgl-project/sglang/pull/263server_args by @hnyls2002 in https://github.com/sgl-project/sglang/pull/277Full Changelog: https://github.com/sgl-project/sglang/compare/v0.1.12...v0.1.13
Output logprobs for decoding tokens
--disable-disk-cache by @hnyls2002 in https://github.com/sgl-project/sglang/pull/160Full Changelog: https://github.com/sgl-project/sglang/compare/v0.1.11...v0.1.12
Serve the official release demo of LLaVA v1.6 blog
is_multimodal_model judge by @hnyls2002 in https://github.com/sgl-project/sglang/pull/132Full Changelog: https://github.com/sgl-project/sglang/compare/v0.1.6...v0.1.11
Nothing published for this version
Nothing published for this version
Nothing published for this version
Add OpenAI-compatible API server (Completion and ChatCompletion)
sgl.selectFull Changelog: https://github.com/sgl-project/sglang/compare/v0.1.5...v0.1.6
Fix for T4 GPUs by @Ying1123 in https://github.com/sgl-project/sglang/pull/16
Full Changelog: https://github.com/sgl-project/sglang/compare/v0.1.3...v0.1.5
Nothing published for this version
Nothing published for this version
One column per month.