Who contributed to Local LLMs on August 22, 2026?

15 developers shipped this update, including ParthSareen, hoyyeva, jessegross, Todd Malsbary, Aleksander Grygier, Georgi Gerganov, Juan Pérez de Algaba, and Summer Yang, and 7 more.

What were the notable Local LLMs updates?

v0.5.18, fix(disagg): PD transfer-failure injection was silently inert (#35890), and [DeepSeek V4] Default FP4 checkpoints to FlashInfer MXFP4 MoE.

Local LLMs

Ollama, llama.cpp, vLLM, and SGLang - running and serving open models locally

Pick a date

Topics: Local LLMs AI / ML Full archive →

The Wire · Showcase

SGLang ships v0.5.18 with 710 PRs and DeepSeek V4 FP4 auto-routing

By RepoJournal · Filed 07:01 UTC on August 22, 2026 · About Local LLMs

15 people shipped this

Todd Malsbary @malsbat 2 cited

Fridge003 @Fridge003 2 cited

ParthSareen @ParthSareen 1 cited

hoyyeva @hoyyeva 1 cited

jessegross @jessegross 1 cited

Juan Pérez de Algaba @jperezdealgaba 1 cited

Kevin H. Luu @khluu 1 cited

Tiezhen WANG @xianbaoqian 1 cited

lukealonso @lukealonso 1 cited

Shangming Cai @ShangmingCai 1 cited

Aleksander Grygier @allozaur

Georgi Gerganov @ggerganov

Summer Yang @GirasoleY

DarkSharpness @DarkSharpness

rainj-me @rainj-me

The biggest release of the week just landed: SGLang v0.5.18 adds new models, fixes a silent disagg bug, and defaults DeepSeek V4 FP4 checkpoints to the right MoE runner.

SGLang shipped v0.5.18 [1], its largest release yet, with 710 PRs from 212 contributors and new model support including Muse Glimmer and Intern-S2-Mobius. In the same period, the team patched a critical bug in disaggregated serving where transfer-failure injection was "silently inert" [2], meaning fault-injection tests were not actually testing anything. For DeepSeek V4 users, FP4 checkpoints now default to the FlashInfer MXFP4 MoE runner on SM90, SM100, and SM120 devices [3], removing a common source of silent performance cliffs. Meanwhile, vLLM made headlines with a back-and-forth on Hunyuan: a PR removed native V1 and VL implementations [4], then a revert restored them [5], so if you use Hunyuan expect churn. vLLM also added a b12x FP4 MoE backend for NVIDIA SM120 and SM121 GPUs [6], a meaningful option for Blackwell users. On the kernel front, llama.cpp landed Q5_K and Q2_K ESIMD kernels [7][8], with measured token-gen improvements up to 1.90x on Q2_K, plus a security validation fix in vLLM's decoder prompt-length checks [9]. Ollama's macOS app now supports Claude model management [10] and a new "Connect your apps" experience [11], while an MLX runner fix addresses the "hanging model" symptom caused by cancelled prefills throwing away computed work [12]. Overall, activity across the four repos totaled 131 commits, 126 PRs, and 9 releases this period.

Action items

→ Upgrade to SGLang v0.5.18 to get the disagg fix and new model support sgl-project/sglang [immediate]
→ Check your DeepSeek V4 FP4 deployment: ensure MoE runner is set to auto to pick FlashInfer MXFP4 sgl-project/sglang [immediate]
→ Rebuild llama.cpp with -DGGML_SYCL_ESIMD=ON for the new Q5_K and Q2_K kernels ggml-org/llama.cpp [plan]
→ Watch vLLM's Hunyuan revert churn before pinning to a release vllm-project/vllm [monitor]

References

[1] v0.5.18 ↗ sgl-project/sglang
[2] fix(disagg): PD transfer-failure injection was silently inert (#35890) sgl-project/sglang
[3] [DeepSeek V4] Default FP4 checkpoints to FlashInfer MXFP4 MoE ↗ sgl-project/sglang
[4] Remove native Hunyuan V1 and VL implementations (#53272) vllm-project/vllm
[5] Revert "Remove native Hunyuan V1 and VL implementations" (#53296) vllm-project/vllm
[6] [Kernel] Add b12x FP4 MoE backend ↗ vllm-project/vllm
[7] Add Q5_K ESIMD kernel ↗ ggml-org/llama.cpp
[8] Add Q2_K reordered MMVQ and ESIMD kernels ↗ ggml-org/llama.cpp
[9] (security) fix: enforce decoder prompt-length validation for skip-che… (#46588) vllm-project/vllm
[10] app: claude model management ↗ ollama/ollama
[11] app: add Connect your apps experience ↗ ollama/ollama
[12] mlxrunner: make prefix cache restore points survive cancelled and resumed prefills ↗ ollama/ollama

Quick answers

What shipped in Local LLMs on August 22, 2026?: The biggest release of the week just landed: SGLang v0.5.18 adds new models, fixes a silent disagg bug, and defaults DeepSeek V4 FP4 checkpoints to the right MoE runner. In total, 131 commits, 126 pull requests, and 9 releases landed.
Who contributed to Local LLMs on August 22, 2026?: 15 developers shipped this update, including ParthSareen, hoyyeva, jessegross, Todd Malsbary, Aleksander Grygier, Georgi Gerganov, Juan Pérez de Algaba, and Summer Yang, and 7 more.
What were the notable Local LLMs updates?: v0.5.18, fix(disagg): PD transfer-failure injection was silently inert (#35890), and [DeepSeek V4] Default FP4 checkpoints to FlashInfer MXFP4 MoE.

DeepSeek V4 fuses shared experts, as vLLM ships a security guard

The biggest local-LLM repos are moving fast: DeepSeek V4's MoE kernel gets a massive fusion, while vLLM patches a security hole.

+12

llms 274 shipped

Local LLMs Aug 20

OLLAMA FIXES DEADLOCK THAT HUNG CHAT AND GENERATE

A mid-stream parser error in Ollama's server silently wedged chat and generate requests, leaking goroutines and hanging retries until a fix landed overnight.

+14

llms 268 shipped

Local LLMs Aug 18

LLAMA.CPP SHIPS BAILINGMOE3 SPEC-DECODING SUPPORT

llama.cpp lands full BailingMoE3 support with speculative decoding, giving developers a native path for a key emerging sparse MoE family.

+10

llms 234 shipped

Local LLMs Aug 17

LLAMA.CPP SHIPS MODEL OPTIMIZATIONS WHILE VLLM AND SGLANG CHASE MEMORY AND SCHEDULING GAINS

Across 87 commits and 5 releases, the local LLM stack is grinding through the unglamorous work that makes inference faster: killing dead code, fixing kernel launches, and removing synchronization bottlenecks.