Who contributed to Local LLMs on August 18, 2026?

14 developers shipped this update, including Toby, 王金旭, Xuan-Son Nguyen, Pascal, Eve, 030611, ZJY0516, and tlrmchlsmth, and 6 more.

What were the notable Local LLMs updates?

model : BailingMoE3 Support (#26608), model: support speculators-format checkpoints for DSpark (#26275), and [K3] support recoverssm for K3.

Local LLMs

Ollama, llama.cpp, vLLM, and SGLang - running and serving open models locally

Pick a date

Topics: Local LLMs AI / ML Full archive →

The Wire · Showcase

LLAMA.CPP SHIPS BAILINGMOE3 SPEC-DECODING SUPPORT

By RepoJournal · Filed 07:01 UTC on August 18, 2026 · About Local LLMs

14 people shipped this

Toby @aetherbird 1 cited

王金旭 @wjinxu 1 cited

ZJY0516 @ZJY0516 1 cited

tlrmchlsmth @tlrmchlsmth 1 cited

mmangkad @mmangkad 1 cited

Xuan-Son Nguyen @ngxson

Pascal @ServeurpersoCom

Eve @netrunnereve

030611 @030611

mgoin @mgoin

LopezCastroRoberto @LopezCastroRoberto

zhihengy @zhihengy

Lianmin Zheng @merrymercy

ch-wan @ch-wan

llama.cpp lands full BailingMoE3 support with speculative decoding, giving developers a native path for a key emerging sparse MoE family.

llama.cpp's new BailingMoE3 backend [1] is the story to beat this cycle: full weight loading, speculative decoding, Q-LoRA for the Ling-3.0-tiny variant, and a fix for SwiGLU clamps. If you serve sparse experts, this is the upgrade. Right behind it, DSpark checkpoints in the speculators format now load directly in llama.cpp [2], which pairs with vLLM's new RecoverSSM path for Kimi-K3 [3] to make speculative decode on MoE targets dramatically cheaper. Meanwhile, vLLM turns one of its most battle-tested env knobs into a first-class argument: prefix_cache_retention_interval is now a CLI flag, and its default drops to 0 [4], which the team says is "an extremely important setting especially for agentic workloads." That one change could reshape how you size prefix caches for long-horizon agents. sglang is quieter but ships a meaningful accuracy win: with DSA skip-topk layer handling [5], a GLM-5.2-NVFP4 run hits 90.83% pass@1 on AIME25, so if you're chasing reasoning benchmarks, that's the config to copy. With 116 commits and 2 releases across the stack, the headline is clear: MoE speculative decoding just got a whole lot more practical.

Action items

→ Review BailingMoE3 support in llama.cpp and test against your sparse-MoE checkpoints ggml-org/llama.cpp [plan]
→ Migrate VLLM_PREFIX_CACHE_RETENTION_INTERVAL to the new --prefix-cache-retention-interval argument vllm-project/vllm [immediate]
→ Benchmark vLLM RecoverSSM on Kimi-K3 spec decoding to measure state-materialization savings vllm-project/vllm [monitor]

References

[1] model : BailingMoE3 Support (#26608) ggml-org/llama.cpp
[2] model: support speculators-format checkpoints for DSpark (#26275) ggml-org/llama.cpp
[3] [K3] support recoverssm for K3 ↗ vllm-project/vllm
[4] Promote `prefix_cache_retention_interval` to an argument and change the default to 0 ↗ vllm-project/vllm
[5] [DSA] Skip indexer KV cache for skip-topk layers ↗ sgl-project/sglang

Quick answers

What shipped in Local LLMs on August 18, 2026?: llama.cpp lands full BailingMoE3 support with speculative decoding, giving developers a native path for a key emerging sparse MoE family. In total, 116 commits, 116 pull requests, and 2 releases landed.
Who contributed to Local LLMs on August 18, 2026?: 14 developers shipped this update, including Toby, 王金旭, Xuan-Son Nguyen, Pascal, Eve, 030611, ZJY0516, and tlrmchlsmth, and 6 more.
What were the notable Local LLMs updates?: model : BailingMoE3 Support (#26608), model: support speculators-format checkpoints for DSpark (#26275), and [K3] support recoverssm for K3.

OLLAMA FIXES DEADLOCK THAT HUNG CHAT AND GENERATE

A mid-stream parser error in Ollama's server silently wedged chat and generate requests, leaking goroutines and hanging retries until a fix landed overnight.

+14

llms 268 shipped

Local LLMs Aug 17

LLAMA.CPP SHIPS MODEL OPTIMIZATIONS WHILE VLLM AND SGLANG CHASE MEMORY AND SCHEDULING GAINS

Across 87 commits and 5 releases, the local LLM stack is grinding through the unglamorous work that makes inference faster: killing dead code, fixing kernel launches, and removing synchronization bottlenecks.

llms 178 shipped

Local LLMs Aug 16

LLAMA.CPP OVERHAULS INFERENCE FLAGS, VLLM PATCHES DEEPSEEK SPARSE MLA

llama.cpp deprecates mmap flags in favor of unified load-mode, while vllm fixes critical issues blocking DeepSeek-V4-Flash across all decode paths.

+11

llms 136 shipped

Local LLMs Aug 15

QWEN3.8 LANDS IN OLLAMA WITH DEVELOPER INSTRUCTION SUPPORT

Ollama shipped full Qwen3.8 support overnight, adding reasoning-effort semantics and a critical fix for coding agents that send developer instructions before user messages.

+12

llms 208 shipped

Elsewhere on the wire

AI Agents Aug 20

LangChain ships core 1.6.0 with a security warning tucked inside

LangChain's newest core release fixes a tool-injection bug, but the fix itself widens the path for arbitrary code execution.

ai-agents 95 shipped

@CachyOS Aug 20

LINUX-CACHYOS SHIPS 7.2.0-1

CachyOS's custom kernel just advanced to 7.2.0-1, and the sched-ext toolchain is moving in lockstep.

infra 55 shipped

Elixir & Phoenix Aug 20

LIVE VIEW HOOKS GET THE ELOQUENT TREATMENT

Phoenix Live View is shipping a passel of hook and JS-client fixes today, headlined by new beforeUpdate arguments that hand you more control over a hook's lifespan.