Who contributed to Local LLMs on August 27, 2026?

14 developers shipped this update, including ParthSareen, hoyyeva, jessegross, Dominik Pantaleoni, Aleksander Grygier, Max Krasnyansky, khluu, and VBS2004, and 6 more.

What were the notable Local LLMs updates?

v0.28.0, app: synchronize macOS app handoff, and proxy: continue requests when the model catalog changes.

Local LLMs

Ollama, llama.cpp, vLLM, and SGLang - running and serving open models locally

Pick a date

Topics: Local LLMs AI / ML Full archive →

The Wire · Showcase

vLLM 0.28.0 LANDED WITH 584 COMMITS AND A KIMI-K3 PERFORMANCE PUSH

By RepoJournal · Filed 07:01 UTC on August 27, 2026 · About Local LLMs

14 people shipped this

ParthSareen @ParthSareen 2 cited

jessegross @jessegross 1 cited

Dominik Pantaleoni @dpantaleoni 1 cited

khluu @khluu 1 cited

VBS2004 @VBS2004 1 cited

JustinTong0323 @JustinTong0323 1 cited

hnyls2002 @hnyls2002 1 cited

hoyyeva @hoyyeva

Aleksander Grygier @allozaur

Max Krasnyansky @max-krasnyansky

oliverholworthy @oliverholworthy

Woosuk Kwon @WoosukKwon

Fangzhou-Ai @Fangzhou-Ai

ch-wan @ch-wan

vLLM shipped its biggest release in months, and Ollama quietly fixed a macOS bug that could leave stale app processes running.

vLLM's v0.28.0 release is the big one this cycle, with 584 commits from 270 contributors and a major Kimi-K3 optimization effort spanning Decode Context Parallel and fused FlashKDA kernels [1]. Meanwhile, two Ollama PRs from ParthSareen tackle macOS app process handoff and a proxy race condition that caused intermittent "Claude model catalog changed" errors [2][3]. The handoff change is particularly important: it favors availability, but if the election fails, a stale instance may remain, so test your upgrade path [2]. On the model side, Ollama is removing the MLX gemma3 text-only port because it lacks vision support and could misroute requests [4]. llama.cpp also pushed a chunked SSD MMA optimization for Mamba-2 prefill on Metal, promising parallel matmuls for token sequences that fit 64-token chunks [5]. In sglang, they added day-0 support for Ling-3.0-flash, a hybrid MoE with KDA linear attention and MLA, plus a new beam search feature that runs k-wide beams without a server flag [6][7]. Finally, vLLM fixed a bug where unguarded tool call JSON parsing could take down conversations permanently [8].

Action items

→ Upgrade vLLM to v0.28.0 for the Kimi-K3 performance gains and the chat postprocessing bugfix vllm-project/vllm [immediate]
→ Review the Ollama macOS handoff changes before rolling out to production Macs ollama/ollama [plan]
→ Test sglang's new beam search feature in a staging environment before relying on it sgl-project/sglang [monitor]

References

[1] v0.28.0 ↗ vllm-project/vllm
[2] app: synchronize macOS app handoff ↗ ollama/ollama
[3] proxy: continue requests when the model catalog changes ↗ ollama/ollama
[4] mlx: remove the text-only gemma3 model ↗ ollama/ollama
[5] ggml-metal: add chunked SSD MMA for Mamba-2 prefill optimization ↗ ggml-org/llama.cpp
[6] [Model] Support Ling-3.0-flash (BailingMoeV3) ↗ sgl-project/sglang
[7] [Feature] Beam search support ↗ sgl-project/sglang
[8] [Bugfix] Guard tool call argument JSON parsing in chat message postprocessing ↗ vllm-project/vllm

Quick answers

What shipped in Local LLMs on August 27, 2026?: vLLM shipped its biggest release in months, and Ollama quietly fixed a macOS bug that could leave stale app processes running. In total, 116 commits, 116 pull requests, and 10 releases landed.
Who contributed to Local LLMs on August 27, 2026?: 14 developers shipped this update, including ParthSareen, hoyyeva, jessegross, Dominik Pantaleoni, Aleksander Grygier, Max Krasnyansky, khluu, and VBS2004, and 6 more.
What were the notable Local LLMs updates?: v0.28.0, app: synchronize macOS app handoff, and proxy: continue requests when the model catalog changes.

OLLAMA'S MLX RUNNER NOW SPEAKS STRUCTURED OUTPUT

Ollama closed a silent correctness gap on Apple Silicon, and the LLM inference stack shipped a wave of fixes that touch everything from tool calls to native ARM support.

+14

llms 239 shipped

Local LLMs Aug 25

OLLAMA BOLSTERS CLAUDE DESKTOP, VLLM HARDENS AUDIO PATHS

Ollama's desktop app just made Claude Desktop integration faster and safer to manage, while vLLM closed a security gap on audio file size limits.

llms 229 shipped

Local LLMs Aug 24

VLLM'S P2P WEIGHT SYNC CUTS RL MOE TRANSFER COSTS

Forget all-gathering experts during RL rollout: vLLM's new sharded_rdt backend lets each worker pull only the slice it needs, turning a total_bytes transfer into a total_bytes divided by num_workers one.

llms 180 shipped

Local LLMs Aug 23

SGLang Fixes Pixtral 500s as vLLM Cuts TTFT 25%

The biggest news overnight: SGLang is patching a production-breaking Pixtral bug, and vLLM engineers found a way to shave up to 25% off time-to-first-token on Mamba models.