Who contributed to Local LLMs on July 28, 2026?

16 developers shipped this update, including ParthSareen, dhiltgen, Aaron Teo, Georgi Gerganov, zql, shalinib-ibm, ronensc, and afriedri, and 8 more.

What were the notable Local LLMs updates?

Improve /prompt rendering performance, cmd/tui: accept file mentions with Enter in the agent TUI, and cmd/tui: keep pipe-delimited prose out of tables.

Local LLMs

Ollama, llama.cpp, vLLM, and SGLang - running and serving open models locally

Pick a date

Topics: Local LLMs AI / ML Full archive →

The Wire · Showcase

OLLAMA REWRITES TUI PERFORMANCE LAYER AS LLAMA.CPP ARMS MEMORY TIERS

By RepoJournal · Filed 07:02 UTC on July 28, 2026 · About Local LLMs

16 people shipped this

ParthSareen @ParthSareen 3 cited

Aaron Teo @taronaeo 1 cited

ColinZ22 @ColinZ22 1 cited

microslaw @microslaw 1 cited

netanel-haber @netanel-haber 1 cited

JustinTong0323 @JustinTong0323 1 cited

yuan-luo @yuan-luo 1 cited

dhiltgen @dhiltgen

Georgi Gerganov @ggerganov

zql @zqlcode

shalinib-ibm @shalinib-ibm

ronensc @ronensc

afriedri @afriedri

zijiexia @zijiexia

longxin9715 @longxin9715

Fridge003 @Fridge003

Ollama shipped three performance wins for the terminal interface while llama.cpp redefines mlock semantics and vLLM closes quant bugs across ROCm and transformer backends.

Ollama's chat TUI got a performance overhaul across three commits. The `/prompt` scrolling cache [1] now snapshots formatted lines at terminal width instead of rebuilding on every frame, eliminating visible lag for large prompts. File mention completion [2] now accepts highlighted references with Enter, keeping cursor position and text flow intact, fixing a root cause where Enter only checked slash completions. The markdown table parser [3] tightened its separator logic to require hyphens in each cell, keeping pipe-delimited prose as text instead of mangling it into tables. Over in llama.cpp, memory management got clearer semantics: the new `-lm mlock` flag [4] specifies memory-lock without mmap, while `-lm mmap+mlock` pairs them together, fixing a call path that was lost during the #20834 refactor. vLLM closed critical bugs blocking inference: per-channel FP8 dequant for GLM-5.2 on ROCm [5], MQA tensor-parallel replication [6], and non-gated MoE support for Nemotron models [7]. Meanwhile, sglang added standalone Qwen3.5 text-only model support [8] and cut spec-v2 host overhead in hybrid-linear MTP decode [9].

Action items

→ Test ollama TUI file completions and table rendering after upgrade ollama/ollama [plan]
→ Verify GLM-5.2 quant checkpoints on ROCm with latest vLLM vllm-project/vllm [plan]
→ Monitor llama.cpp mlock behavior in production after semantics shift ggml-org/llama.cpp [monitor]

References

[1] Improve /prompt rendering performance ↗ ollama/ollama
[2] cmd/tui: accept file mentions with Enter in the agent TUI ↗ ollama/ollama
[3] cmd/tui: keep pipe-delimited prose out of tables ↗ ollama/ollama
[4] arg: add `-lm mlock` where it mlocks but doesnt mmap ↗ ggml-org/llama.cpp
[5] [ROCm] [BugFix] Fix Quark GLM-5.2 Checkpoint inference: indexer wk per-channel FP8 dequant + missing sparse-MLA metadata fields ↗ vllm-project/vllm
[6] Fix MQA with tensor parallelism on transformers modeling backend ↗ vllm-project/vllm
[7] Fix Humming non-gated MoE ↗ vllm-project/vllm
[8] [Model] Support standalone text-only Qwen3.5 checkpoints ↗ sgl-project/sglang
[9] [MTP] Cut spec-v2 host-seam overhead in hybrid-linear MTP decode ↗ sgl-project/sglang

Quick answers

What shipped in Local LLMs on July 28, 2026?: Ollama shipped three performance wins for the terminal interface while llama.cpp redefines mlock semantics and vLLM closes quant bugs across ROCm and transformer backends. In total, 93 commits, 93 pull requests, and 10 releases landed.
Who contributed to Local LLMs on July 28, 2026?: 16 developers shipped this update, including ParthSareen, dhiltgen, Aaron Teo, Georgi Gerganov, zql, shalinib-ibm, ronensc, and afriedri, and 8 more.
What were the notable Local LLMs updates?: Improve /prompt rendering performance, cmd/tui: accept file mentions with Enter in the agent TUI, and cmd/tui: keep pipe-delimited prose out of tables.

OLLAMA RIPS OUT IMAGE GENERATION, LLAMA.CPP SHIPS SPECULATIVE DECODING

Ollama removed its entire MLX image generation pipeline overnight, while llama.cpp landed DSpark speculative decoding and fixed a critical SYCL memory bug affecting Arc GPUs.

+11

llms 239 shipped 2-min read

Local LLMs 2 days ago

LLAMA.CPP SHIPS MINIMAX-M3 SPARSE ATTENTION, VLLM UNLOCKS HETEROGENEOUS PREFILL-DECODE

The inference stack gets a new model architecture and a fundamental shift in how prefill and decode can run on different hardware configurations.

+10

llms 125 shipped 1-min read

Local LLMs 3 days ago

LLAMA.CPP LOCKS DOWN WASM, ADDS MCP STDIO, HEXAGON GETS IM2COL ACCELERATION

llama.cpp disabled OpenMP for Emscripten builds to fix WASM compilation, while shipping full MCP stdio support and unlocking 1.5x to 3.5x latency gains on Hexagon vision models.

llms 139 shipped 2-min read

Local LLMs 4 days ago

OLLAMA LANDS LAGUNA SUPPORT AND CRUSHES MEMORY LEAKS WHILE SGLANG HITS V0.5.16 WITH CONFIDENCE-DRIVEN SPECULATIVE DECODING

Ollama shipped three critical performance and reliability fixes for Metal residency and concurrent access patterns, while SGL-Lang released 0.5.16 with a new speculative algorithm hitting 383.7 tok/s on DeepSeek-V4.

+11

llms 210 shipped 2-min read

Elsewhere on the wire

AI Agents about 4 hours ago

LANGCHAIN CORES SHIP, ANTHROPIC THINKING BLOCKS FIXED, OPENHANDS TIGHTENS WEBSOCKET AUTH

LangChain released two core packages with critical fixes for streaming stability and environment variable handling, while OpenHands closed a security gap that left WebSocket connections unprotected.

ai-agents 119 shipped 1-min read

@CachyOS about 4 hours ago

KERNEL SCHEDULER UPDATES ACROSS BORE AND SCX TOOLING

CachyOS shipped BORE 6.8.0 patches across two kernel series while upgrading its sched-ext ecosystem in parallel, signaling major tuning work ahead.

infra 83 shipped 1-min read

Elixir & Phoenix about 4 hours ago

ELIXIR TIGHTENS ERROR HANDLING ACROSS DATE, ECTO, AND IEXHELPERS

Date.range now surfaces ArgumentError instead of Protocol.UndefinedError when passed invalid step values, catching a class of bugs that silently fail in production code.

elixir 14 shipped 1-min read

@dotnet about 4 hours ago

MAUI CI SCANNER FIXED, MSBUILD ALIGNS TO .NET 10.0.10

A critical MAUI CI pipeline flaw that could pass builds with unscanned device tests is now patched, while MSBuild runtime dependencies ship their first 10.0.10 servicing bump.