RepoJournal
Local LLMs

Local LLMs

Ollama, llama.cpp, vLLM, and SGLang - running and serving open models locally

Keep up with Local LLMs in about 3 minutes a day: what actually shipped — the commits, pull requests, releases, and security advisories that matter.

One email a day. Unsubscribe in one click.

Pick a date

Topics: Local LLMs AI / ML Full archive →

The Wire · Showcase

QWEN3.8 LANDS IN OLLAMA WITH DEVELOPER INSTRUCTION SUPPORT

By RepoJournal · Filed · About Local LLMs

Ollama shipped full Qwen3.8 support overnight, adding reasoning-effort semantics and a critical fix for coding agents that send developer instructions before user messages.

The big story across local LLMs this cycle is Qwen3.8 integration. Ollama added the renderer and MLX import support [3], then immediately followed with developer instruction folding [2] to handle OpenAI-compatible coding patterns that were breaking on Qwen3.5. A third commit [4] fixed a runtime message-ordering issue that was turning valid requests into HTTP 500s. On the vision side, Ollama now transcodes WebP images to PNG before sending them to llama-server [1], filling a gap in format support. Over in llama.cpp, the team shipped MiniMax-Text-01 model support [6] and fixed a quadratic performance regression in jinja template parsing [5]. vLLM landed several infrastructure wins: spec decode now taps the correct pre-norm mixture for Kimi K3 DFlash auxiliary states [7], multimodal encoders eliminate blocking GPU-to-CPU syncs [8], and a KV-cache layout refactor pushes quantization knowledge to backends instead of specs [9]. SGLang rebuilt MiniMax-H3 diffusion outputs on demand to save 24.2 GiB of weights [10] and fused MoE activation epilogues to eliminate intermediate buffer round-trips [11].

One email a day. Unsubscribe in one click.

Action items

References

  1. [1] llm: transcode WebP images for llama-server ↗ ollama/ollama
  2. [2] qwen3.8: support developer instructions ↗ ollama/ollama
  3. [3] qwen3.8: add renderer and MLX import support ↗ ollama/ollama
  4. [4] renderers/qwen: tolerate non-leading system messages (#17757) ollama/ollama
  5. [5] jinja : fix quadratic cost in gather_string_parts (#27034) ggml-org/llama.cpp
  6. [6] model : add support for MiniMaxText01ForCausalLM and MiniMaxM1ForCausalLM (#27018) ggml-org/llama.cpp
  7. [7] [Model][Spec Decode] Tap the pre-norm AttnRes mixture as the Kimi K3 DFlash aux state ↗ vllm-project/vllm
  8. [8] [Perf] Avoid more GPU<->CPU syncs in multimodal encoders ↗ vllm-project/vllm
  9. [9] [5/N][KV-Cache Layout Refactor] Backend-published KV packing via customize_spec ↗ vllm-project/vllm
  10. [10] feat(diffusion): rebuild MiniMax-H3 AdaLN outputs on demand ↗ sgl-project/sglang
  11. [11] [MoE] Fuse swiglu moe up gemm epilogue ↗ sgl-project/sglang

Quick answers

What shipped in Local LLMs on August 15, 2026?
Ollama shipped full Qwen3.8 support overnight, adding reasoning-effort semantics and a critical fix for coding agents that send developer instructions before user messages. In total, 99 commits, 97 pull requests, and 12 releases landed.
Who contributed to Local LLMs on August 15, 2026?
16 developers shipped this update, including dhiltgen, 0, fairydreaming, Hemanth Battu, ngxson, lnigam, rchalamala, and stefankoncarevic, and 8 more.
What were the notable Local LLMs updates?
llm: transcode WebP images for llama-server, qwen3.8: support developer instructions, and qwen3.8: add renderer and MLX import support.

More from Local LLMs

Daily updates, in your inbox

Follow Local LLMs

Keep up with Local LLMs in about 3 minutes a day: what actually shipped — the commits, pull requests, releases, and security advisories that matter.

or

One email a day. Unsubscribe in one click. Read a past issue →

Elsewhere on the wire

Want every project, not just this one?