The Wire · Showcase
OLLAMA CLEANS UP LINT PIPELINE AS LLAMA.CPP ADDS SPECULATIVE DRAFTING FOR GLM-5.2
By RepoJournal · Filed · About Local LLMs
Ollama's CI now scans the entire codebase instead of just changed lines, unblocking larger PRs that were silently accumulating lint violations across their diffs.
The shift fixes a critical gap in golangci-lint's only-new-issues mode, which filters findings down to touched lines and drops issues introduced at a distance where the report anchors to an untouched line [1]. Daniel Hiltgen's follow-up PR cleans the tree of existing violations so dependent work lands without carrying unrelated fixes [2]. Meanwhile, Jesse Gross improved speculative decoding diagnostics by logging per-request stats at info level instead of debug, capturing every speculative round to surface throughput issues [3]. Across llama.cpp, the project shipped two releases with expanded speculative decoding support: GLM-5.2 now has NextN/MTP drafting via the --spec-type draft-mtp target [4], and RDNA3.5 tuning configs can now be optimized independently [5]. On the performance front, a new SYCL contiguous fast path eliminates redundant 64-bit integer math from unary elementwise ops, cutting SILU kernel time from 3.2 ms down toward the 0.63 ms bandwidth floor [6]. The same release cycle adds MTP draft support for mimo2 architecture, preserving trunk-only GGUFs while building the MiMo-specific graph with fused attention and shared-head fallbacks [7].
One email a day. Unsubscribe in one click.
Keep up with Local LLMs in about 3 minutes a day: what actually shipped — the commits, pull requests, releases, and security advisories that matter.
One email a day. Unsubscribe in one click. Read a past issue →
Action items
- → Land dependent PRs against ollama/ollama now that CI lint cleanup is merged ollama/ollama [plan]
- → Test GLM-5.2 speculative decoding on llama.cpp if you serve Chinese reasoning models ggml-org/llama.cpp [monitor]
- → Pull SYCL fast-path release (b10175) for Intel Xe GPU deployments ggml-org/llama.cpp [plan]
References
- [1] CI: enable lint on the whole tree (#17457) ollama/ollama
- [2] lint: clean up current tree ↗ ollama/ollama
- [3] mlxrunner: count every speculative round and log stats at info ollama/ollama
- [4] b10174 ↗ ggml-org/llama.cpp
- [5] b10175 ↗ ggml-org/llama.cpp
- [6] sycl: contiguous fast path + 32-bit index math for unary elementwise ops ↗ ggml-org/llama.cpp
- [7] mimo2: add MTP draft support ↗ ggml-org/llama.cpp