The Wire · Showcase
TRANSFORMERS V5.16.0 SHIPS WITH QWEN4-EXP
By RepoJournal · Filed · About Hugging Face
Hugging Face's flagship release lands with a brand-new Qwen architecture that changes how residuals and sparse attention are built.
Transformers v5.16.0 lands with Qwen4-Exp [1], a hybrid model that marries GatedResidual and Qwen Sparse Attention, and it's the kind of release that resets the baseline for the whole stack. The attention mechanism [1] "reduces per-layer KV cache storage requirements" [1], which should make long-context inference materially cheaper for anyone moving to the new checkpoint. While you're upgrading, note that the docs cleanup [2] drops TokenizerFast references, and the video processor now caps pixels per frame [3] for Qwen3-VL, both worth pulling in before your next build. Harbor-HF spent the day stabilizing its agent runner: a Docker Hub quota blowout [4] where four tasks burned both anonymous pull attempts is fixed by collapsing each task image to a single remote copy, and two worker pins [5][6] lock that fix and the leading-hyphen repair [7] into every Terminal-Bench profile. On the tooling side, the ML linter now stops nagging about config plumbing [8] and single-source MoE widths [9], so deepseek and qwen2_moe PRs will stop tripping false positives, and the hub client caches Xet connection info [10] to kill the one-token-request-per-file storm that was rate-limiting 77k-file snapshot downloads. Finally, the CI health dashboard was crying wolf over 2.39M "lost" spans [11] that the privacy filter actually dropped on purpose, so the red alert you saw yesterday was noise.
One email a day. Unsubscribe in one click.
Keep up with Hugging Face in about 3 minutes a day: what actually shipped — the commits, pull requests, releases, and security advisories that matter.
One email a day. Unsubscribe in one click. Read a past issue →
Action items
- → Upgrade transformers to v5.16.0 and test Qwen4-Exp integration before next deploy huggingface/transformers [immediate]
- → Pull the Xet connection caching fix in huggingface_hub if you snapshot large repos huggingface/huggingface_hub [immediate]
- → Adopt the pinned Terminal-Bench workers in harbor-hf to avoid Docker Hub rate limits huggingface/harbor-hf [plan]
- → Update your transformers-mlinter version to clear false positive TRF041/TRF029 reports huggingface/transformers-mlinter [plan]
References
- [1] Release: v5.16.0 ↗ huggingface/transformers
- [2] [docs] Fix links and remove TokenizerFast (#47748) huggingface/transformers
- [3] Add an opt-in per-frame pixel cap (cap_pixels_per_frame) to the Qwen3-VL video processor ↗ huggingface/transformers
- [4] fix(agents): bound task image registry pulls ↗ huggingface/harbor-hf
- [5] chore(workers): pin task-workdir worker ↗ huggingface/harbor-hf
- [6] chore(workers): pin registry-efficient worker ↗ huggingface/harbor-hf
- [7] chore(workers): pin leading-hyphen fix ↗ huggingface/harbor-hf
- [8] exempt plumbing config fields and guard branches from TRF041 (#52) ↗ huggingface/transformers-mlinter
- [9] exempt optional config-field overrides from TRF029 (#53) ↗ huggingface/transformers-mlinter
- [10] [Xet] Cache connection info to avoid one token request per file ↗ huggingface/huggingface_hub
- [11] Stop the privacy filter reading as span loss on CI Health huggingface/transformers-ci