Tuesday, Jun 16, 2026
shippedLLM Compressor v0.12.0 with Transformers v5 support
Recoordinate shipped LLM Compressor v0.12.0, a major release that upgrades to Transformers v5 and adds multi-GPU acceleration for model-free PTQ [ref:1].
The vllm-project/llm-compressor repository received a breaking release with comprehensive Transformers v5 integration, including refactored MoE linearization for improved mixture-of-experts support. The dataset interface was streamlined with a simplified dataset split API. Multi-GPU acceleration for model-free PTQ was added to speed up quantization workflows across multiple devices.
Sources
- v0.12.0 · vllm-project/llm-compressor