The Wire ยท Showcase
TRANSFORMERS FIXES GPU IMAGE MELTDOWN, TRL GRADUATES KTO TO STABLE
By RepoJournal ยท Filed ยท About Hugging Face
The nightly all-latest-gpu image was broken by a dependency conflict. It's fixed. And KTO just left experimental.
The executorch dependency was uninstalling the pinned cu126 torch in the GPU image, pulling a mismatched CUDA/NCCL stack that crashed at import [1]. That's now removed from the GPU build, and executorch export tests have been reclassified as CPU-only to prevent future cross-stack breakage [2]. In parallel, transformers cleaned up pipeline generators to stop materializing them entirely, which was causing OOMs on complex inputs [3]. Over in TRL, version 1.8.0 promotes KTOTrainer from experimental to stable [4], and trainers now accept DatasetDict and IterableDatasetDict directly as eval_dataset, which means you can pass load_dataset output without reshaping [5]. On the diffusers side, Cosmos3 now has full modular pipeline support with dedicated encoding, denoising, and decoding blocks [6]. In smolagents, transformers 5.13.0 is now pinned out due to a compatibility issue that was breaking CI [7].
Action items
- โ If you test nightly GPU builds: pull the latest transformers immediately, the image is usable again huggingface/transformers [immediate]
- โ Upgrade to TRL 1.8.0 if you're using KTO, update your imports from experimental to top-level huggingface/trl [plan]
- โ Pin transformers != 5.13.0 in any smolagents-dependent projects huggingface/smolagents [plan]
- โ Monitor Cosmos3 modular pipeline adoption if you're building video generation workflows huggingface/diffusers [monitor]
References
- [1] Remove executorch from all-latest-gpu image + add torch smoke test (#47196) huggingface/transformers
- [2] Make executorch exporter tests always use xnnpack backend (#47201) huggingface/transformers
- [3] Cleanup pipelines, stop materializing generators โ huggingface/transformers
- [4] v1.8.0 โ huggingface/trl
- [5] Support DatasetDict and IterableDatasetDict as eval_dataset in trainers โ huggingface/trl
- [6] Cosmos3 ModularPipeline โ huggingface/diffusers
- [7] Fix CI AttributeError: 'str' object has no attribute '__module__' โ huggingface/smolagents