$ the-wire · showcase
SAGE ATTENTION GETS ITS SECOND WIND
By RepoJournal · Filed · About Hugging Face
Sayak Paul re-synced SageAttention with upstream, and suddenly the consumer-GPU video crowd has a reason to care again.
The kernels-community desk leads with sage-attention: Sage and Sage2 are now synced with upstream after a period of staleness, and Sage3 is out of the tree entirely, since it's Blackwell-only and its FP4 mainloop relies on `mma.sync` instructions that CUTLASS only enables for consumer Blackwell (sm120/sm121), not datacenter sm100a [1][2]. The repo also picked up a nested build-toml feature to support the incoming kernel dirs [3], plus an XPU conv1D kernel for causal-conv1d [4]. On the security front, a workflow vulnerability in pr-comment-build.yaml got remediated, so if you run kernels-community in CI, that one is worth a look [5]. Over in diffusers, a callback fix closes a fatal KeyError when users request prompt_embeds or masked_image_latents in pipelines like LEditsPP and SDXL ControlNet Union [6]. TRL is quietly locking down quantization coverage: QLoRA tests now exercise the documented quantization_config argument across SFT, DPO, KTO, and newly GRPO, RLOO, Reward, and Distillation trainers, closing a real coverage gap [7][8]. Transformers is silencing the noise: continuous batching no longer spews five WARNING lines and a progress bar at default verbosity, which is a small win for anyone reading logs in production [9]. And the mlinter repo is prepping 0.1.5, adding the missing TRF058 public-API assertions and fixing two ty diagnostics in trf009 [10].
Action items
- → If you run kernels-community CI, pull the security fix for pr-comment-build.yaml before your next run huggingface/kernels-community [immediate]
- → Review the sage-attention sync if you build for consumer GPUs, and confirm your build.toml still matches huggingface/kernels-community [plan]
- → Watch for the diffusers callback fix to land in a release, and patch when it does huggingface/diffusers [monitor]
References
- [1] sage-attention: sync sage and sage2 ↗ huggingface/kernels-community
- [2] sage-attention: sync sage and sage2 (#1095) huggingface/kernels-community
- [3] feat: Nested build toml support ↗ huggingface/kernels-community
- [4] causal-conv1d: add conv1D kernel for XPU (#1079) huggingface/kernels-community
- [5] fix(security): remediate workflow vulnerability in .github/workflows/pr-comment-build.yaml (#1116) huggingface/kernels-community
- [6] Fix callback tensor inputs that are never bound in the denoising loop (#14416) huggingface/diffusers
- [7] Convert the QLoRA tests to the quantization_config trainer argument ↗ huggingface/trl
- [8] Add a QLoRA test to the trainers that support quantization_config ↗ huggingface/trl
- [9] Quiet continuous batching at default verbosity (#48314) huggingface/transformers
- [10] preparing for 0.1.5 huggingface/transformers-mlinter