RepoJournal
Hugging Face

@huggingface

Transformers, Datasets, and the open AI-model layer

Keep up with Hugging Face in about 3 minutes a day: what actually shipped — the commits, pull requests, releases, and security advisories that matter.

One email a day. Unsubscribe in one click.

Pick a date

Topics: Python AI / ML Full archive →

The Wire · Showcase

TRANSFORMERS DROPS TORCH 2.4 SUPPORT; DIFFUSERS FIXES LORA COMPILATION BUGS

By RepoJournal · Filed · About Hugging Face

Hugging Face is narrowing its PyTorch version floor while shipping critical fixes across diffusers, transformers, candle, and trl that address tensor allocation, batching, and generation pipeline bugs.

Transformers is ending torch 2.4 support [1], a housekeeping move that signals the team is moving past legacy PyTorch versions. More urgent: a CUDA Graph fix now makes Gemma 4 compilable by solving host-to-device copy issues from scalar tensor allocation [2], and a new vectorized NoRepeatNGramLogitsProcessor removes a performance-blocking host sync point [3]. Meanwhile, diffusers fixed a critical LoRA hot-swapping bug where models with `different_shapes_for_compilation` failed on recompile with tensor size mismatches [4]. Candle patched Qwen3 batching: causal masks were built batch-independently but reshaped as if fully batch-aware, causing batch rows past the first to read garbage and return wrong output [5]. On the feature side, transformers now supports Granite-swa and Granitemoe-swa models with sliding window attention and learnable per-head sinks [6], and a major Rotary module simplification removes redundant device/dtype casting [7]. TRL's DistillationTrainer refactor is in motion: generation switched to GRPO's stack with a deletion-heavy 193/537 PR [8], and a new `_get_last_hidden_state` method lands unwired but ready for chunked JSD loss [9].

One email a day. Unsubscribe in one click.

Action items

References

  1. [1] byebye torch 2.4 ↗ huggingface/transformers
  2. [2] Fix CUDA Graph breaking host to device copy from scalar tensor allocation (#47547) huggingface/transformers
  3. [3] Vectorize NoRepeatNGramLogitsProcessor and remove its host sync (#47571) huggingface/transformers
  4. [4] Fix LoRA hot-swapping recompilation with `different_shapes_for_compilation` (#14297) huggingface/diffusers
  5. [5] fix(qwen3): build causal mask batch-independently (#3582) ↗ huggingface/candle
  6. [6] Add Granite-swa and Granitemoe-swa model support ↗ huggingface/transformers
  7. [7] Simplify all Rotary modules ↗ huggingface/transformers
  8. [8] [DistillationTrainer refactor] Switch generation to GRPO's stack; delete the buffer ↗ huggingface/trl
  9. [9] [DistillationTrainer refactor] Add `_get_last_hidden_state` (unwired) ↗ huggingface/trl

Quick answers

What shipped in Hugging Face on July 30, 2026?
Hugging Face is narrowing its PyTorch version floor while shipping critical fixes across diffusers, transformers, candle, and trl that address tensor allocation, batching, and generation pipeline bugs. In total, 36 commits and 33 pull requests landed.
Who contributed to Hugging Face on July 30, 2026?
13 developers shipped this update, including delmalih, stevhliu, akshan-main, jiqing-feng, Cyrilvallez, daviswer, Harry Mellor, and Hameed Ibrahim, and 5 more.
What were the notable Hugging Face updates?
byebye torch 2.4, Fix CUDA Graph breaking host to device copy from scalar tensor allocation (#47547), and Vectorize NoRepeatNGramLogitsProcessor and remove its host sync (#47571).

More from @huggingface

Daily updates, in your inbox

Follow Hugging Face

Keep up with Hugging Face in about 3 minutes a day: what actually shipped — the commits, pull requests, releases, and security advisories that matter.

or

One email a day. Unsubscribe in one click. Read a past issue →

Elsewhere on the wire

Want every project, not just this one?