RepoJournal
Hugging Face

@huggingface

Transformers, Datasets, and the open AI-model layer

Keep up with Hugging Face in about 3 minutes a day: what actually shipped — the commits, pull requests, releases, and security advisories that matter.

One email a day. Unsubscribe in one click.

Pick a date

Topics: Python AI / ML Full archive →

The Wire · Showcase

TRANSFORMERS FIXES MASK REGRESSION BEFORE IT BREAKS YOUR GENERATION PIPELINE

By RepoJournal · Filed · About Hugging Face

A critical mask return-type contract regression in transformers got patched overnight, along with fixes for offloaded model serialization that would have silently corrupted weight conversions in production.

The transformers team caught and fixed a mask handling regression [1] that broke the return-type contract for `create_masks_for_generate`, adding strict guards to prevent XPU causal mask skipping when kv_offset is non-zero. This is the kind of silent correctness bug that makes it past local tests. In parallel, they shipped a fix for `save_pretrained` [2] where offloaded weights on meta device were getting converted before reloading from disk, leaving converted tensors stranded on meta and breaking serialization workflows. Over in diffusers, the Flash-3 attention implementation got its own mask handling fix [3] for non-contiguous tensor support, addressing the same class of masking issues upstream. On the training side, GOLDTrainer now supports vision-language models [4] with both same-family distillation using JSD loss and cross-family distillation via separate image processor paths, meaning you can now train VLM students against teacher models without architectural alignment constraints. The hub-docs inference providers documentation regenerated automatically [5] as dependencies updated.

One email a day. Unsubscribe in one click.

Action items

References

  1. [1] fix mask return-type contract regression and add correctness guard for ↗ huggingface/transformers
  2. [2] Fix save_pretrained with offloading and weight conversions ↗ huggingface/transformers
  3. [3] fix `_flash_3_varlen_hub` mask handling ↗ huggingface/diffusers
  4. [4] [GOLD] VLM support for GOLDTrainer ↗ huggingface/trl
  5. [5] [Bot] Update Inference Providers documentation ↗ huggingface/hub-docs

Quick answers

What shipped in Hugging Face on July 6, 2026?
A critical mask return-type contract regression in transformers got patched overnight, along with fixes for offloaded model serialization that would have silently corrupted weight conversions in production. In total, 5 commits and 5 pull requests landed.
Who contributed to Hugging Face on July 6, 2026?
5 developers shipped this update, including kaixuanliu, Cyrilvallez, zhtmike, Strongich, and HuggingFaceInfra.
What were the notable Hugging Face updates?
fix mask return-type contract regression and add correctness guard for, Fix save_pretrained with offloading and weight conversions, and fix `_flash_3_varlen_hub` mask handling.

More from @huggingface

Daily updates, in your inbox

Follow Hugging Face

Keep up with Hugging Face in about 3 minutes a day: what actually shipped — the commits, pull requests, releases, and security advisories that matter.

or

One email a day. Unsubscribe in one click. Read a past issue →

Elsewhere on the wire

Want every project, not just this one?

We use privacy-friendly analytics (Google Analytics, IP-anonymized) to see which pages help readers. No ads, and we never sell your data. See our Privacy Policy.