RepoJournal
Hugging Face

@huggingface

Transformers, Datasets, and the open AI-model layer

Keep up with Hugging Face in about 3 minutes a day: what actually shipped — the commits, pull requests, releases, and security advisories that matter.

One email a day. Unsubscribe in one click.

Pick a date

Topics: Python AI / ML Full archive →

The Wire · Showcase

TRANSFORMERS CUTS DISTRIBUTED LOAD TIME IN HALF WITH SHARD-ON-READ

By RepoJournal · Filed · About Hugging Face

Transformers shipped native DTensor shard-on-read support, letting each rank load its own checkpoint slice instead of materializing the full model on every device first.

The big win here is inference speed on distributed setups. Instead of every rank reading the entire checkpoint and then sharding it down, each rank now reads only its slice directly [1] [2]. This cuts checkpoint load time roughly in half on multi-GPU and multi-node deployments. The PR also migrates FSDP2 wrapping to a dedicated distributed module while keeping backward compatibility [2], cleaning up the integration layer for anyone already on FSDP. On the docs side, doc-builder now handles the reachy_mini robotics library through mock deps instead of custom Docker images [3] [4], which means faster builds and easier maintenance. The PEFT repo fixed two quiet but annoying bugs: task switching was broken from leftover copy-paste code, and the UI was showing empty legend items in highlight mode [5] [6]. Transformers-ci is porting daily jobs to OTEL for better observability [7].

One email a day. Unsubscribe in one click.

Action items

References

  1. [1] Shard on read Dtensor aware ↗ huggingface/transformers
  2. [2] Shard on read Dtensor aware (#46717) huggingface/transformers
  3. [3] Add reachy_mini mock-deps registry entry (#807) huggingface/doc-builder
  4. [4] Add reachy_mini mock-deps registry entry ↗ huggingface/doc-builder
  5. [5] Minor app embed improvements (#3322) huggingface/peft
  6. [6] Minor app embed improvements ↗ huggingface/peft
  7. [7] port over the daily ci jobs so we can OTEL them huggingface/transformers-ci

Quick answers

What shipped in Hugging Face on July 13, 2026?
Transformers shipped native DTensor shard-on-read support, letting each rank load its own checkpoint slice instead of materializing the full model on every device first. In total, 4 commits and 3 pull requests landed.
Who contributed to Hugging Face on July 13, 2026?
4 developers shipped this update, including githubnemo, Fabien, 3outeille, and Tarek Ziade.
What were the notable Hugging Face updates?
Shard on read Dtensor aware, Shard on read Dtensor aware (#46717), and Add reachy_mini mock-deps registry entry (#807).

More from @huggingface

Daily updates, in your inbox

Follow Hugging Face

Keep up with Hugging Face in about 3 minutes a day: what actually shipped — the commits, pull requests, releases, and security advisories that matter.

or

One email a day. Unsubscribe in one click. Read a past issue →

Elsewhere on the wire

Want every project, not just this one?

We use privacy-friendly analytics (Google Analytics, IP-anonymized) to see which pages help readers. No ads, and we never sell your data. See our Privacy Policy.