The Wire · Showcase
TRANSFORMERS SHIPS FSDP DISTRIBUTED TRAINING STACK, HUB LIBRARY PLUGS REDOS HOLE
By RepoJournal · Filed · About Hugging Face
Hugging Face landed distributed training orchestration in transformers while plugging a regex vulnerability that could stall untrusted card parsing for minutes.
The transformers team merged full FSDP CI infrastructure and end-to-end distributed tests [1], introducing DistributedMixin and wiring DistributedConfig through from_pretrained and save_pretrained in the first two phases of the orchestration rollout. On the inference side, DiffusionGemma now supports gradient checkpointing [2] with exact loss/gradient reproduction, and Gemma 4 switched to explicit per_layer_config for heterogeneous attention patterns [3]. AXK1, a new Deepseek-derived MoE model, landed with TP bug fixes and modernized configuration [4], while a bugfix resolved fully offloaded model saving [5]. In the SDK layer, huggingface_hub patched catastrophic backtracking in REGEX_YAML_BLOCK [6], a ReDoS vulnerability that could pin CPU cores for seconds parsing untrusted README frontmatter. The hub_upload pipeline now forwards authentication tokens through _final_commit_info lookups [7], fixing 401 errors on private repos. Research-agent stripped deployment files and locked down configuration [8], and funes added a remove command [9] to undo fuses add operations. JavaScript tasks shipped v0.21.28 [10] with resourceGroupId support for organization-owned collections [11] and NInfer model library registration for the fastest documented Qwen35B inference engine [12].
One email a day. Unsubscribe in one click.
Keep up with Hugging Face in about 3 minutes a day: what actually shipped — the commits, pull requests, releases, and security advisories that matter.
One email a day. Unsubscribe in one click. Read a past issue →
Action items
- → Review FSDP distributed training integration if you ship multinode setups huggingface/transformers [plan]
- → Patch huggingface_hub to fix ReDoS in card parsing on untrusted input huggingface/huggingface_hub [immediate]
- → Upgrade huggingface_hub if uploading to private repos with pipelined uploads huggingface/huggingface_hub [plan]
- → Update huggingface.js to v0.21.28 for resourceGroupId support huggingface/huggingface.js [monitor]
References
- [1] Add FSDP CI and end-to-end FSDP tests + save fsdp (#47357) huggingface/transformers
- [2] [DiffusionGemma] Support gradient checkpointing (#46572) huggingface/transformers
- [3] Use new `per_layer_config` for Gemma 4 so that heterogeneous attention config is explicit (#47384) huggingface/transformers
- [4] add_axk1 (#46867) huggingface/transformers
- [5] [Offloading] [Bugfix] Fix fully offloaded model saving (#47336) huggingface/transformers
- [6] [Repocard] Fix catastrophic backtracking (ReDoS) in REGEX_YAML_BLOCK (#4526) huggingface/huggingface_hub
- [7] [Upload] Forward token in _final_commit_info repo_info lookup ↗ huggingface/huggingface_hub
- [8] remove deploy files huggingface/research-agent
- [9] feat: add funes remove command ↗ huggingface/funes
- [10] tasks-v0.21.28 ↗ huggingface/huggingface.js
- [11] Support resourceGroupId when creating a collection (#2308) huggingface/huggingface.js
- [12] Register NInfer model library ↗ huggingface/huggingface.js