The Wire · Showcase
TRANSFORMERS SHIPPING EXPORT STANDARDIZATION, GEMMA ATTENTION FIXES LAND
By RepoJournal · Filed · About Hugging Face
Transformers just locked in broad modeling changes that make ONNX, torch.export, and ExecuTorch export work cleanly across a huge set of models, while Gemma 3/4 gets critical attention masking corrections.
The modeling standardization PR [1] reshapes how models handle compilation and export paths, eliminating one of the sharpest pain points for production deployments. That lands alongside targeted fixes for Gemma 3/4 attention masking at sliding window boundaries [2], which patches a behavioral drift in local layer attention that would have broken inference consistency. TRL is also housekeeping: dropping vLLM 0.14 support [3], removing the defunct sft_video_llm.py script [4], and integrating the new response parsing API [5]. Over in robotics, LeRobot shipped configurable MIT control mode for ReBot [6], letting users swap between position-velocity and torque-based control per joint with tunable stiffness parameters. The physics-intern-skills repo continues internal iteration on Codex integration [7], workspace bootstrap flow [8], and plugin distribution [9], with documentation catching up to match.
One email a day. Unsubscribe in one click.
Keep up with Hugging Face in about 3 minutes a day: what actually shipped — the commits, pull requests, releases, and security advisories that matter.
One email a day. Unsubscribe in one click. Read a past issue →
Action items
- → Review transformers modeling export changes for your deployment targets (ONNX/torch.export/ExecuTorch) huggingface/transformers [plan]
- → If you're running Gemma 3/4 in production, pull the attention masking fix before next inference deployment huggingface/transformers [immediate]
- → TRL users on vLLM 0.14: upgrade vLLM before next training run huggingface/trl [plan]
References
- [1] 🚨 Modeling changes for export, compile, and hybrid-attention standardization ↗ huggingface/transformers
- [2] 🚨 [gemma 3/4] Fix bidirectional attention masking crossing sliding window boundaries ↗ huggingface/transformers
- [3] Drop vLLM 0.14 support (#6209) huggingface/trl
- [4] Remove sft_video_llm.py script (#6193) huggingface/trl
- [5] Integrate the new response parsing API ↗ huggingface/trl
- [6] Feat(robot): add MIT control mode to ReBot ↗ huggingface/lerobot
- [7] Codex host: migrate sub-agent glue to auto-discovered .codex/agents/ huggingface/physics-intern-skills
- [8] Drop the problem one-liner / start-research bootstrap step huggingface/physics-intern-skills
- [9] Add Codex CLI plugin: $init-physics-intern + build-codex-plugin.sh huggingface/physics-intern-skills