The Wire · Showcase
TRANSFORMERS OVERHAULS LINEAR ATTENTION WHILE DEPRECATING LEGACY RESPONSE SCHEMA
By RepoJournal · Filed · About Hugging Face
The transformers library is retiring its fragile response_schema prototype in favor of streaming-compatible parsing, while simultaneously refactoring every linear attention model to use standardized convolution patterns.
Transformers dropped the old response_schema [1] after discovering it was brittle, hard to write regexes for, and couldn't handle streaming. The deprecation triggers a cascade: TRL now ships a new Gemma4 response template [4] to avoid breaking on models that relied on the old approach. Simultaneously, the library refactored all linear attention models to latest convolution best practices [2], touching Mamba, Jamba, Falcon, Qwen, Zamba and others in a massive consolidation that simplifies cache handling and prefill logic. SKT's AXK2 landed as a new flagship LLM [3], refactored to inherit from DeepSeek V3 architecture. On the TRL side, AsyncGRPOTrainer is gaining a loop-owning agent path [5] for training external tools that manage their own loops like OpenCode, plus DistillationTrainer continues its incremental refactor with new generation methods [6] [7]. LeRobot bumped diffusers from 0.36 to 0.38+ [8] to pick up a critical security fix blocking downstream consumers, and added token argument support for private Hub datasets [9] while fixing depth frame handling in image preprocessing [10]. Skills expanded Spaces templates to cover 3D generation models [11], then refined the documentation to avoid skewing agent behavior [12].
One email a day. Unsubscribe in one click.
Keep up with Hugging Face in about 3 minutes a day: what actually shipped — the commits, pull requests, releases, and security advisories that matter.
One email a day. Unsubscribe in one click. Read a past issue →
Action items
- → Review deprecated response_schema usage in any custom parsing code and migrate to streaming-compatible solution huggingface/transformers [plan]
- → Upgrade diffusers to >=0.38.0 if consuming lerobot or dependent on security fix GHSA-98h9-4798-4q5v huggingface/lerobot [plan]
- → Test linear attention model outputs if running inference on Mamba, Jamba, Qwen, Zamba or Falcon variants huggingface/transformers [monitor]
References
- [1] Deprecate the old response_schema (#47320) huggingface/transformers
- [2] Refactor all linear attention models to latest best standards for convolution (#47452) huggingface/transformers
- [3] Add AXK2 from SKT (#47528) huggingface/transformers
- [4] Add Gemma4 response template ↗ huggingface/trl
- [5] Async grpo OpenEnv harness rollout ↗ huggingface/trl
- [6] [DistillationTrainer refactor] Add `_generate_single_turn` (unwired) (#6513) huggingface/trl
- [7] [DistillationTrainer refactor] Add `_generate` + `_generate_and_score_completions` (unwired) (#6521) huggingface/trl
- [8] chore(deps): bump diffusers to `>=0.38.0,<0.40.0` (#4145) huggingface/lerobot
- [9] feat(dataset): accept token argument for private HF Hub datasets ↗ huggingface/lerobot
- [10] (depth image processing): excluding depth frames from the RGB to BGR image processing ↗ huggingface/lerobot
- [11] huggingface-spaces: add 3D generation model coverage within the Spaces skill ↗ huggingface/skills
- [12] huggingface-spaces: Remove disproportionate 3D generation information ↗ huggingface/skills