The Wire · Showcase
TAU FIXES SESSION CORRUPTION BUG, SERGE ADDS GPU VERIFICATION LOOP
By RepoJournal · Filed · About Hugging Face
Tau's Unicode line separator bug was silently bricking user sessions. The fix is retroactive and ships today.
A critical fix in Tau [1] addresses a data corruption bug where Unicode characters U+2028, U+2029, and U+0085 in message content were splitting valid JSONL lines into malformed fragments, permanently bricking session files on load. The fix splits on actual JSONL delimiters (\n only) and retroactively repairs already-broken files. In parallel, Tau is restructuring skill discovery to separate user and project resources from built-in extension knowledge [2], mirroring Pi's documentation architecture, while the TUI now defaults sidebar positioning to the right [3] and clarifies token usage metrics [4] to prevent confusion between cumulative provider usage and context estimates. Over in serge, the team shipped GPU verification for fix PRs [5]: before opening a PR, serge now runs targeted tests on GPU and only merges patches that actually turn red tests green, closing a loop that previously shipped no-op fixes to transformers. The diffusers team continues refactoring Wan pipeline tests to the new mixin structure [6], keeping existing coverage while simplifying test organization across multiple variants. In TRL, cross-rank metric aggregation for GRPO and RLOO is now unbiased [7], computing true global means instead of mean-of-means when per-rank token counts differ, while the environment-owned dataset feature makes train_dataset optional when using environment factories [8], removing the need for dummy datasets in procedural environments.
One email a day. Unsubscribe in one click.
What actually shipped in Hugging Face, written up every day — commits, pull requests, releases, and security advisories.
One email a day. Unsubscribe in one click. Read a past issue →
Action items
- → Update Tau immediately if sessions are failing to load huggingface/tau [immediate]
- → Review Tau skill discovery changes and update any custom extensions huggingface/tau [plan]
- → Enable VERIFY_ON_GPU in serge if patching transformers or other heavy-test repos huggingface/serge [plan]
- → Monitor TRL GRPO/RLOO logging output to verify corrected aggregation huggingface/trl [monitor]
References
- [1] fix: don't split session JSONL on Unicode line separators ↗ huggingface/tau
- [2] Keep Tau self-knowledge out of user skills ↗ huggingface/tau
- [3] Default the TUI sidebar to the right ↗ huggingface/tau
- [4] Clarify TUI session and context token usage ↗ huggingface/tau
- [5] Verify serge patches on GPU before opening a PR (opt-in) ↗ huggingface/serge
- [6] refactor wan pipeline tests to the new mixin structure ↗ huggingface/diffusers
- [7] Fix biased cross-rank aggregation of token-weighted metrics (GRPO, RLOO) ↗ huggingface/trl
- [8] Environment-owned dataset: make `train_dataset` optional ↗ huggingface/trl