The Wire · Showcase
TAU FIXES ANTHROPIC BILLING LEAK, UNLOCKS PROMPT CACHING
By RepoJournal · Filed · About Hugging Face
Tau shipped critical fixes for Anthropic subscriptions today, plugging a prompt caching hole that was re-billing identical system prompts on every single turn.
Tau 0.3.5 landed with the caching layer developers have been waiting for [1]. The library had wired up the *reporting* side of Anthropic's prompt cache (parsing cache_read, cache_write, and ephemeral_1h_input_tokens from responses) but never actually *requested* caching in payloads, so every turn re-billed the system prompt, tool schemas, and conversation history as fresh input [3]. In parallel, rian-dolphin patched three separate OAuth bugs blocking Anthropic subscription login entirely: a typo in the client ID where one character stood between users and "Invalid client id" errors, broken token refresh that would kill credentials overnight, and auth URL handling that failed under load [2]. On the TRL front, GRPO, DPO, KTO and RLOO now respect frozen reference adapters when working with PEFT's `target_parameters` on peft>=0.20.0, instead of always falling back to the base model [4]. Separately, DPO now rejects unsupported f_divergence_type combinations that were either silently ignored or half-wired at init time [5]. LeRobot merged robotics-specific image augmentations (8 transforms for real-world robustness), fixed a double-reset bug in LiberoEnv that paid two full resets per episode termination, and improved Hub checkpoint diagnostics for legacy models [6][7]. The huggingface.js inference client shipped text-to-speech support for DeepInfra and reordered conversational payloads to put `model` first, enabling prefix-based routing for proxies instead of forcing buffering to identify providers [8][9].
One email a day. Unsubscribe in one click.
Keep up with Hugging Face in about 3 minutes a day: what actually shipped — the commits, pull requests, releases, and security advisories that matter.
One email a day. Unsubscribe in one click. Read a past issue →
Action items
- → Upgrade to Tau 0.3.5 if you're running Anthropic subscriptions to enable prompt caching and fix OAuth token refresh huggingface/tau [immediate]
- → Update PEFT to 0.20.1 if training with target_parameters adapters to support frozen reference adapters in GRPO/DPO huggingface/peft [plan]
- → Pull LeRobot's latest if you're using LiberoEnv for real-world robotics evaluation; fixes double-reset overhead huggingface/lerobot [plan]
References
- [1] Cache Anthropic prompts instead of re-billing every turn ↗ huggingface/tau
- [2] Fix Anthropic subscription login and OAuth token refresh ↗ huggingface/tau
- [3] Cache Anthropic prompts instead of re-billing every turn (#502) huggingface/tau
- [4] Use a reference adapter with `target_parameters` on `peft>=0.20.0` ↗ huggingface/trl
- [5] Reject unsupported `f_divergence_type` / loss type combinations in DPO ↗ huggingface/trl
- [6] feat(transforms): add 8 robotics-relevant image augmentations ↗ huggingface/lerobot
- [7] fix(libero): don't reset inside step() on termination (#4273) huggingface/lerobot
- [8] [Inference Providers] deepinfra: add text-to-speech support ↗ huggingface/huggingface.js
- [9] Serialize `model` first in conversational payloads ↗ huggingface/huggingface.js