RepoJournal
Hugging Face

@huggingface

Transformers, Datasets, and the open AI-model layer

Pick a date

The Wire · Showcase

TRL FIXES MULTIMODAL LOGGING AND QUANTIZATION CRASHES ACROSS GRPO AND QORA PIPELINES

By RepoJournal · Filed · About Hugging Face

Adam Pardyl Sergio Paniego Blanco Albert Villanova del Moral Sayak Paul drbh Bertrand CHEVRIER
6 people shipped this

TRL shipped four critical fixes overnight for multimodal RL training, including a QLoRA + FSDP1 dtype crash that was breaking mixed-precision setups.

The biggest one: QLoRA + FSDP1 mixed-dtype configurations were crashing in prepare_peft_model, and that's now fixed [1]. Parallel to that, the multimodal logging system got a new control lever with the `log_multimodal` parameter added to both GRPOConfig and RLOOConfig [2], letting you silence image logging when you need lighter checkpoints. GKD also got a vocab_size validation fix for multimodal models [3] that was silently breaking configs that looked valid. On the data side, GRPO and RLOO now handle IterableDataset errors correctly instead of swallowing them [4]. Kernels desk shipped Helion support [5], enabling pure-Python Triton kernels to build as noarch variants, which means one binary for all torch versions. huggingface.js fixed their Deno e2e CI by setting minimumDependencyAge to 0 for local registry testing [6], unblocking the test pipeline.

Action items

References

  1. [1] Fix QLoRA + FSDP1 mixed-dtype crash in prepare_peft_model (#6343) huggingface/trl
  2. [2] Add `log_multimodal` param to GRPOConfig and RLOOConfig to control image logging (#5408) huggingface/trl
  3. [3] Fix GKD vocab_size check for multimodal model configs (#6340) huggingface/trl
  4. [4] Fix error type for IterableDataset in GRPO and RLOO (#6324) huggingface/trl
  5. [5] Add Helion as a supported Python dependency ↗ huggingface/kernels
  6. [6] CI fix e2e test (#2284) huggingface/huggingface.js

More from @huggingface

Daily updates, in your inbox

Follow Hugging Face

Transformers, Datasets, and the open AI-model layer We'll email you a link to confirm first.

Free. Confirm via email. Unsubscribe in one click.

— or follow the whole beat:

Elsewhere on the wire