$ the-wire · showcase
open-instruct reworks MILES defaults, fixes reward-hacking IFEvalG checkers
By RepoJournal · Filed · About Alignment & Post-training · Composed from the cited sources · methodology
allenai/open-instruct changed MILES runtime defaults and the batch handling around them, and separately fixed three IFEvalG checkers that were paying reward for degenerate answers.
Consolidate MILES throughput configuration, runtime and evaluation optimizations allenai/open-instruct
MILES now uses the Rust router by default, runs distributed HTTP workers, and drops the successful-refresh admission handshakes while keeping engine pause/update/resume; evaluation picks model/GPU profiles with capacity-aware batches. Every one of those is overridable, so existing explicit configs keep working, but anyone relying on the old defaults will see different throughput and eval batchi...
Fix IFEvalG checkers that rewarded degenerate answers allenai/open-instruct
Three IFEvalG checkers paid reward for degenerate answers or paid at random, and both the GRPO IFEvalVerifier and the MILES ManifestIFVerifier delegate to them. If you trained RL on the IF pool with these checkers, the reward signal behind those runs was wrong, and the table in the pull request maps each constraint name to its bug and fix.
Improve MILES batch delivery and align demo learning defaults allenai/open-instruct
Batches were delayed by rollout delivery and repeated trainer preparation; MILES now pins a revision that drains ready groups, writes sampled diagnostics asynchronously and reuses prepared token packs. It also exposes an opt-in core.layer_profile_interval if you want the per-layer, expert and cache cost measurements, and the demos now share per-response loss, zero truncation rewards and eight r...
[ci] chore: enable daily Ascend A5 Docker builds (#8470) verl-project/verl
verl turned on the existing cron so Ascend A5 Docker images build daily at 19:00 UTC, matching the Ascend A3 workflow, which matters only if you pull those images to run on Ascend hardware. The README hardware support entry now names the vendor as "Huawei Ascend" rather than just "Ascend."
Action items
- → Re-check any MILES or GRPO RL runs trained on the IFEvalG pool; the count:lowercase_counting and two other checkers w... allenai/open-instruct [plan]
