RepoJournal
Alignment & Post-training Alignment & Post-training
47 wires and counting

$ follow Alignment & Post-training

Keep up with Alignment & Post-training in about 3 minutes: what actually shipped — the commits, pull requests, releases, and security advisories that matter.

or

fair warning: these emails are deeply technical. diffs, version numbers, CVEs, benchmark deltas. if that's not your idea of a good read, this isn't your newsletter.

Folds into your digest — weekly by default, monthly if you prefer. Unsubscribe in one click.

$ status

wire 2026-11-18
stories 20

© 2026 RepoJournal Home Showcase How it works Privacy

$ the-wire · showcase

verl now fails loudly on overlong prompts instead of silently truncating them

By RepoJournal · Filed · About Alignment & Post-training · Composed from the cited sources · methodology

verl's agent loop finally honors the data.truncation policy you set, so the default error mode raises instead of dropping the head of an overlong prompt, and the MILES Tiny examples moved to batch 2048 at LR 6e-6 with token-mean loss.

fix(agent_loop): honor data.truncation policy in _cap_text_prompt_length verl-project/verl

by Jackie2049

AgentLoopBase._cap_text_prompt_length used to left-truncate any prompt over the cap, keeping only the suffix regardless of the policy; it now reads data.truncation, so with error (the default) an overlong prompt raises ValueError rather than quietly discarding its leading instructions. If your agent runs depend on that silent clipping, they will start failing at the prompt cap.

[trainer] fix: conditionally fetch token-level rewards (#8565) verl-project/verl

by ChibiQuest

PPO metric collection now only fetches token_level_rewards when they are actually produced, which removes missing-field errors with algorithm.use_kl_in_reward=false. KL-in-reward workflows keep their existing data-writing behavior.

MILES Tiny recipe: batch 2048, LR 6e-6 and token-mean loss allenai/open-instruct

by no0p

Both maintained Tiny templates (tiny/node.toml and tiny/three-node.toml) now run 2,048 responses per optimizer update, 256 prompts by 8 responses, with constant LR 6e-6 and no warmup, and calculate_per_token_loss=true across all four maintained MILES examples with group-standard-deviation normalization still off. Baseline, router and throughput test expectations moved with them, so any numbers ...

[ci, vllm] test: add top-k sampling support checks to Ascend CI (#8706) verl-project/verl

by lxb007981

The vLLM sampling test suite now runs in the Ascend CI workflow, asserting generated completions are nonempty and carry one logprob record per token.

[fsdp, perf] chore: deepseek v4 flash performance optimization solution for NPU (#8698) verl-project/verl

by zhouhengan1211

Elsewhere on the verl side: a DeepSeek V4 flash policy change for NPU training, with the redundant path controlled by use_no_sync_for_gradient_accumulation removed, plus delta sync landed for NPU checkpointing.

Quick answers

What shipped in Alignment & Post-training on November 18, 2026?
verl's agent loop finally honors the data.truncation policy you set, so the default error mode raises instead of dropping the head of an overlong prompt, and the MILES Tiny examples moved to batch 2048 at LR 6e-6 with token-mean loss. In total, 10 commits and 10 pull requests landed.
Who contributed to Alignment & Post-training on November 18, 2026?
6 developers shipped this update, including ChibiQuest, zhouhengan1211, Jackie2049, wucong25, lxb007981, and no0p.
What were the notable Alignment & Post-training updates?
fix(agent_loop): honor data.truncation policy in _cap_text_prompt_length, [trainer] fix: conditionally fetch token-level rewards (#8565), and MILES Tiny recipe: batch 2048, LR 6e-6 and token-mean loss.