$ the-wire · showcase
Chunked-entropy backward fix for Megatron, plus a Quay description for Ascend images
By RepoJournal · Filed · About Alignment & Post-training · Composed from the cited sources · methodology
verl landed a backward-pass fix for chunked vocab-parallel entropy under the Megatron engine and put the quay.io/ascend/verl repository description under version control, a quiet day for operators of the trainer.
[megatron] fix: backward through chunked vocab-parallel entropy verl-project/verl
Operators running the Megatron engine with `entropy_from_logits_with_chunking=True` no longer hit a RuntimeError in backward when entropy is part of the graph; the failure came from applying `_VocabParallelEntropy` to chunks that are views of one tensor, so the gradient reference was modified in place before it was needed.
[ci] feat: Add Ascend Quay repository description verl-project/verl
The description for quay.io/ascend/verl now lives in the repo rather than being set by hand on the registry, so anyone pulling the Ascend image sees a description that stays in step with the source tree.