RepoJournal
PyTorch

@pytorch

PyTorch and the broader machine-learning ecosystem

Pick a date

Topics: Python AI / ML Full archive →

The Wire · Showcase

INDUCTOR FIXES NESTED REDUCTION BLOCK POINTER BUG, TORCHRL UNIFIES CHECKPOINTING

By RepoJournal · Filed · About PyTorch

Inductor's Triton codegen was silently corrupting fused broadcasts and reductions by losing track of block pointer advancement across outer loops, now patched [ref:3].

This wasn't a rare edge case: any `mean(a * b)` style operation where shapes broadcast then reduce would have produced wrong numerics in compiled kernels [1]. The fix tracks per-level pointer advancement correctly through nested loop structures. On the distributed training front, c10d's abort handler got a needed refactor to use the generic coalescing_manager instead of hardcoded NCCL calls [2], making it work cleanly across all backends. Meanwhile, TorchRL shipped a massive checkpointing unification [3] that consolidates legacy versioned formats into one manifest-driven API supporting both directory and ZIP containers, atomic replacement, and partial loading across all eight RL algorithms. The tensordict team landed single-file zip archives for memory-mapped tensors [4], letting you ship memmap data as a single file without a new format. Inductor also got smarter about int32 versus int64 indexing by analyzing actual addressing expressions instead of guessing from buffer sizes [5]. Three additional Inductor and c10d polish commits landed for NCCL review feedback and nested reduction bookkeeping [6].

Action items

References

  1. [1] [inductor] Rewind block_ptr across outer loop in nested reductions (#188771) (#188771) pytorch/pytorch
  2. [2] [c10d] Use _coalescing_manager for abort instead of hardcoded NCCL group calls (#189770) pytorch/pytorch
  3. [3] [Feature] Unify TorchRL checkpointing ↗ pytorch/rl
  4. [4] [Feature] Single-file zip archives for memory-mapped TensorDicts ↗ pytorch/tensordict
  5. [5] [Inductor] Bound exact index expressions for int32 indexing eligibility (#189108) pytorch/pytorch
  6. [6] [c10d][nccl2] Address stack review comments (#188701) pytorch/pytorch

Quick answers

What shipped in PyTorch on July 14, 2026?
Inductor's Triton codegen was silently corrupting fused broadcasts and reductions by losing track of block pointer advancement across outer loops, now patched [ref:3]. In total, 71 commits and 6 pull requests landed.
Who contributed to PyTorch on July 14, 2026?
7 developers shipped this update, including Tristan Rice, Frederik Gossen, Limin Tang, Shangdi Yu, vmoens, theap06, and Benson Ma.
What were the notable PyTorch updates?
[inductor] Rewind block_ptr across outer loop in nested reductions (#188771) (#188771), [c10d] Use _coalescing_manager for abort instead of hardcoded NCCL group calls (#189770), and [Feature] Unify TorchRL checkpointing.

More from @pytorch

Daily updates, in your inbox

Follow PyTorch

PyTorch and the broader machine-learning ecosystem We'll email you a link to confirm first.

Free. Confirm via email. Unsubscribe in one click.

— or follow the whole beat:

Elsewhere on the wire