RepoJournal
PyTorch

@pytorch

PyTorch and the broader machine-learning ecosystem

Keep up with PyTorch in about 3 minutes a day: what actually shipped — the commits, pull requests, releases, and security advisories that matter.

One email a day. Unsubscribe in one click.

Pick a date

Topics: Python AI / ML Full archive →

The Wire · Showcase

FSDP2 CUDA GRAPHS STREAM EXPLOSION FIXED, EXECUTORCH FUSION PIPELINE PATCHED

By RepoJournal · Filed · About PyTorch

PyTorch's FSDP implementation shipped a critical fix for stream proliferation in CUDA graphs, while ExecutorCh closed a gap in its convolution fusion pipeline that was breaking downstream models.

The big win: FSDP2 now eliminates redundant stream waits when running CUDA graphs [1]. This fix won't fully solve the problem (TP, EP, and micro-batching edge cases remain), but it cuts stream count significantly and requires CUDA 13.2 or higher. In parallel, ExecutorCh's ConvBNReLU fusion pipeline was broken by a new Convert1DConvTo2D pass that didn't account for batch norm followed by activation functions [2]. That's patched. Separately, Helion fixed a critical logic bug in traced if-subgraph outputs that was bleeding local variables across branch boundaries [3], which could cause silent correctness issues in control flow tracing. The docs preview pipeline got rearchitected to avoid S3 write permission issues with fork PRs [4], moving artifact staging to GitHub Actions instead of the Kubernetes pod. ExecutorCh also added QNN backend support for the randn operation [6] and fixed permute cancellation around rank-changing views [5], both landing just in time for broader model export use cases.

One email a day. Unsubscribe in one click.

Action items

References

  1. [1] [fsdp] Remove redundant stream waits (#183983) pytorch/pytorch
  2. [2] Fix broken ConvBNReLu from new Convert1DConvTo2D pass (#19558) (#19558) pytorch/executorch
  3. [3] Only include common outputs as outputs of traced if subgraph ↗ pytorch/helion
  4. [4] Upload docs preview from a workflow_run job, not the OSDC pod (#184414) pytorch/pytorch
  5. [5] Handle rank-changing views in RemovePermutesAroundElementwiseOps (#19538) ↗ pytorch/executorch
  6. [6] Qualcomm AI Engine Direct - Adding QNN backend support for randn core ATen op (#19377) pytorch/executorch

Quick answers

What shipped in PyTorch on May 20, 2026?
PyTorch's FSDP implementation shipped a critical fix for stream proliferation in CUDA graphs, while ExecutorCh closed a gap in its convolution fusion pipeline that was breaking downstream models. In total, 97 commits and 43 pull requests landed.
Who contributed to PyTorch on May 20, 2026?
2 developers shipped this update, including AmesingFlank and mcremon-meta.
What were the notable PyTorch updates?
[fsdp] Remove redundant stream waits (#183983), Fix broken ConvBNReLu from new Convert1DConvTo2D pass (#19558) (#19558), and Only include common outputs as outputs of traced if subgraph.

More from @pytorch

Daily updates, in your inbox

Follow PyTorch

Keep up with PyTorch in about 3 minutes a day: what actually shipped — the commits, pull requests, releases, and security advisories that matter.

or

One email a day. Unsubscribe in one click. Read a past issue →

Elsewhere on the wire

Want every project, not just this one?