RepoJournal
PyTorch @pytorch
90 wires and counting

$ follow PyTorch

Keep up with PyTorch in about 3 minutes: what actually shipped — the commits, pull requests, releases, and security advisories that matter.

or

fair warning: these emails are deeply technical. diffs, version numbers, CVEs, benchmark deltas. if that's not your idea of a good read, this isn't your newsletter.

Folds into your digest — weekly by default, monthly if you prefer. Unsubscribe in one click.

$ status

wire 2026-06-09
stories 118
GitHub RSS Archive Reviews Topics

© 2026 RepoJournal Home Showcase Explore How it works Privacy

$ the-wire · showcase

DYNAMO GAINS ARITHMETIC OPERATORS AS FSDP2 CUTS BACKWARD COMPUTE STALLS

By RepoJournal · Filed · About PyTorch · Composed from the cited sources · methodology

tianyu-l Gasoonjia yuchengliu1
3 people shipped this
tianyu-l @tianyu-l 1 cited Gasoonjia @Gasoonjia 1 cited yuchengliu1 @yuchengliu1 1 cited

PyTorch's JIT compiler now handles Python's core division and modulo operators natively, while FSDP2 adds buffering controls to stop reduce-scatter from blocking gradient computation.

Dynamo landed three operator implementations [1] [2] [3] that wire floor division (//), true division (/), and remainder (%) directly into torch.compile by adding CPython's number protocol slots to VariableTracker, letting compiled code use native Python arithmetic without fallback. On the distributed training front, FSDP2 shipped set_reduce_scatter_max_input_buffers [4] to decouple reduce-scatter blocking from backward compute, solving a critical latency bottleneck where compute streams stall waiting for buffer recycling every layer (measured at 37.6 ms per step per layer in production). ExecuTorch expanded MLX support with fused Q6_K quantized kernels [8] for Gemma 4 31B GGUF export, eliminating the slow dequant path and shrinking `.pte` size through kernel blob deduplication. Meanwhile, XNNPACK was removed from default builds [5] now that ExecuTorch is the recommended mobile inference path. TorchTitan consolidated FSDP configuration by deprecating the llama4 folder [6] [7] and unifying MoE and dense model setup into a single distributed/fsdp.py file. The AO team added int8/fp8 quantized QKV fusion for x86 [11], fusing three GEMMs and scaled dot product attention into a single kernel pair. Across ExecutorTorch, device tensor helpers got hardened with proper metadata preservation and error reporting [9], while test utilities moved to shared modules [10] to kill duplication. FBGEMM deployed deterministic seeding infrastructure [12] for legacy test reproducibility and optimized ROCm gradient accumulation with block-wise loop unrolling [13].

Action items

References

  1. [1] [Operators] Implement remainder operator in Dynamo (#185654) pytorch/pytorch ↗
  2. [2] [Operators] Implement true division operator in Dynamo (#185653) pytorch/pytorch ↗
  3. [3] [Operators] Implement floor division operator in Dynamo (#185652) pytorch/pytorch ↗
  4. [4] [FSDP2] Add set_reduce_scatter_max_input_buffers to mitigate reduce-scatter blocking backward compute (#186000) pytorch/pytorch ↗
  5. [5] Remove XNNPACK availability check from binary smoke test (#186662) pytorch/pytorch ↗
  6. [6] [BE] deprecate llama4, move apply_fsdp to common file ↗ pytorch/torchtitan
  7. [7] [BE] deprecate llama4, move apply_fsdp to common file (#3573) ↗ pytorch/torchtitan
  8. [8] [MLX][Gemma4] Introduce Q6K kernels (#20004) pytorch/executorch ↗
  9. [9] Address review feedback on device tensor helpers (#20078) (#20078) pytorch/executorch ↗
  10. [10] Extract shared device test utilities to reduce redundancy (#20061) ↗ pytorch/executorch
  11. [11] add quantized qkv-fusion pass for x86 ↗ pytorch/ao
  12. [12] Add seed_all() deterministic-seed test helper (#5851) ↗ pytorch/FBGEMM
  13. [13] Add `PROCESS_BLOCK` macro for grad accumulation loop unrolling (#5835) ↗ pytorch/FBGEMM

$ ls pytorch/reviews/ # the step-back reads

the week in review Helion autotunes Metal, ending default 16x16x16 tiles the month in review ExecuTorch MoE quantization, Helion runtime splits, and a broader cleanup wave
Topics: Python AI / ML Full archive → Weekly reviews →

Quick answers

What shipped in PyTorch on June 9, 2026?
PyTorch's JIT compiler now handles Python's core division and modulo operators natively, while FSDP2 adds buffering controls to stop reduce-scatter from blocking gradient computation. In total, 86 commits and 32 pull requests landed.
Who contributed to PyTorch on June 9, 2026?
3 developers shipped this update, including tianyu-l, Gasoonjia, and yuchengliu1.
What were the notable PyTorch updates?
[Operators] Implement remainder operator in Dynamo (#185654), [Operators] Implement true division operator in Dynamo (#185653), and [Operators] Implement floor division operator in Dynamo (#185652).
♥

$ log @pytorch --recent

torchtitan fixes multi-node HF export, torch._native opens to non-aten namespaces 57 shipped Fake-tensor hardening, ROCm graph fixes, and an XNNPACK use-after-free 180 shipped CPU caching allocator teardown race fixed, torchtitan shares one training engine 67 shipped ROCm test timeouts traced to duplicated runs, and distributed/test_store drops 15 minutes 100 shipped

$ log --all # elsewhere on the wire

@openclaw Cold-start Gateway diagnostics stop crying wolf, doctor repairs plugin drift Agentic Coding Cline desktop bundles shrink, goose unblocks its own clicks

$ ls showcases/

Rails Django Laravel Node.js Go Vercel Vue.js Kubernetes HashiCorp Arch Linux Linux Anthropic

$ init your-desk

RepoJournal can write one of these for any repo you care about. Sign in with GitHub, pick your repos and sources, and your desk gets a wire like this one every morning.