RepoJournal
PyTorch

@pytorch

PyTorch and the broader machine-learning ecosystem

Keep up with PyTorch in about 3 minutes a day: what actually shipped — the commits, pull requests, releases, and security advisories that matter.

One email a day. Unsubscribe in one click.

Pick a date

Topics: Python AI / ML Full archive →

The Wire · Showcase

PYTORCH SHIPS TRITON CACHE HOT-LOAD AND PROFILER RESILIENCE FIXES

By RepoJournal · Filed · About PyTorch

Inductor's FX graph cache now hot-loads Triton bundles directly from serialized artifacts, eliminating the delay until cache-hit compilation [ref:1].

The cache hot-load fix [1] means compiled graphs emit Triton code and cubin files immediately on load instead of waiting for a second cache hit. This cuts time-to-first-inference on cached models and simplifies the emit pipeline. Separately, the PyTorch profiler now handles duplicate async-flow correlation IDs from active backends without crashing [2], allowing workloads to complete instead of aborting. Regional AOTI's submodule replacement now mutates the root ScriptModule in place [3], avoiding expensive cloning during compilation. Three emerging fixes address correctness gaps: named tensor revert [4] restores vLLM and TPU compatibility after a lint-driven change broke downstream, while OpInfo NumPy tests now run on CPU [5] after a logic error skipped them entirely. On the executorch desk, QuantFusionPass adds shared fusion infrastructure for quantization patterns [6], MLX now supports GGUF exports for Gemma 4 31B [7], and a new general Aten lowering pass [8] reuses single-op dialect replacements across backends. TorchTitan's RL loop now batches episodes with configurable microbatch sizing [9], and RoPE refactoring enforces model-intrinsic sequence length limits as hard errors [10].

One email a day. Unsubscribe in one click.

Action items

References

  1. [1] Hot-load Triton bundles from cache artifacts (#184953) pytorch/pytorch
  2. [2] Make profiler resilient to duplicate flow start IDs (#184792) pytorch/pytorch
  3. [3] [Regional AOTI] Mutate root ScriptModule in place in _replace_submodule_with_typecheck_pybind (#185321) (#185321) pytorch/pytorch
  4. [4] Revert "Remove named tensor (#173895)" pytorch/pytorch
  5. [5] [test] Remove unintentional skip for OpInfo test against NumPy on CPU (#182999) pytorch/pytorch
  6. [6] Add shared fusion infrastructure and QuantFusionPass (#19724) ↗ pytorch/executorch
  7. [7] Add GGUF → MLX export support for Gemma 4 31B ↗ pytorch/executorch
  8. [8] Add general Aten lowering pass ↗ pytorch/executorch
  9. [9] [rl] Add Batcher in RL Loop ↗ pytorch/torchtitan
  10. [10] RoPE refactor: Using model's max_sequence_length as the upper bound of Training.sequence_length ↗ pytorch/torchtitan

Quick answers

What shipped in PyTorch on May 29, 2026?
Inductor's FX graph cache now hot-loads Triton bundles directly from serialized artifacts, eliminating the delay until cache-hit compilation [ref:1]. In total, 80 commits and 30 pull requests landed.
Who contributed to PyTorch on May 29, 2026?
4 developers shipped this update, including ethansfng, mergennachin, AdrianLundell, and wwwjn.
What were the notable PyTorch updates?
Hot-load Triton bundles from cache artifacts (#184953), Make profiler resilient to duplicate flow start IDs (#184792), and [Regional AOTI] Mutate root ScriptModule in place in _replace_submodule_with_typecheck_pybind (#185321) (#185321).

More from @pytorch

Daily updates, in your inbox

Follow PyTorch

Keep up with PyTorch in about 3 minutes a day: what actually shipped — the commits, pull requests, releases, and security advisories that matter.

or

One email a day. Unsubscribe in one click. Read a past issue →

Elsewhere on the wire

Want every project, not just this one?