The Wire · Showcase
Pallas HBM Windows Open on Any Tensor Axis
By RepoJournal · Filed · About PyTorch
Pallas stagers just gained the ability to align HBM windows on any tensor axis, not just the last one, and a critical autotuning crash is fixed.
The Pallas frontend is flexing serious new muscle with a 16-PR stack from AmesingFlank that extends stage-aligned HBM windows to any tensor axis [1], covers static value slices [2], and supports aligned dynamic HBM windows [3] for projection kernels. Meanwhile, the autotuner now handles kernels with callable arguments, fixing the `TypeError: Cannot serialize type: code` that broke AOT tuning for things like flex attention's score_mod [4]. On the XPU front, a torch-xpu-ops commit pin [5] lands fixes for register spilling, group_reduce asserts, and TopK NaN behavior. "AOT tuning currently does not work for any kernel with a callable input" [4], but that's no longer the case. Elsewhere, DreamerV3 gets a focused correctness patch fixing episode-boundary semantics [6], and TensorDict deprecates `TensorDictModule.device` ahead of removal in 0.17 [7]. Buckle up, because the Pallas changes alone shift how you write tile-based kernels.
One email a day. Unsubscribe in one click.
Keep up with PyTorch in about 3 minutes a day: what actually shipped — the commits, pull requests, releases, and security advisories that matter.
One email a day. Unsubscribe in one click. Read a past issue →
Action items
- → Review Pallas PRs #3390 and #3404 for your projection epilogues pytorch/helion [plan]
- → Update torch-xpu-ops pin to 1a3415 for XPU correctness fixes pytorch/pytorch [plan]
- → Test your AOT autotuning with callables after PR #3325 pytorch/helion [plan]
- → Watch TensorDictModule.device deprecation; prepare for removal in 0.17 pytorch/tensordict [monitor]
References
- [1] [Pallas] Stage aligned HBM windows on any tensor axis ↗ pytorch/helion
- [2] [Pallas] Lower static value slices as basic indices ↗ pytorch/helion
- [3] [Pallas] Stage aligned dynamic HBM windows ↗ pytorch/helion
- [4] [autotuner] AOT tuning for callables ↗ pytorch/helion
- [5] Update torch-xpu-ops commit pin (#194185) pytorch/pytorch
- [6] [BugFix] Match DreamerV3 reference semantics ↗ pytorch/rl
- [7] [Deprecation] Deprecate TensorDictModule.device (#1770) pytorch/tensordict