The Wire · Showcase
Pytorch Fixes XPU Dispatch Gap and CI OOMs
By RepoJournal · Filed · About PyTorch
PyTorch's XPU backend lost a critical dispatch for _safe_softmax, and CI is getting a GOMAXPROCS pin to stop GPU nodes from OOMKilling.
A missing XPU dispatch line in `aten::_safe_softmax` broke the backend in 2.14, and the fix lands with this PR [3] while a matching commit pin updates torch-xpu-ops to address batchnorm accuracy and empty-batch FFT handling [2]. Over in CI-infra, dcgm-exporter was OOMKilling about 48% of 8-GPU pods because Go 1.24 ignores cgroup limits; pinning GOMAXPROCS=2 stops it dead [6]. TorchTitan is tightening its runtime: it drops Python 3.10 support entirely [5] and adds an opt-in fused MLA implementation for DeepSeek-V3, "Keeps V as a zero-copy view" [4]. The Kineto submodule bump pulls in a CUPTI buffer rejection bugfix [1], and TorchRL locks TransformedEnv specs by default so hooks can't mutate parent specs [7]. TensorRT's executorch fixes are worth a skim if you hit 0-d outputs [8].
One email a day. Unsubscribe in one click.
Keep up with PyTorch in about 3 minutes a day: what actually shipped — the commits, pull requests, releases, and security advisories that matter.
One email a day. Unsubscribe in one click. Read a past issue →
Action items
- → Pull in the XPU dispatch fix and torch-xpu-ops pin if you're on XPU 2.14 pytorch/pytorch [immediate]
- → Apply GOMAXPROCS=2 to dcgm-exporter if you see 8-GPU OOMKills pytorch/ci-infra [immediate]
- → Plan for Python 3.11+ before the next torchtitan release pytorch/torchtitan [plan]
- → Review the fused MLA override for DeepSeek-V3 attention pytorch/torchtitan [monitor]
References
- [1] Update third_party/kineto submodule to 4f8caaa (#193990) pytorch/pytorch
- [2] Update torch-xpu-ops commit pin (#193929) pytorch/pytorch
- [3] Add missing XPU: _safe_softmax_xpu dispatch for _safe_softmax (#193786) pytorch/pytorch
- [4] Fused MLA override ↗ pytorch/torchtitan
- [5] Drop Python 3.10 support, require Python 3.11+ (#4180) pytorch/torchtitan
- [6] Pin GOMAXPROCS=2 on dcgm-exporter to stop 8-GPU node OOMKills ↗ pytorch/ci-infra
- [7] [Performance] Lock TransformedEnv specs by default ↗ pytorch/rl
- [8] fix(executorch): do not resize a 0-d delegate output (#4469) pytorch/TensorRT