RepoJournal
Google

Google

JAX, the GenAI SDK, and the Cloud libs - Google's open source layer

Keep up with Google in about 3 minutes a day: what actually shipped — the commits, pull requests, releases, and security advisories that matter.

One email a day. Unsubscribe in one click.

Pick a date

Topics: AI / ML Python Full archive →

The Wire · Showcase

JAX SHIPS MULTI-GPU COLLECTIVE KERNELS AND MOSAIC GPU OPTIMIZATION WAVE

By RepoJournal · Filed · About Google

JAX's Pallas GPU kernel interpreter now simulates multiple GPUs with shard_map, while Mosaic GPU generates optimized PTX conversions that cut instruction bloat by half [ref:4] [ref:3].

The Pallas GPU kernel interpreter landed three major capabilities overnight: type annotation clarification for callbacks [4], multi-GPU simulation support via shard_map [1], and block/cluster coordinate logging for debugging [5]. On the Mosaic side, engineers shipped an architecture win—generating multiple pairwise PTX conversions in a single inline_asm [2] eliminates the "forest of prmt instructions" LLVM was generating, letting ptxas optimize vector casts dramatically cleaner. The NCCL collective peer address handling [3] now works across processes, unlocking true distributed kernel launches without host-side parameter rendezvous in the symmetrical memory case. Meanwhile, python-genai cut a patch release [6] fixing response_format field naming to snake_case conventions [7], a small but necessary standardization. On the broader cloud SDK front, BigFrames simplified its @udf wrapper object [8], BigTable added client-side metric instrumentation to basic RPCs [9], and db-dtypes dropped Python 3.9 support entirely [10]—a clean break that signals confidence in the 3.10+ baseline.

One email a day. Unsubscribe in one click.

Action items

References

  1. [1] [Pallas][GPU kernel interpreter] Support simulating multiple GPUs with `shard_map`. ↗ google/jax
  2. [2] [Mosaic GPU] Generate multiple pairwise PTX conversions when possible ↗ google/jax
  3. [3] [Mosaic:GPU] Use NCCL API on the host to collective peer addresses. ↗ google/jax
  4. [4] [Pallas][GPU kernel interpreter] Clarify type annotations, esp. of Jax/Numpy arrays, of callback arguments. ↗ google/jax
  5. [5] [Pallas][GPU kernel interpreter] Log coordinates of blocks/clusters in the grid. ↗ google/jax
  6. [6] v2.0.1 ↗ googleapis/python-genai
  7. [7] fix: Update response_format field names to snake_case. ↗ googleapis/python-genai
  8. [8] refactor(bigframes): Simplify @udf wrapper object ↗ googleapis/google-cloud-python
  9. [9] feat(bigtable): add client side metric instrumentation to basic rpcs ↗ googleapis/google-cloud-python
  10. [10] fix(db-dtypes): Drop support for Python <= 3.9 ↗ googleapis/google-cloud-python

Quick answers

What shipped in Google on May 9, 2026?
JAX's Pallas GPU kernel interpreter now simulates multiple GPUs with shard_map, while Mosaic GPU generates optimized PTX conversions that cut instruction bloat by half [ref:4] [ref:3]. In total, 38 commits, 35 pull requests, and 1 releases landed.
Who contributed to Google on May 9, 2026?
4 developers shipped this update, including copybara-service[bot], TrevorBergeron, daniel-sanche, and chalmerlowe.
What were the notable Google updates?
[Pallas][GPU kernel interpreter] Support simulating multiple GPUs with `shard_map`, [Mosaic GPU] Generate multiple pairwise PTX conversions when possible, and [Mosaic:GPU] Use NCCL API on the host to collective peer addresses.

More from Google

Daily updates, in your inbox

Follow Google

Keep up with Google in about 3 minutes a day: what actually shipped — the commits, pull requests, releases, and security advisories that matter.

or

One email a day. Unsubscribe in one click. Read a past issue →

Elsewhere on the wire

Want every project, not just this one?