RepoJournal
Google

Google

JAX, the GenAI SDK, and the Cloud libs — Google's open source layer

Pick a date

The Wire · Showcase

JAX GPU KERNELS GET FASTER MEMORY ACCESS, BIGFRAMES UNLOCKS PANDAS-STYLE COLUMN INDEXING

By RepoJournal · Filed · About Google

copybara-service Yash Katariya skye-ant Allan Renucci mattjj Wanlin Du tswast
7 people shipped this

JAX's Mosaic GPU backend shipped support for specialized matrix load/store instructions that will cut memory bottlenecks on supported hardware, while BigFrames now lets you access DataFrame columns by position like you're working with pandas.

The Mosaic GPU team landed ldmatrix/stmatrix instruction support [1], clearing the path for sharded address calculations that'll meaningfully improve memory throughput on tensor operations. This is the foundation work; the full performance win comes in the follow-up when they enable num>1 sharding, but shipping this now keeps the pipeline moving without blocking downstream work. On the JAX core side, register_hlo_module_transformation got refactored to support AOT compilation [2] by pulling PJRT_Api directly from platforms instead of routing through clients that don't exist in ahead-of-time contexts. This unblocks compiling JAX graphs without initializing a runtime, a critical path for edge deployment and mobile. BigFrames shipped offset-based column access via iloc [3], which means your team can finally use familiar pandas patterns like df.iloc[:, 0] instead of remembering column names. Small QOL win but it closes a friction point for teams migrating from pandas workflows.

Action items

References

  1. [1] [Mosaic GPU] Add basic support for ldmatrix/stmatrix ↗ google/jax
  2. [2] Refactor register_hlo_module_transformation to support AOT compilation ↗ google/jax
  3. [3] feat(bigframes): support offset-based column access via iloc ↗ googleapis/google-cloud-python

More from Google

Daily updates, in your inbox

Follow Google

JAX, the GenAI SDK, and the Cloud libs — Google's open source layer We'll email you a link to confirm first.

Free. Confirm via email. Unsubscribe in one click.

— or follow the whole beat:

Elsewhere on the wire