RepoJournal
Google

Google

JAX, the GenAI SDK, and the Cloud libs - Google's open source layer

Keep up with Google in about 3 minutes a day: what actually shipped — the commits, pull requests, releases, and security advisories that matter.

One email a day. Unsubscribe in one click.

Pick a date

Topics: AI / ML Python Full archive →

The Wire · Showcase

JAX CUTS MEMORY OVERHEAD IN REVERSE-MODE DIFFERENTIATION WITH SPARSE GRADIENT UPDATES

By RepoJournal · Filed · About Google

1 person shipped this

JAX's mutable arrays feature now handles autodiff with refs efficiently, transforming dense gradient computations into sparse in-place updates that cut memory pressure on large embedding models.

The JAX team documented critical interactions between Ref types and automatic differentiation [1], showing how jax.vjp with_refs accumulates gradients via += instead of overwriting them. This pairs with a new fancy transpose rule for gather operations [2] that replaces dense materialization with direct indexed updates: gather operations that look like embedding lookups (NumPy-style advanced indexing over leading axes) now become single in-place adds on the gradient ref instead of materializing a full dense array, scattering into it, and adding the result back. The practical impact hits immediately on production workloads. A follow-up on hijax type safety [3] hardens error handling for missing methods and device_put operations on higher-order JAX values, while the FFI docs now integrate hijax patterns with proper sharding semantics [4]. This is the autodiff efficiency win the framework has needed.

One email a day. Unsubscribe in one click.

Action items

References

  1. [1] [mutable-arrays] document Ref autodiff interactions, esp jax.vjp with_refs ↗ google/jax
  2. [2] [vjp3] add a fancy transpose rule for gather_p, for sparse gradient-ref updates ↗ google/jax
  3. [3] [hijax] followups: better errors for missing hitype methods and device_put of hi values ↗ google/jax
  4. [4] [hijax] update ffi docs with hijax, handle sharding ↗ google/jax

Quick answers

What shipped in Google on July 4, 2026?
JAX's mutable arrays feature now handles autodiff with refs efficiently, transforming dense gradient computations into sparse in-place updates that cut memory pressure on large embedding models. In total, 20 commits and 10 pull requests landed.
Who contributed to Google on July 4, 2026?
1 developer shipped this update, including mattjj.
What were the notable Google updates?
[mutable-arrays] document Ref autodiff interactions, esp jax.vjp with_refs, [vjp3] add a fancy transpose rule for gather_p, for sparse gradient-ref updates, and [hijax] followups: better errors for missing hitype methods and device_put of hi values.

More from Google

Daily updates, in your inbox

Follow Google

Keep up with Google in about 3 minutes a day: what actually shipped — the commits, pull requests, releases, and security advisories that matter.

or

One email a day. Unsubscribe in one click. Read a past issue →

Elsewhere on the wire

Want every project, not just this one?

We use privacy-friendly analytics (Google Analytics, IP-anonymized) to see which pages help readers. No ads, and we never sell your data. See our Privacy Policy.