$ the-wire · showcase
REALTIME CUTS TEST FLAKINESS, SUPABASE FIXES EXPERIMENT BUCKETING
By RepoJournal · Filed · About Supabase · Composed from the cited sources · methodology
Supabase shipped fixes to two critical infrastructure problems overnight: realtime's e2e tests now run reliably across regions, and a PostHog experiment flag was reading wrong bucketing data across the entire platform.
The realtime team crushed a major test stability issue [1] that was dropping broadcast events into unestablished subscriptions and breaking concurrent insert filters with race conditions. They raised Phoenix channel join timeouts to 10 seconds for APAC replay channels, then swapped out flaky ID-based filtering for UUID comparisons. This hits the team hard: unreliable tests mean you can't trust your deployments. The fix clears the path to ship with confidence again. On the main repo, engineers merged a critical experiment flag fix [2] that made the dataApiRevokeOnCreateDefault PostHog flag reads shape-agnostic instead of multivariate. The flag was bucketing correctly (treatment split reconciled to 2.56% vs expected 2.5%), but control users were invisible to the system. That means every experiment using this flag has been blind to half its data. In lighter news, billing updated storage pricing math [3] to account for month-length variance. The difference between 744-hour and 730-hour months was creating a 1.5% pricing drift. It's a small fix, but billing caught it and cleaned it up.
Action items
- → Merge the realtime e2e flakiness fix before your next test run supabase/realtime [immediate]
- → Audit any active experiments using dataApiRevokeOnCreateDefault - control bucket data was lost supabase/supabase [immediate]
- → Update pricing displays to reflect new storage month-length math supabase/supabase [plan]
References
- [1] chore: reduce e2e flakiness ↗ supabase/realtime
- [2] fix(experiment): make dataApiRevokeOnCreateDefault flag reads shape-agnostic ↗ supabase/supabase
- [3] chore(pricing-www): adjust storage prices ↗ supabase/supabase
