The Wire · Showcase
CLI TEARDOWN GETS 5X FASTER AS ISAAC ROLDÁN KILLS THE FLAKIEST E2E BOTTLENECK
By RepoJournal · Filed · About Shopify
Shopify's test suite just shed its worst leak: app cleanup now runs in parallel via Admin API instead of clicking through the UI, cutting E2E teardown from minutes to seconds.
Isaac Roldán shipped three interconnected wins across the CLI repo that transform E2E reliability. First, the teardown now uninstalls apps via the Admin API [1], ditching the Playwright clicks through Polaris modals and hard-coded waits that were causing leaked stores and apps. Then cleanup itself parallelizes with a five-worker pool [2], batching page aggregation across isolated Playwright instances. The real leverage, though, comes upstream: E2E tests no longer run at all if the build breaks or TypeScript drifts [3]. Roldán's 90-day failure audit found 308 false-positive E2E failures that weren't E2E problems at all, polluting signal and eating CI budget. "~12% of classified failures were not E2E problems at all," Roldán noted in the analysis [3]. All three changes merged and are live. Over in Hydrogen, Frederico fixed a monorepo command path bug where the nested `hydrogen:customer-account:push` discovery was shadowing the canonical `customer-account-push` command, forcing users back to the bundled Shopify CLI version [4].
One email a day. Unsubscribe in one click.
Keep up with Shopify in about 3 minutes a day: what actually shipped — the commits, pull requests, releases, and security advisories that matter.
One email a day. Unsubscribe in one click. Read a past issue →
Action items
- → Monitor E2E shard times and app leak rate over next 48 hours Shopify/cli [monitor]
- → Pull latest CLI to verify Hydrogen command resolution works locally Shopify/hydrogen [plan]
References
- [1] Uninstall E2E apps via the Admin API instead of the store admin UI ↗ Shopify/cli
- [2] Parallelize E2E app cleanup with worker pool ↗ Shopify/cli
- [3] Wait for lint/build before running E2E + Run snapshot check outside E2E ↗ Shopify/cli
- [4] Fix local Hydrogen CLI command resolution ↗ Shopify/hydrogen