The Wire · Showcase
CLI E2E CLEANUP BUG LEAVES TEST APPS BEHIND IN DEV DASHBOARD
By RepoJournal · Filed · About Shopify
Shopify CLI's test cleanup was silently failing, leaving orphaned apps scattered across the Dev Dashboard because it mistook an error state for an empty list.
The e2e test suite creates temporary Shopify apps with GitHub Actions run tokens baked into the names for easy cleanup [1]. When individual app deletions failed on Dashboard errors, the fallback cleanup script would check the apps list, see zero cards rendered, and exit successfully without realizing it had hit an error state [1]. This left behind apps from every failed run, polluting the Dev Dashboard and making it harder to identify which test artifacts actually belong to the current run. The fix [2] now forces the cleanup to retry and explicitly verify deletion, rather than treating a zero-card render as proof of success [3]. In parallel, the team bumped Javy dependencies to pull in a QuickJS bug fix from the latest wasm runtime [4], closing a separate gap in function execution reliability.
Action items
- → Merge cleanup fix into main and verify Dashboard is clean Shopify/cli [immediate]
- → Monitor next e2e run to confirm cleanup fully clears test apps Shopify/cli [immediate]
- → Plan Javy v4 adoption in next scheduled function runtime release Shopify/cli [plan]
References
- [1] Fix e2e cleanup ↗ Shopify/cli
- [2] Merge pull request #7936 from Shopify/06-26-fix_e2e_cleanup Shopify/cli
- [3] Fix e2e cleanup CI Shopify/cli
- [4] Update Javy related dependencies ↗ Shopify/cli
FAQ
- What changed in Shopify on June 27, 2026?
- Shopify CLI's test cleanup was silently failing, leaving orphaned apps scattered across the Dev Dashboard because it mistook an error state for an empty list.
- What should Shopify teams do about it?
- Merge cleanup fix into main and verify Dashboard is clean • Monitor next e2e run to confirm cleanup fully clears test apps • Plan Javy v4 adoption in next scheduled function runtime release
- Which Shopify repositories shipped on June 27, 2026?
- Shopify/cli