TLDR Tech / Dev
How we raised mobile end-to-end test stability to 98%
Shopify's mobile E2E test suite had become so flaky that it had to be pulled from PR checks, because the old Appium/WebdriverIO setup using React Native Test IDs allowed footguns like arbitrary pauses and asserted on view-hierarchy nodes rather than what a user could actually see. They rebuilt it as an opinionated wrapper with a strict builder-style API that forces an assertion on every step and prefixes escape hatches with UNSAFE_, plus computer vision that finds elements the way a merchant does.
Read the full story