How We Raised Mobile End-to-End Test Stability to 98%

2026-09-07

Shopify rebuilt its flaky mobile E2E framework around a strict builder API that requires an assertion after every action and labels escape hatches as UNSAFE_. PaddleOCR and OpenCV now locate visible text and icons the way users see them, helping raise test stability from 50% to 98% while annotated videos make failures easier to diagnose.