Mobile — Cloud Test Labs

Local simulators and emulators cover most cases. For real-device coverage (older OS versions, Samsung quirks, network shaping, regional devices) you need a cloud lab. Most are paid; only Firebase Test Lab has a meaningful free tier. For test framework choice see Mobile — Testing Frameworks.

Free / generous tier

• ★ Firebase Test Lab — Google-hosted real devices and virtual devices. Free quota daily for Spark plan; paid beyond. Robo (smart crawler) tests + Espresso/XCUITest/Maestro flows. The default first stop.

Paid

• BrowserStack App Live / App Automate — large device farm; Appium / Espresso / XCUITest / Maestro. No free tier for app testing in 2026.
• Sauce Labs Real Device Cloud — long-running incumbent; Appium-shape; paid.
• AWS Device Farm — pay-per-device-minute; integrates with AWS pipelines; cheap at low volume.
• LambdaTest Real Device Cloud — newer; competitive pricing; supports many frameworks.
• Headspin — paid; strong global device pool and network conditioning.
• Kobiton — paid; supports custom device labs on-prem.
• Bitbar — Smartbear's device cloud; paid.

Self-hosted device labs

• ★ Open STF (Smartphone Test Farm) — open-source web-based farm for Android devices. Free.
• DeviceFarmer (community fork of OpenSTF) — actively maintained.
• Selenium Grid for mobile — via Appium Grid.
• AWS Device Farm Private — bring-your-own devices to AWS.

Specifics by platform

• iOS real devices — required for any IAP, push, ATT, biometric flow.
• Android real devices — required for OEM-specific quirks (Samsung One UI, Xiaomi MIUI, Huawei) — emulators don't model these.
• Wear OS / watchOS / tvOS — Firebase Test Lab covers Wear; tvOS / watchOS are device-only and harder to find in clouds.

What to test where

• Smoke tests on every PR: simulator/emulator (free, fast).
• Pre-release sweeps: real-device cloud across top 5 devices and bottom 1 OS version you support.
• Crash regressions: pair with Crash Reporting.
• Visual diff: see Snapshot Testing.

Cost reality

• Firebase Test Lab's free quota is small (a few minutes/day on Spark) but enough for indie projects.
• Pay-per-minute clouds (AWS Device Farm) work well at < 1k minutes/month.
• Subscription clouds (BrowserStack, Sauce) make sense for QA teams running thousands of test minutes monthly.
• Self-hosting STF / DeviceFarmer pays off when you have actual quirky regional devices to test against.

Pick this if…

• Default first lab, indie: Firebase Test Lab.
• Cheap pay-as-you-go in AWS: AWS Device Farm.
• Heaviest real-device matrix needed: BrowserStack or Sauce.
• Self-host with your own dev devices: OpenSTF / DeviceFarmer.
• Network-conditioning + global devices: Headspin.