Test Observability

One Dashboard for Every Test Framework

Unified test observability for Playwright, Appium, and Maestro. Web E2E, native mobile, and UI flow tests — all in one place.

Playwright
AppiumBeta
MaestroBeta
Setup in under 5 minutes
From $5 / month
Unlimited users on all plans

Deep Integration with Every Framework

TestRelic AI is built from the ground up for each framework — not a generic wrapper. You get insights that only a native integration can provide.

Playwright

Playwright

Web E2E & API testing

Trace Viewer Correlation

Click any failed test to jump into the Playwright trace with network, DOM snapshots, and full action log.

Shard Analytics

Visualize shard distribution, spot hot shards, and rebalance parallelism for faster CI runs.

Worker & Retry Insights

See how workers, retries, and project configs affect total wall-clock time across your suite.

Appium

Native iOS & Android testing

Device Log Aggregation

Collect device logs, crash reports, and system events from every iOS and Android session automatically.

Session Video Replay

Full session recordings for every Appium run, correlated with test steps and assertion results.

Device Matrix Analytics

Break down pass rates and failure patterns by OS version, device model, and Appium server configuration.

Maestro

Maestro

Mobile UI flow testing

YAML Flow Step Tracking

Every step in your Maestro YAML flow is captured with timing, screenshots, and pass/fail status.

iOS & Android Run Analysis

Compare run results across iOS simulators and Android emulators to surface platform-specific failures.

Flow Coverage Visibility

Track which user flows have test coverage, identify gaps, and correlate failures with recent app changes.

Everything Works Across All Three Frameworks

Core observability capabilities apply universally — regardless of which framework your test suite uses.

SDK Reporters

Single-line reporter setup for all three frameworks. No proxy servers, no CI plugins — just install and run.

Flaky Test Detection

Automatic detection across all frameworks with historical pass/fail timelines, retry counts, and confidence scores.

CI Pipeline Correlation

Link every run to GitHub Actions, GitLab CI, Jenkins, or CircleCI for full traceability from commit to result.

Unified Search

Full-text search across all logs, traces, and results — filter by framework, status, branch, or custom tags.

Log Aggregation

Centralised log collection from every runner, shard, and device in real time — no more scrolling CI output.

Cross-Run Correlation

Track how failures evolve across commits, branches, and environments for all frameworks in one view.

How It Works

One SDK, zero infrastructure, any framework — live in minutes.

01

Install the Reporter

Add the TestRelic reporter for your framework. playwright.config.ts, wdio.conf.js, or .maestro/ — one line of config.

02

Run Your Tests

Execute your suite as normal. Results, traces, device logs, and screenshots stream to TestRelic AI automatically.

03

AI Analysis

TestRelic AI categorizes failures, flags flaky tests, and correlates results with CI metadata — across all frameworks.

04

Unified Dashboard

Web, native mobile, and UI flow results in one dashboard with search, filtering, and AI-powered insights.

Playwright
npm install @testrelic/playwright-reporter

Configure in playwright.config.ts

Appium
npm install @testrelic/appium-reporter

Configure in wdio.conf.js

Maestro
npm install @testrelic/maestro-reporter

Configure in .maestro/config.yaml

Built for Engineering Teams

Centralized Log Aggregation

Every log, console output, and error trace from every framework — in one searchable place. No more switching between CI jobs.

  • Playwright: sharded run logs aggregated automatically
  • Appium: device logs, crash reports, and system events
  • Maestro: YAML flow step output and screenshot capture
  • Real-time ingestion during test runs

Cross-Run Correlation

Understand how failures evolve across commits, branches, and environments — for every framework in a single view.

  • Automatic commit-level correlation
  • Branch comparison views across frameworks
  • Environment-specific filtering
  • Impact analysis per code change

Unified Search & Filtering

Full-text search across all test results with advanced filtering. Find any failure across any framework instantly.

  • Search across logs, traces, and device output
  • Filter by framework, status, branch, or device
  • Regex support and saved filters
  • Tag-based organisation across teams

Custom Dashboards

Build dashboards tailored to your workflow. Mix Playwright, Appium, and Maestro data in a single view.

  • Drag-and-drop dashboard builder
  • Framework-specific and cross-framework widgets
  • Real-time updates
  • Role-based access control

How We Compare

TestRelic AI is the only platform with native support for all three frameworks.

FeatureTestRelic AIAllureReportPortalDatadog
Playwright — native trace integrationNativePluginManualNone
Appium — device log aggregationNativeManualLimitedNone
Maestro — YAML flow step trackingNativeNoneNoneNone
AI-powered failure triageBasic
Natural language queries
Cross-framework unified viewPartialPartialLimited
Setup time< 5 min30+ min1+ hour1+ hour
Starting price$5/moFree (self-host)$0 (self-host)~$500/mo

One platform. Every framework.

Connect your Playwright, Appium, or Maestro suite and get full observability in under 5 minutes. From $5/month — no credit card required.