Free Engineering Workbench calculator

Flaky test cost

Put a monthly cost on flaky tests that fail pipelines and get rerun.

Open Flaky test cost in the live, interactive calculator — type your numbers, see the result instantly.

Open live calculator →
Quality & testing

How it's worked out

  • Cost = runs × flaky share × days × minutes ÷ 60 × people × hourly cost
  • Each flaky failure costs one investigation and rerun
NoteThe bigger cost is trust: when red builds are often flaky, people ignore real failures. Quarantine flaky tests and fix the noisiest first.

Source: Platform-defined; Google Testing Blog on flaky tests (concept)

Need help acting on this number?

VVnT SeQuor's Digital Testing & Automation practice helps teams turn this metric into a plan.

Talk to us →

Related calculators