Skip to main content

Test Case Health

Scores test cases on a 0–100 scale combining staleness, execution frequency, and pass-rate pattern detection. Use it to find stale or abandoned tests and to spot suspicious pass-rate patterns (e.g., tests that have only ever passed and may not be exercising the system at all).

Health Status​

Each case is classified into one of four buckets:

StatusCriteria
Never Executed0 executions in the lookback window
Always Failing0% pass rate, with at least the minimum-executions threshold met
Always Passing100% pass rate, with at least the minimum-executions threshold met — flagged as suspicious, since a never-failing test may not be exercising anything
HealthyMixed results, or fewer executions than the minimum-executions threshold

Staleness​

Independent of the health bucket, a case is flagged as stale when daysSinceLastExecution > staleDaysThreshold (default 30 days).

Settings​

  • Stale Days Threshold — 7–90 days (default 30)
  • Min Executions for Rate — 3–20 executions needed before a case can be classified as Always Passing or Always Failing (default 5)
  • Lookback Days — 0–365; 0 means all-time

Filters​

Filters live in the Filters menu at the bottom of the report settings. Each filter accepts several values, and a row matches if it has any of them. When you use several filters, a row must match all of them. A filter with nothing selected doesn't narrow the report.

  • Automated — Yes (automated cases), No (manual cases)
  • Folder — cases in the selected folders (project report only). Include subfolders, on by default, also covers every folder beneath them.
  • Health Status — Healthy, Always Passing, Always Failing, Never Executed
  • Staleness — Stale, Not Stale

Sort Order​

Results are sorted by health-status priority (Always Failing first), then by staleness, then by score. Sorting by a column reorders the whole result set; the table loads more rows as you scroll, and the summary tiles and chart always describe every matching case, not just the rows loaded so far. Export CSV exports every matching case.