Skip to content

Suites tab

The Suites tab of the Test Explorer (/tests?view=suites) lets you build your own groupings of tests and treat each grouping as a single runnable unit.

This is different from the Tests tab. There, a “suite” means whatever your framework already groups together — a spec file, a describe block, a feature file. Here, a suite is something you define: a named set of tests pulled from anywhere in the project, with its own run options, its own schedule, and its own notification rules.

The Suites tab of the Test Explorer
  • A smoke pack. Twelve tests from eight different files that together prove the app is alive. Run them before every deploy.
  • A regression pack per release. Pull the tests that cover what changed, run them as one unit, and re-run only the failures.
  • A nightly job that owns its own settings. A suite carries its own browser/device, extra arguments, setup and teardown — so scheduling it doesn’t depend on someone remembering the right command.

The tab opens on the list of suites you’ve created. Each row shows the suite’s name, how many tests it holds, its last result, and — when a schedule is enabled — a Scheduled badge with a clock icon.

A search box across the top filters by suite name, test name, or tag, so you can find a suite by something inside it rather than only by its title.

Each row carries a Run action that executes every test in the suite using the suite’s default run options.

Opening a suite shows its tests and its configuration.

Every test in the suite appears as a row with its status, name (shown in readable form), and duration. Rows reveal extra actions on hover:

ElementWhat it does
Status + nameThe test’s most recent outcome in this suite, and the test itself.
Retry chipWhen a test needed retries, a chip shows the attempt count — expand it to see each individual attempt.
Open runJumps to that test’s run in Results, with its logs, screenshots, and trace.
RemoveTakes the test out of this suite. It does not delete the test from your project.

A search box filters within the suite once it holds enough tests to need one.

ActionWhat it does
RunExecutes every test in the suite using its default run options.
Re-run only the failed testsRe-runs just the failures from the last execution — the fastest way to confirm a fix without paying for the whole suite again.

A suite’s configuration is grouped into cards:

CardWhat you set
DetailsThe suite’s name and an optional description.
Default run optionsThe browser or device, environment, and any extra arguments (for example -DbaseUrl=https://staging.example.com -Dbrowser=firefox) applied to every test in the suite.
Setup & teardownCommands to run before and after the suite — seeding data, starting a service, cleaning up afterwards.
ScheduleTurn on a cron schedule so the suite runs unattended. The same cron builder used by the Schedules tab is embedded here.
NotificationsWhether to notify on Manual runs, Scheduled runs, or Both.
ChannelsWhere those notifications go — the destinations you configured under Connectors.

Open the Suites tab and create a new suite, give it a name, then add tests to it. You can also select tests on the Tests tab and add them to a suite in bulk.

How do I add tests from several different files?

Section titled “How do I add tests from several different files?”

That’s the point of a suite — add them from anywhere in the project. The suite holds references to the tests, so the files themselves stay untouched.

Open the suite and use Re-run only the failed tests. Nothing that passed is executed again.

Open the suite’s Schedule card, turn it on, and pick a cron expression. The suite runs with its saved default run options — no command to type.

Set Notifications to Scheduled (or Both) and pick your Channels. Configure the destinations themselves under Connectors.

To Results, like every other run. A suite run appears as one master entry; open it to reach each test’s own console output and artifacts.

  • Keep smoke suites small. A smoke pack that takes 20 minutes stops being a smoke pack. Aim for the shortest set that would catch a broken deploy.
  • Put the environment in the suite, not in people’s heads. Default run options travel with the suite, so a scheduled run can’t drift from what you tested manually.
  • Use “re-run only failed” during triage, then run the whole suite once at the end to confirm nothing regressed.
  • Removing a test from a suite is safe — it only unlinks it. The test stays in your project and in the Tests tab.