Test Suites and Scheduling
A test suite is a named group of tests that you run together, for example a quick check after each deploy or a full check every night. You can run a suite with one click or let it run on a schedule.
Which suites do I get by default?
Every new project starts with three suites:
| Suite | Purpose |
|---|---|
| Sanity | A focused and narrow suite that checks specific functions after small changes. It usually covers about 5–10% of tests. |
| Smoke | A shallow and wide suite that checks basic functions, to see if a build is stable enough for more testing. It usually covers up to 20% of tests. |
| Regression | A broad suite that checks existing functions again after code changes, to make sure nothing broke. It usually covers 40–60% of tests. |
The Sanity suite is scheduled to run every day at 3:00 AM in your project’s time zone, on the main environment. You can change or remove this schedule.
How do tests get into a suite?
- By the AI agent. When the agent writes tests during feature discovery, it reads the names and descriptions of your suites and puts each test into the suites that fit. A clear suite description helps it choose well.
- On a test. Open the test and click ADD next to Test suites in the details panel. You can also pick suites when you create a test.
- On a feature. Open the feature and click ADD next to Test suites. When the suite runs, it includes every runnable test in that feature.
To see which tests are in a suite, click the tree icon of the suite on the Test Suites page. It opens the features list filtered by that suite.
How do I create or edit a suite?
- Click Test Suites in the side menu.
- Click ADD TEST SUITE, or click the pencil icon of an existing suite.
- Fill in:
- Test suite name
- Description – say what the suite is for. The AI agent uses this text when it assigns new tests.
- Select a color – the color of the suite’s label throughout the app.
- Click SAVE.
To delete a suite, open it and click DELETE SUITE. The tests themselves are not deleted.
What do the icons on the Test Suites page do?
Each suite in the list has four icons:
| Icon | Action |
|---|---|
| ▶ Run | Runs the suite now. |
| ✎ Edit | Opens the suite’s name, description and color. |
| 📅 Schedule | Opens the suite’s schedules. |
| Tree | Shows the suite’s tests on the features list. |
Click the suite’s name to open a quick view with its description.
How do I schedule a suite?
- Open the suite and choose the SCHEDULE tab.
- Click ADD SCHEDULE.
- Choose:
- Environment – which copy of your app to test.
- Frequency – daily, weekly, monthly, every few minutes or every few hours.
- Run At – the time of day. The time zone of your project is shown next to it. You can change the project time zone in Settings → Organization & Name.
- Click SAVE.
A suite can have several schedules, for example one for staging every hour and one for production every night. Click + ADD to add another. Each schedule shows its Last Run. Click the bin icon to remove a schedule.
What happens when a schedule fires?
At the chosen time, Testifly’s scheduler starts an Execute Tests job for the suite on the chosen environment. It works exactly like a run you start by hand. See Runs and Results. Scheduled runs appear on the Runs and Jobs pages like any other run. Whether you get an email for scheduled runs depends on your notification preferences.
Scheduled runs do not run while a project is inactive, for example after the trial ended.