Skip to main content

Creating test plans

A test plan groups test suites together so you can run them all at once or on a schedule. You can run a plan manually at any time by clicking Run, or set up a schedule to run it automatically.

Test Plans list​

Click Test Plans in the left sidebar to see all your plans. The list shows:

Name - The name of the test plan. Click to open it.

Last Run - When the plan was last run.

Last Run Result - The result of the last run.

Updated By - Who last edited the plan.

Updated Date - When the plan was last changed.

Actions - Delete the test plan.

How to create a test plan​

  1. Go to Test Plans

    Click Test Plans in the left sidebar.

  2. Click + Create Test Plan

    Click the + Create Test Plan button in the top right corner. A new test plan opens with the name Untitled Test Plan.

  3. Name the test plan

    Click directly on Untitled Test Plan at the top to edit the name. Type a clear name and press Enter.

  4. Add a description (optional)

    Click Add a description below the name to add a short note about what this plan covers.

Inside a test plan​

A test plan has three tabs:

Suites and Devices - Add test suites and configure test machines to run the plan on.

Schedules - Set up automatic scheduled runs for this plan.

Execution History - See all previous runs of this plan with their results.

The right panel has a Tag field to add tags to the plan.

Step 1 - Add test suites​

  1. Click + Add Test Suites

    In the Suites and Devices tab click + Add Test Suites. An Add Test Suites popup appears with two panels - Available Suites on the left and Selected Suites on the right.

  2. Select suites

    Click the + button next to any suite on the left to move it to the Selected Suites panel. Use the >> button to move all suites at once. Use the << button to remove all.

  3. Click Add Suites

    Click Add Suites to confirm. The selected suites appear in the plan with their assigned machine shown as a tag.

  4. Manage suites later

    After adding suites the Suites and Devices tab shows two buttons at the top: Manage Test Suites to add or remove suites, and Map Suites To Machines to assign machines to suites.

Step 2 - Add a test device​

A test device tells QAlity which machine and browser to use when running the plan.

  1. Click + Add Test Device

    In the Test Devices panel on the right click + Add Test Device. An Add Test Machine popup appears.

  2. Fill in the machine details

    Fill in the following fields:

Name - Give the machine a name like 'machine' or 'Chrome Staging'.

Agent Type - Choose Cloud Execution to run in the background, or Local Devices to run on your own machine.

Test Machine - Select the machine to run on.

OS Version - The operating system version shown automatically.

Browser - Select Chrome.

Browser Version - Enter the Chrome version to use.

Map to all suites - Toggle on to automatically assign this machine to all suites in the plan.

  1. Click Create

    Click Create. The machine appears in the Test Devices panel showing its Type, Browser, Browser Version, Headless, Map to all suites, and Suites count.

Running a test plan​

You have two ways to run a test plan:

Run manually - Click the Run button in the top right corner of the test plan at any time to run it immediately.

Run on a schedule - Go to the Schedules tab and click + Add Schedule to set up automatic runs. See Scheduling test plans for full details.

Before running

Make sure your test plan has at least one test suite with test cases and at least one test device configured. Without these the plan cannot run.