Test Suite Platform Matrix


Note

This is a customized feature of QMetry. It is not part of QMetry base package.


Introduction

The Platform Matrix View allows users to view the execution status for multiple platforms on a single screen. In addition to viewing and comparing the status for each platform, a manager can assign test cases to testers, mark test cases with a status and assign an Execution Type to test cases in bulk.

When test cases are linked to a test suite, all of them are available to execute on every associated platform. But users generally don’t execute all the test cases they are dealing with on all the linked platforms.

For example,

There are 250 test cases linked to a test suite that has 7 platforms associated with it. But the Test Manager does not want to execute all of the test cases on each platform linked to the test suite.

Before starting the test case execution, user can mark test cases as “Not Applicable” to avoid the test run on such test cases that are part of the test suite but are not intended for execution.

Use Case: The execution batch of test cases is constituted at the Test Manager’s own discretion. For each iteration, they choose which test cases are be executed on which platform. Hence, the organization needs a workflow that includes an easy process to pick the test cases intended to run on the particular platforms.


Platform matrix provides a single view where test cases and platforms can be seen together and also have options to bulk update test case status, bulk update test case assignee and bulk updated test case execution type.

Use Case: There are multiple platforms in a test suite and 150 test cases in an organization. All test cases are not assigned to all the platforms in test suites. QA Leads have to assign test cases to multiple platforms. For the ease of assignment, they need to see all combination of platforms and test cases in one page.


Steps to Access the Platform Matrix View

  1. Go to the Test Suites module.
  2. Open test suite detail page.
  3. On the Test Execution tab, select test suite(s) and click the Bulk Execute button.



The platform matrix screen displays Bulk Operations and Filter options.

The screen displays test cases and platforms associated to the test suite.



If a user selects the first test case check box in the row, then all platforms are selected. Once the row is selected, the user can assign the same tester to all platforms for the selected test case(s), can apply the Execution Status for all platforms for the selected test cases and can define Execution Type of selected test cases.

On clicking the checkbox on the column header, all the test case records are selected with their platforms. User can execute a single or multiple test cases with all selected platforms.

Use Case: QA Manager wants to select all the platform check boxes at a time on selection of a test case row on the Test Suite Platform Matrix screen so that they don’t have to select platforms for the test case one by one.

Note: Platform Matrix remain disabled for archived platforms.


Users can update the following values for multiple test cases at a time:

  • Execution Status
  • Execution Type
  • Assignee

Update Execution Status in Bulk

Previously users could change the status of test cases in bulk to “Not Applicable” only.  Now users can choose any status level for bulk update. In Test Suite Platform Matrix view, users can now change the status of the test case to any status they want. QMetry 6.8 onwards, the Not Applicable button is replaced with Bulk Status Update button.

Use Case: The testers had marked some of the test cases as “Not Applicable” for the previous cycle. Now they want to include the same test cases to current cycle and revert the status to some other status other than "Not Applicable".

The Bulk Status Update button is used to revert the status of a test case or multiple test cases in one go.


As Platform and Test Run are distinct columns, their execution status could remain distinct also.

For example,

If the user marks a test case as “Not Applicable” for its Platform. The test case will still be available to execute for the Test Run.

The status that are updated here, will reflect on the Test Suite Execution Screen.


Steps:

  1. Go to the Test Suites module.
  2. Open test suite detail page.
  3. On the Test Execution tab, select test suite(s) and click the Bulk Execute button. It opens the Test Run page.
  4. On the Platform Matrix screen, select the test cases you want to update the Execution Status of.
  5. Open the Bulk Operations drop-down and select Execution Status.
  6. The Execution Status drop-down enables. Select the status that you want to apply to the selected test cases.



Update Execution Type in Bulk

Testers can mark the executions as Automated or Manual in bulk. By default the execution type is "Manual". Users can change the value to the "Automated" type.

Steps:

  1. Go to the Test Suites module.
  2. Open test suite detail page.
  3. On the Test Execution tab, select test suite(s) and click the Bulk Execute button. It opens the Test Run page.
  4. On the Platform Matrix screen, select the test cases you want to update the Execution Type of.
  5. Open the Bulk Operations drop-down and select Execution Type.
  6. The Execution Type drop-down enables. Select the execution type that you want to apply to the selected test cases.



Update Assignee in Bulk

Users can assign a tester to bulk test cases at a time. Just click in the Assignee cell and type in the text box to filter the tester name to avoid scrolling through the long list of users.


Steps:

  1. Go to the Test Suites module.
  2. Open test suite detail page.
  3. On the Test Execution tab, select test suite(s) and click the Bulk Execute button. It opens the Test Run page.
  4. On the Platform Matrix screen, check the check box for the test case you want to assign a tester to.
  5. Open the Bulk Operations drop-down and select Assignee.
  6. The Assignee drop-down enables. Select the user you want to assign as a tester to the test case(s).



User can still assign a tester to a particular test case row, just by clicking in the Enter Assignee cell on the grid.




Applying Filter

On the Test Suite Platform Matrix View, the test case records can be filtered on Test Case Summary.

View Platform Attributes

To view the platform attributes, click on the platform name.

The pop-up opens showing the platform attributes.