Introduction

QMetry Configuration allows you to create the Execution Result of your choice. In addition to the system defined Execution Results – Fail, Blocked, Not Executed, Work In Progress, and Pass, you can add customized Execution Results that suit your project's need. You can set the Priority of the customized Execution Result. The customized Execution Result can also be Edited.

The system defined Execution Results are available for all projects. On other hand, the QA manager can define custom Execution Results at the project level and set the priority of the result.

Note: System default result can neither be edited nor be deleted.

Example: Your testing process needs execution result Omit to exclude some Test cases from execution. The QA manager can add Omit status and set the priority below Fail.

Permissions Required:

Jira Permissions: Browse Project permissions are required.

QMetry Permissions:

• If Enabled then the below permissions are required.

  • Configuration View

  • Configuration Modify

Auto Update Execution Result

Users with “Configuration Modify” rights can enable or disable the Auto Update Execution Result feature. If enabled, the test case execution result will be auto-updated in accordance with the change in test step execution result. Any change in the execution result of a test step will also impact the execution result of its test case.

This is a project-based configuration. The settings will be applicable only to the current project.

Open

Manage Execution Results

You can create, edit, delete, and copy the execution results.

Creating an Execution Result

Users need to have Configuration “Modify” access to the project for creating execution results.

Below are the steps to create custom execution results:

1. Go to QMetry menu > Configuration > Select your Project. 

2. Under Test Execution select Execution Result.

3. Enter a new execution result e.g. enter 'Omit' as execution result name and fill in its relevant description.

4. Select color for the Execution Result and click Add.

   Open

   

Editing an Execution Result

Users having Configuration “Modify” access to the project can edit an execution result that is already created.

Users can edit values (i.e. Name, Description, Color) of System as well as Custom Execution Results. Execution Results already used in assets will also get updated accordingly. Users with Configuration “Modify” rights for the project can edit the Execution Results.

Note: Modifying Execution Result names will reset the existing filters applied to those values.

Steps to edit an execution result:

1. Click on the execution result name to edit, and a text box to enter the new execution result name appears as shown in the below screenshot.

2. Type the new name and click on the tick mark symbol.

You can edit the Description and Execution Result Color in the similar manner.

The confirmation message pops up. Click Confirm to proceed.

Change Execution Result Color

Users can change the color of System as well as Custom Execution Results. The color of execution results that are already used in assets will get updated accordingly. Users with Configuration “Modify” rights for the project can change the color of Execution Results.

Steps to change the color of an execution result:

1. Click on the existing color of the execution result. The color picker opens as shown in the screenshot below.

2. Select the color you want to set for the execution result.

Copy Execution Result to Other QMetry Projects

Users can copy Execution Results from one project to other projects. The functionality allows users to use similar items in different QMetry projects without having to add these items individually.

Users can save their time as they do not have to create redundant/duplicate items for different QMetry projects.

1. Select the items that you want to copy to other QMetry Projects and click Copy at the top right corner.

2. Now select the project wherein you want to copy the selected items. You can select multiple QMetry Projects (maximum 5 projects) at a time to copy the items.

Duplicate entities will be ignored while copying.

Delete a Custom Execution Result

Users having 'Configuration modify' access to the project can delete custom execution results that are created by users. System Default execution results can not be deleted.

Below are the steps to delete execution results:

1. Go to QMetry menu > Configuration > Select your Project 

2. Under Test Execution select Execution Result. The Execution Result's list is displayed on the screen.

3. Click on the Delete icon of the Execution Result that you want to delete.

Set Priority of Execution Result

You can set priority of the Execution Result when the Auto Update Execution Result is enabled. The sequence of the system default results represents their priority. You can add new execution results anywhere in between the system results. 

For example, in the below image a new status “Omit” is added in between the “Fail" and “Work In Progress” status. You can still arrange the statuses in sequence.

You can change the Execution Result precedence by Drag and Drop operation or directly changing the sequence number.

Example: Your testing process needs execution result Omit to exclude some test cases from execution. The QA manager can add Omit status and set the priority below Fail.

Search an Execution Result

You can search execution results using the search functionality.

1. Navigate to QMetry > Configuration menu.

2. Click on Execution Result.

3. Click on the search icon to see the text box. Type the keyword in the text box and press ENTER on the keyboard.

Set Execution Result Quick Button

This preference for execution results is set at project level.

Users with “Configuration Modify” access can customize the display of shortcut buttons for execution results on the execution screen. This feature allows users to quickly access execution results while executing test cases.

• Configuration Scope: Preferences for displaying the Execution Result quick buttons are set at the project level.

• Status Options: You can configure a minimum of 3 and a maximum of 5 execution statuses to be displayed on the Execution Screen.

→ Required Permissions

Jira Permissions : Browse Project permissions are required.

QMetry Permissions :

• If Enabled then below permissions are required.

  • Configuration View

  • Configuration Modify

On the execution screen, the buttons for preferred execution status will displayed in a way that you can access them quickly to assign status to the test cases.

Timer Settings

The Timer Settings allows you to set configuration for calculation of Actual Time on the execution screen.

→ Required Permissions: Users with “Configuration Modify” rights can modify the settings to On and Off.

• Automatically start the timer when users commence the execution of the first or any step of any test case:

• Allow users to manually override the recorded time captured using the timer in the actual time field:

Notes:

• The settings are valid for manual test case executions and not for automated test case uploads.

• If the timer is initiated to record the time of an on-going execution and the browser tab gets closed during the execution, the time will not be saved automatically.

Auto Stop Timer

Note: The Auto Stop Timer settings are only available when the Auto Update Execution Result option is enabled.

The Auto Stop Timer settings allow you to stop the timer automatically as and when the test case step execution status is changed to one of the configured or selected execution statuses. For example, if the “Blocked” and “Fail” statuses are selected in the configuration. Now, whenever the test steps execution status achieves either “Blocked” or “Fail” status, the status of the test case is auto updated with the assigned status. It assumes that the test case execution is completed, and hence, the timer gets stopped automatically.

The Auto Stop the Timer settings are applicable to both system and custom execution statuses. The “Failed” and “Blocked” statuses are selected by default; you can also select other statuses.

→ Required Permissions: Users with “Configuration Modify” rights can modify the settings to On and Off.

• When Auto Update Execution Result is enabled:

  • The “Failed” and “Blocked” Execution Results are selected by default for the Auto Stop Timer. When a step's status is marked as “Failed” or “Blocked” during execution, the overall test case status is automatically updated to “Failed” or “Blocked” accordingly. In this case, the timer will automatically pause. You can resume it manually, but you must stop the timer manually as well; otherwise, it will be auto-stopped and saved.

  • You can remove the default selection of Execution Result and select other results.

• When Auto Update Execution Result is disabled:

  • The timer will not be affected when a step's status is marked as “Failed,” “Blocked,” or any other selected status; it will automatically stop instead.