Test Execution Reports

The Test Execution report helps the testing team, the project manager, and the product owner to understand the status of the testing and the overall stability of the application. The report enables the user to get a detailed understanding of the status of the Test Case within a single or multiple Test Cycle. The report allows the user to view the executions graphically or in tabular format.

Test Execution Reports can be shared and discussed during retrospectives as they contain detailed test execution status. The report can help the organization visualize its current quality and plan QA and Development activities timely.

For the selected Project, the Test Execution Report shows how many tests were run over a period of Time, Sprint, or Version. The report displays the overall progress of test executions.

QMetry allows users to configure and generate reports to retrieve the details with a variety of customization. For further details, you can browse through the Configure and Generate Report and View Report.

Note: The report export does not include the Test Execution custom fields in it.

The different options available to generate the Test Execution Report are mentioned below.

Test Case Execution Summary Report

The Test Case Execution report helps the testing team, the project manager, and the product owner understand the status of testing and the stability of the overall application. The report shows the count of test cases based on statuses like passed, blocked, failed, not executed, etc. The report can be grouped on the following mentioned parameters.

• By Project

• By Test Cycle

• By Environment

• By Build

• By Execution Assignee

• By Label

• By Component

• By Test Case Type

• By Requirement

• By Time Frame: The report displays the count of test cycle executions performed in a project(s) during the defined time frame of Daily, Weekly, Monthly, and Yearly. In addition to a specified number of days, you can define a time frame using custom date ranges and operators like =, >, <, <=,>=. The options to select a period depend on the frequency you select to generate the report. The following table displays the maximum duration set to generate the report.

Open

Open

Once the Test Case Execution Report is configured and generated considering By Test Cycle for example.

• Test Case Execution Report can be generated in the bar chart, line chart, pie chart, and table formats.

  • The report can be exported to an Excel file for sharing. Users can export the report using the export button.

  • Test Execution Summary can be exported using the following options:

    1. With steps: The exported report contains all Test Steps for all Test Cases in the selected Test Cycle.

    2. Without steps: The exported report contains only the list of Test Cases in the selected Test Cycle.

The bar graph displays the test cycle summary, test case count, and corresponding percentage on hover.

Line Chart:

The pie chart displays a drop-down menu with values appropriate to the grouping of the Test Case Execution Summary report. For example, for Test Case Execution Summary By Test Cycle the pie chart shows the drop-down menu with the test cycles covered in the report. In the same way, the pie chart report for Test Case Execution Summary By Build will show the drop-down menu with builds considered in generating the report.

The tabular view displays the test execution summary in a two-dimensional view that includes the count of the executed test cases and the percentage. Users can click on the Test Cycle Key to view the test cycle details.

Additionally, 2 new filters have been included with DD/MM/YYYY format which enables users to export reports based on “Created” and “Updated” details for Test Assets as shown in the screenshot below:
The example below is for Test Case filtered by “Created On” and “Updated On” for Test Case Execution Summary “By Test Cycle”.

Test Case Execution Overall Effort Summary

The report provides a comparison between the Estimated Time for test case execution vs. Actual Time taken for test case execution. The Test Case Execution Overall Effort Summary Report would help the user to make sure that the tasks are being completed in a set amount of time; through which the user will be able to understand the lag,

Once the Test Case Execution Overall Effort Summary is configured and generated.

• The report can be viewed in three distinct graphs: Bar Chart, Line Chart, and Pie Chart

• Also, a tabular form can be used to represent the data.

• The report can also be exported into an Excel file for sharing. Users can use the Export button for the same.

• The Test Case Execution Overall Effort Summary can be exported using the following options:

  1. With steps: The exported report contains all Test Steps for all Test Cases.

  2. Without steps: The exported report contains only the list of Test Cases.

Test Case Execution Effort Summary By Execution Assignee

The report displays the Execution Assignee-wise summary of the Estimated Time vs. Actual Time of test case execution. It shows the actual time taken by the Execution Assignee to whom the Test Case was assigned for execution. Use this report if you want to know the efforts put on a given execution by an individual assignee.

Once the Test Case Execution Effort Summary By Execution Assignee is configured and generated.

• The report can be exported into an Excel file for sharing it further. Users can use the Export button for the same.

• The Test Case Execution Effort Summary By Execution Assignee can be exported using the following options:

  1. With steps: The exported report contains all Test Steps based on the execution assignee.

  2. Without steps: The exported report contains only the list of Test Cases based on the execution assignee.