Test Execution Reports

Introduction

The Test Execution report helps the testing team, the project manager and the product owner to understand the status of the testing and the overall stability of the application. The report enables the user to get a detailed understanding of the status of the Test Case within a single or multiple Test Cycles. The report allows the user to view the executions, graphically or in tabular format.

Test Execution Reports can be shared and discussed during retrospective as it contains detailed test execution status. The report can help organization visualize their current quality and plan ahead QA and Development activities timely.

For the selected Project, the Test Execution Report shows how many tests were run over a period of Time, Sprint or Version. The report displays the overall progress of test executions.

To view Test Execution Reports,

1. Go to QMetry Menu > Test Management > Test Report tab.

2. On the Test Report window expand Test Execution Reports

You can drill down to see the following reports

• Test Case Execution Summary

• Overall Effort Summary

• Effort Summary By Execution Assignee

Open

QMetry allows users to configure and generate a customized report to retrieve the details with a variety of customization. For further details on how to configure and generate reports browse through Configure and Generate Report and View Report.

The different options available to generate the Test Execution Report are mentioned below:

Test Case Execution Report

The Test Case Execution report helps the testing team, the project manager, and the product owner understands the status of testing, quality and stability of the product. The report shows the count of test cases passed, blocked, failed, not executed, etc. The report can be grouped on the following mentioned parameters.

• By Project

• By Test Cycle

• By Environment

• By Build

• By Execution Assignee

• By Label

• By Component

• By Test Case Type

• By Requirement

Once the Test Case Execution Report is configured and generated, the report can be viewed in a tabular form or in a graph.

For example, a QA Manager wants to view Test Case Execution summary By Test Cycle 

The bar graph displays the test cycle summary, test case count and corresponding percentage on hover.

Open

The tabular form of the report with the test case count and corresponding percentage.

Overall Effort Summary

The report provides a comparison between the Estimated Time for test case execution vs. Actual Time taken for test case execution. The Overall Effort Summary Report would help the user to make sure that the tasks are being completed in a set amount of time; through which the user will be able to understand the lag,

Once the Overall Effort Summary is configured and generated.

• The report can be viewed in three distinct graphs: Bar Chart, Line Chart and Pie Chart.

• Also, a tabular form can be used to represent the data.

• The report can also be exported into an excel file for sharing. Users can use the Export button for the same.

Effort Summary By Execution Assignee

The report displays Execution Assignee wise summary of Estimated Time vs. Actual Time of test case execution. It shows the actual time taken by the Assignee to whom the test case was assigned for execution. If the user wishes to get the overall efficiency in terms of effort put on by an individual assignee for a given execution, the user can make use of the Effort Summary By Execution Assignee.

Once the Effort Summary By Execution Assignee is configured and generated.

• The report can be exported into an excel file for sharing. Users can use the Export button to export the report.