Execution Summary Report

Execution Summary report provides standard industry matrices used by Product Managers, QA managers & Testers to get a summarized view on test executions & issues found during execution for combination of Project, Release, Cycle and Type.

  • Test Suite Execution Summary by Status: The report displays execution summary of the test suites based on execution status of its test case runs.

  • Platform Summary By Test Suites: The report displays execution summary of the test case runs for a combination of Platform and test suites.

  • The report can be generated by applying filters Project, Release, Cycle, Start Date, End Date.

  • The report includes summary of archived test case executions.

  • For eSignature enabled projects, the report shows count for Approved, In Review, Closed execution status.

The report can be generated for multiple projects. You can select more than one project on the drop-down.

  • If only Project is selected (without Release and Cycle), then the latest version of test case will be considered in the report.

  • If Release/Cycle is selected along with Project, then the test case version associated to that Release and Cycle will be considered in the report.

Execution Summary reports show the following matrices. The reports display chart colors matching with the execution status colors in Customization > Execution Status.

Test Case Execution Result 

This report shows summary based on test execution results.

 

Filter Report:
Click on the Filter icon on the individual chart to generate the report as per requirement by applying multiple filters.

  • Start Date and End Date are based on Test Execution Run Creation Date.

Test Execution Analysis

This report shows summary of test case executions grouped Day/Week/Month and Execution Status. This report graph can be filtered by day/week/month.

Filter Report:
Click on the Filter icon on the individual chart to generate the report as per requirement by applying multiple filters.

  • Start Date and End Date are based on Test Execution Run Creation Date.

Issue Summary 

This report shows summary of issues raised during test case executions grouped by Workflow Status and Priority. 

Filter Report:
Click on the Filter icon on the individual chart to generate the report as per requirement by applying multiple filters.

  • Start Date and End Date are based on Test Execution Run Creation Date.

 

Test Case Execution By Assignee

This report shows summary of test case executions grouped Assignee and Execution Status. This report graph can be filtered by assigned testers. 

 

Filter Report:
Click on the Filter icon on the individual chart to generate the report as per requirement by applying multiple filters.

  • Start Date and End Date are based on Test Execution Run Creation Date.

Test Suites Execution Summary

The Test Suites Execution Summary report displays the execution summary of test suites based on the execution status of its test case runs.

  • This report is generated by applying filters on Project, Release, Cycle, Start Date, End Date and Execution Type.

  • It includes Execution Summary of archived test case executions.

  • For eSignature enabled projects, the report shows count for Approved, In Review, Closed execution status.

This report displays overall test suite execution status so that users do not need to open each test suite to view overall execution status of it. This report is helpful for QA Leads and Managers as they can view execution status of test cases under individual test suites quickly without opening each test suite. For example, a test suite has 10 test cases within it - out of which 5 test cases are  "Passed", 2 test cases are "Failed", and 3 test cases are "Not Run".

The Total Platforms and Total Test Cases columns in report displays the respective association with the test suite.

 

Filter Report:
Click on the Filter icon on the individual chart to generate the report as per requirement by applying multiple filters.

Users can set criteria for test suites to obtain the report. The following parameters are available to filter the report:

  • Project

  • Release

  • Cycle

  • Start Date: Start Date is based on Test Suite Creation Date.

  • End Date: End Date is based on Test Suite Creation Date.

  • Execution Type

  • Build

 

Export Report

To export the report, click on the cog icon for the report and select Export Raw Data.

The job scheduled message appears. You can check the export progress in the Scheduled Task section.

Platform Summary by Test Suites

The report displays execution summary of the test case runs for a combination of Platform and test suites.

  • The report can be generated by applying filters Project, Release, Cycle, Start Date, End Date, Platform, and Platform Owner.

  • The report includes Execution Summary of archived test case executions.

  • For eSignature enabled projects, the report shows count for Approved, In Review, Closed execution status.

  • The report displays Platform Summary of all platforms including archived platforms.

 

 

Filter Report:
Click on the Filter icon on the individual chart to generate the report as per requirement by applying multiple filters.

Users can set criteria for platforms to obtain the report. The following parameters are available to filter the report:

  • Project

  • Release

  • Cycle

  • Start Date: Start Date is based on Test Suite Creation Date.

  • End Date: End Date is based on Test Suite Creation Date.

  • Platform

  • Platform Owner

  • Build

Build Execution Summary 

The Build Execution Summary report displays test case executions against Build, for combination of Test Suites and Platforms. It gives QA Manager a summary of which test cases are getting failed/passed against multiple builds. Looking at the summary, the QA Manager can take decision to exclude test cases which are passed against relevant platforms in different builds, in next execution run to save testing efforts.

The report column includes test case summary , test case entity key, test suite entity key, platform, Last Executed Build and selected build (all builds -  if no build is selected).

  • NONE: If the test case is not executed under any build, then the execution status is shown under the None column.

  • Last Executed Build: Last Executed Build column shows the build name the test case was executed last.

 

Filter Report:
Click on the Filter icon  on the individual chart to generate the report as per requirement by applying multiple filters.

  • Project (mandatory)

  • Release (mandatory)

  • Cycle (mandatory) Report will work on cycle level (Single cycle only), this will be mandatory filter.

  • Build: The selected build details will be displayed in the report if test cases are executed on that build. If a build is not selected, details of all the builds with execution will be displayed. Archived build will not be displayed.

 

Export Report

To export the report, click on the cog icon for the report and select Export Raw Data.

The job scheduled message appears. You can check the export progress in the Scheduled Task section.