Skip to end of metadata
Go to start of metadata

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 7 Current »

This report is introduced after QMetry version 1.70.

Introduction

This Executive Coverage Report shows what percent of issues have one or many test cases associated.
The report consists of three charts: Story Coverage, Test Run Coverage of selected stories and Defect Coverage of selected stories.

Selection of Stories

In case you have not selected any story to generate the report, then the message displays with a link that opens the list of stories to select from. On the basis of stories selected here, the report will be generated. You can always modify the scope by clicking on the Modify Story Scope button at top. 


 
Select stories, i.e. issues with JIRA issue types, that you want to generate the report for. Multiple options are available to filter stories and select the required ones.
Basic Search: You can filter the search records with the following filters -

  • Issue Type
  • Status
  • Search by: Summary / Issue Key
  • More: Label, Version, Component, Sprint

Advanced Search
You can use JQL for searching stories. Read more about JQL syntax and how to use JQL for search.

Story Coverage

The pie chart displays Story Coverage based on test cases within the selected stories. It provides details of stories bifurcated on the basis of types of test cases within it.

 
Not Covered: It refers to Stories which don't have any test case within it.
Manual Coverage: It refers to Stories which have Manual test cases within it.
Automation Coverage: It refers to Stories which have only Automation test cases within it.
Manual + Automation Coverage: It refers to Stories which have Manual as well as Automation test cases within it.  

The stories counts are clickable.

 


You can drill down each category and view contents of the stories covered in the category.
You can open individual Story page in JIRA.
Export Story Coverage Report
You can drill down to individual category and export the details related to that category into Excel file.
Click on the Export button to export the report details.

Selection of Test Run

By default, latest test run for the test case is considered for calculating test run and defect coverage of selected stories. For example, one of the stories are executed in different three test runs. So, the latest test run for that story will be considered to calculate the statistics. Otherwise, the report is generated for the Test Run Scope you define.
If you want to choose different Test Run not latest one, then you can modify Test Run Scope option. 


Modify Test Run Scope: You can always modify the scope by clicking on the Modify Test Run Scope button at top.

It displays test runs which contain stories you selected above.

Select test runs you want to generate the report for. Multiple options are available to filter test runs and select the required ones. Basic Search and Advanced Search are available to apply different criteria for search. Refer to Selection of Stories above.

Test Run Coverage

Once you select the test runs as described above, you can view the Test Run Coverage report. The bar chart displays count of test case execution results of test cases covered under stories.

 
Once you generate the report, you can see that the counts in the table are clickable.

 
You can drill down each Execution Result and view contents of the test cases covered in the Execution Result.
You can open individual Story page in JIRA.
The records are expandable. You can drill down further from stories to test cases.

Export Test Execution Report: You can drill down to individual category and export the details related to that category into Excel file. Clicking on the Export button to export the report details.

Defect of selected

Test Run

The bar chart displays Priority wise count of defects logged during the test runs. Once you select test runs as described above, you can view the Defect of selected Test Run report. 

 
You can filter the report further by its Story Coverage and Test Case Status. Select required option on the Story and Test Case drop-down menus above the chart.
The counts in the table are clickable. You can drill down each Priority and view contents of the defects (bugs) covered in the test run.
You can open individual defect page in JIRA.

 
You can view the complete hierarchy of association –> Bug – Test Run – Story – Test Case.
Export Defect Coverage Report: You can drill down to individual category and export the details related to that category into Excel file.
Clicking on the Export button to export the report details.

Syncing Report Data

Click on the Refresh icon at the top to sync the report data with data updated in JIRA. The data of stories and test runs, which you selected to generate reports, are updated with the latest changes. The report is generated anew with the updated data.

 



  • No labels