View Imported Test Results

Users will receive an email notification containing test run details as soon as the import process is completed.

The automation API also returns the Test Run key that is generated or reused for uploading the results.

{
  "testRunURL": "{{JIRA Base URL}}/browse/JQ-1", 
 "testRunKey": "JQ-1"    
}


Follow the Test Run key URL to track the status of your automation upload.

  • If Test Run workflow status is,
    • In Progress : This means the upload of test results is still in progress.
    • Any Jira workflow status : Either automation is completed or Failed.
      • If it is completed successfully then you can see the Test assets linked to Test Run. 
      • In case of failure the error will be shown under automation summary.txt file. If this file is not attached then enable this option from QMetry menu > Configuration .

Execution Results in QMetry Test Manager for JIRA

You can view the automation results of test cases and test scenarios on Test  Run Execution Screen as shown here.



Click the automation icon to view automation details for the specific test scenario/test case.

If the test case is failed, then the relevant error message is displayed.

It is the execution time of the particular test case.

Execution time for a test scenario is the total of execution time of all the test cases under it.


When you call the REST API, the import process starts running in the background and the test run status is displayed as "In Progress". Once the import process is complete, you will be notified by email and the test run status will be changed to its previous state.

The Automation Summary.txt file gets attached to the created test run on completion of the import process. The file contains Test Scenario and Test Case details for the test run. It displays the following statistics:

  • New Test Scenarios Created
  • Total Test Scenarios Re-Used 
  • New Test Cases Created 
  • Total Test Cases Re-Used

In case the automation test fails, the relevant error message is shown in the file as below.




Automation Attributes

Automation Attributes are used to identify automated test cases and test scenarios uniquely. If you import another result having test scenario or test case, which has been imported previously, then existing test case or test scenario will be reused based on these attributes.


Automation Attributes section for Test Case


Automation Attributes section for Test Scenario