Test using QMetry Automation Framework

Introduction

QMetry Automation Framework is designed to solve common industry problems related to testing complex web systems. The framework is best suited for writing Automated Web, Mobile Web and Mobile Native Application UI Tests simulate real user activities on the page. The framework is built upon java and integrates TestNG, Selenium/Webdriver, Appium and Perfecto.

Due to the framework’s thorough design, test developer does not need to worry about common tasks such as thread safe browser session for running test in parallel, reporting or to incorporate result with test management tools. The tests run can be configured through standard testing configuration files, the test run filters and behavior can be changed within the config File.

Supported file types : ZIP

Sample Test Result File

The following are the screenshots of the file. Click here to download the Sample Test Result File.

Meta-info.json

test_file.json

Entities

While importing result file, you can choose which level of hierarchy do you want. Test Case-Test Step or Test Scenario-Test Case.

1st level of Entity will be identified by "Scenario Name" attributes. If it already exists, then it is not created again.
2nd level of Entity will be identified by "checkPoints Message" attributes. If it already exists, then it is not created again.

If you would like to see values for these attributes, you can verify in Automation Attributes panel of Test Case/Test Scenario issue page.

Note : By default, Automation attributes panel will be hidden. If you would want you can enable it. Refer Automation Settings to know how to enable Automation Attributes panel.

Story Association

While importing test result file, if you want us to link Test Case or Test Scenario to any of existing story then its possible.

An annotation is added to the Bdd file to associate scenarios with a particular story in JIRA.

Another option is added to the Java test file to associate scenarios with a particular story in JIRA.

Test Case Reusability

While importing test result file, if you want us to reuse Test Case then it is possible.

An annotation is added to the Bdd file to reuse test cases in JIRA.

Another option is added to the Java test file to reuse test cases in JIRA.

Execution Attachments

To add attachments in test run execution through QAF, enable capturing screenshots in QAS. After that you will get folder with all screenshots of automation testing.

You need to provide zip file containing that output folder of screenshots and json output folder.

The relative path of screenshots will be referred from "checkpoints > screenshots" to find the attachment at the relative path in the zip file that is being uploaded.

For example,

If the screenshot path is ../img/TC_11.png, then the file name with TC_11.png needs to be available in img folder in the zip file at root level.