Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Build 8.6.4 - Release Date: 2020-10-10

Improvements & Bug Fixes

Improvements

Improvements to Test Case and Test Execution

  • Summary and Entity Key are now separate columns on all link test asset screens to allow better sorting and filtering.
  • Enhanced test case steps edit experience with an option to open step details in maximized mode.
  • Users can view shareable test case steps in the test case without scrolling.
  • Test executions with archived release/cycle will be hidden by default.
  • Filter requirements by External key while linking them to Test cases and Test Suites. 
  • Users can hide test steps “Input data” and “Expected Outcome” fields on the execution screen to utilize the space effectively.
  • Link Test case to Test suite panel now displays more test cases on the page. 

Improvements to Jira Integration

  • QMetry authentication from `Jira Integration - QMetry Enterprise` app now supports Open API key (part of Open API app) and two step verification.
  • Jira field mapping configuration is now separate for each integrated issue type.
  • Test case panel, test case details view and test execution sections in Jira issues now have resizable columns.
  • Test case details view in Jira now displays all user defined fields.
  • `Jira Integration - QMetry Enterprise` app v2.0.9 is released compatible with QTM 8.6.4. Customers using Jira Server/DC need to update the app manually, while it is automatically upgraded for Jira Cloud. Server customers need to sync the meta data for all the projects integrated with Jira.

Improvements to Reports

  • Advance Query Reports database schema tables `Requirements` and `Issues` having field names starting with “Jira” are updated with “Ext”. (part of Advance Report app)
  • Users will now be able to set any system or custom dashboard as their default dashboard seen after logging in to QMetry.
  • Introduced new report `Count of API Requests by User` which shows number of Open API or Automation API calls made by each user at a given time.
  • Share dashboards with specific users or all users of a specific role, project combination. (part of Advance Report app)

Improvements to Automation API, Bamboo/Jenkins/Maven Plugins

  • Upload automation results of Robot framework.
  • Added support for uploading automation results from a Bamboo remote agent server.
  • skipWarning parameter have been added that allows to import test cases by truncating summary having more than 255 characters.
  • QMetry Test Management for Bamboo (v1.0.9), QMetry Test Management Plugin for Jenkins (v1.10) & QMetry Test Management Plugin for Maven has been released with above supported improvements.

Improvements to QMetry Administration

  • QMetry Admin can now enforce two step verification for all users by making it mandatory. (part of Customization app)
  • Password expiry related email notifications will be sent to QMetry authenticated users in advance. Organization who have subscribed for customization app can even configure the advance number of days. (part of Customization app)
  • Users having two step verification enabled can now use recovery codes to regain access to the accounts. 
  • Easily filter and find users having two step verification enabled on users list page. 
  • QMetry Admin using On premise installation can now set a maintenance message that will be displayed on login screen to notify users about a scheduled maintenance. (part of Customization app).

General Improvements

  • Export exploratory testing session details, documented test steps and associated defects to a word document. (part of Exploratory Testing app)
  • Share defect details over email to users even outside of QMetry.
  • Import test cases with longer summaries now truncated to 255 characters using option to `Import with Warning`.
  • Gitlab support for BDD integration.

Bug Fixes

  • Fixed a bug that prevented cloning of a project when the project has test case or requirement with attachments moved from another project.
  • Fixed a bug that prevented auto linking of requirements to testcases when requirement key is specified in the automation result file.
  • Fixed a bug that did not display assignee information when Execution Summary Assignee report is exported as PDF.
  • Fixed a bug that prevented display of all records for a tabular view gadget when dashboard is shared using embedded URL.
  • Fixed a bug that displayed the test case execution for a deleted parameter value combination for custom reports generated using the Advanced Query module.
  • Fixed a bug that displayed html tags for large text user defined field when test case is exported to a PDF.
  • Fixed a bug that prevented proper loading of test case when accessed using URL with test case id.

Summary of Open Rest API Changes

The following APIs have been modified. Here is the detailed difference document.

...

API Name

...

REST URL

...

Method

...

Backward compatibility with 8.6.3

...

Request Change

...

Response Change

...

List of Cycles

...

/rest/admin/cycle/list

...

POST

...

Yes

...

Yes

...

No

...

Add BDD Configuration

...

/rest/admin/bddConfiguration/add

...

POST

...

Yes

...

Yes

...

No

...

Fetch Executions for Issues

...

/rest/execution/getExecutionsForIssue

...

POST

...

Yes

...

No

...

Yes

Build 8.6.3.4 - Release Date : 2020-09-18

...

Expand
titleQMetry Test Management v8.6.2

Build 8.6.2.2 - Release Date: 2020-08-03

Bug Fixes

  • Fixed a bug that prevented loading of QMetry on IE browser.
  • Fixed a bug that caused pie chart gadgets to disappear on mouse hover.
  • Fixed a bug that automatically linked release and cycle to the test cases when a test suite is associated to a release and cycle.
  • Fixed a bug that caused custom report sync to stop working after an operation with large amount of data was performed in QMetry.
  • Fixed a bug that prevented loading of 'User Last Login Details' report on Login Summary Dashboard when generated with a large number of records.

Build 8.6.2.1 - Release Date: 2020-07-12

New Features/Improvements

Improvements on Test Execution against Builds

  • Now testers can assign a build for an individual test case execution. This helps when test cases in a same test suite are executed against multiple builds. 
  • QA Managers can make build selection mandatory to ensure testers assign test executions against a build.
  • QA Mangers can set a default build for a release & cycle combination so that test executions are auto assigned an intended build, so that testers do not have set them manually.
  • Now view test case executed build information in the Test case - Test Execution details section along with other execution details.  

Improvements to System & Custom Reports

  • New system dashboard “Test Execution Summary by Folder” is added under QMetry System reports. This dashboard has two reports :-  
    • “Test Execution Summary by Test Suite Folder - Chart” - Displays the execution summary for all test suite folders with count of executions for each execution status. This chart can be drilled to view summary of the subfolders. 
    • “Test Execution Details by Test Suite Folder” report - Display the test execution details for all testcases executed in the test suites for the selected folder.
  • New system reports -
    • Build Execution Summary - Added under Execution Summary dashboard : This report displays test case executions against Build, for combination of Test suites and Platforms. 
    • Count of Unique users by date - Added under Login Summary dashboard : This report displays unique number of users logged in daily.
    • Users last login details - Added under Login Summary dashboard : This report displays last login date and time for each user.
  • Execution Summary report will now display chart colors uniform and matching with the execution status colors. 
  • Modify colors on your custom report charts as required.
  • Every report gadget header now has a reset filter option.

Improvements to Exploratory Testing

  • Capture browser Console and Network logs for a session that are helpful for developers to debug failed scenarios. The Console and Network events recorded during the session will be displayed on the Console and Network Tab for that session. These logs will also be added as attachments to the test case created from the session. The new chrome extension 1.0.6 has an option to record these logs. 
  • Test case created from an exploratory session can now be linked to Requirements & Test Suites from the Exploratory testing screen. The workflow now allows testers to execute the test case by associating it to a test execution from within the session as an evidence of the tested use case. 

Note : Release 8.6.2 upgrade requires to install/upgrade the latest version v1.0.6 of QMetry Test Management – Exploratory Testing extension on chrome browser.

Improvements to Jira Integration - QMetry Enterprise app

  • QMetry Test case panel in Jira for Story and Bugs now displays:
    • Latest test case execution status.
    • Section now has two tabs – Test Steps & Executions (New)
    • Execution Tab displays :
      • Test case executions for a combination of test suite, release, cycle, platform and executed version.
      • Linked Bugs and Test logs for the test executions.
      • Execution details like - Assigned to, Executed by, Executed on & Estimated time. 
    • Test Steps tab – displays Test steps of the linked test case version.
  • Test case detail page in Jira now displays Execution & Test case details in separate tabs.
    • Execution tab displays : 
      • Test case executions for a combination of test suite, release, cycle, platform and executed version.
      • Test case step execution details.
      • Linked Bugs, Test logs, Comments for the test executions and test step
    • Test case details displays complete test case information.
  • Bugs linked directly to requirements in QMetry will now appear in Jira Story “Issue Link” section.

Note : Release 8.6.2 upgrade requires to install/upgrade the latest version v2.0.7 of Jira Integration - QMetry Enterprise App in Jira. For customer using Jira Cloud the add-on will be auto-upgraded to the latest version.

Miscellaneous Improvements 

  • System Admins can now regulate project administrators access with more granular permissions for create, modify, delete, clone for projects.
  • Audit logs now include events for user details like activation, deactivation, role assignments & authentication type changes. 
  • Export Test Suite Summary details (without test cases and steps) from Test Suite module using option “Export Test Suite List Summary View”.
  • Now expand the folder structure panel to easily view long folder names.
  • Execute dependent or independent multiple parallel API calls with Json Batch Support.
  • While importing automation test cases using Automation API, test cases with summary length truncated to 255 characters can be imported, by setting new "skipWarning" parameter to 1.
  • Server installations : System Administrator can now trigger data sync for custom reports, check the sync progress and download logs from Insights configuration screen.
  • Server installations : System Administrator now have an option to disable auto deletion of audit, change and test result logs and retain then forever. 

Bug Fixes

  • Fixed a bug that prevented deactivating a project, if it was the last logged in project for a deleted user. 
  • Fixed a bug that prevented removing user access from a project, if it is the last logged in project for the user.
  • Fixed a bug that displayed mandatory reporter field as optional while creating a Jira issue from QMetry.
  • Fixed a bug that displayed workflow statuses from non-integrated Jira projects while creating/searching issues. 
  • Fixed a bug that prevented loading My Dashboard for some users due to internal duplication of dashboard ids.
  • Fixed a bug that prevented syncing of Jira issue if priority field is not set in any of the synced Jira issues. 
  • Fixes a bug that prevented loading My Dashboard if Jira username for reporter/assignee contains single quote.
  • Fixed a bug that prevented freezing grid header row while scrolling records in a page, across the product. 

Summary of Open Rest API Changes

API Name

REST URL

Method

Backward Compatible to  8.6.1

Request Changed

Response Changed

List all builds

/rest/admin/drop/list

POST

Yes

No

Yes

Create build

/rest/admin/drops

POST

Yes

Yes

No

Get Test Suite Run IDs

/rest/execution/list/platformHome

POST

Yes

No

Yes

Reset execution statuses on build updates

/rest/execution/resetstatus

POST

Yes

Yes

Yes

Get List of Fields

/rest/admin/managefield/list

POST

Yes

Yes

Yes

List Test Case Executions

/rest/testcases/execution

POST

Yes

No

Yes

Fetch Testcase Run ID

/rest/execution/list/viewColumns

POST

Yes

No

Yes

Get List of Users

/rest/admin/user/list

POST

Yes

No

Yes

Bulk Update Run Status

/rest/execution/runstatus/bulkupdate

PUT

Yes

No

Yes

Create Project

/rest/admin/project

POST

Yes

Yes

No

Get List of Execution Statuses

/rest/admin/execution/list

POST

Yes

Yes

No


...