Release Notes

Build 8.13.0.1 - Release Date: 2023-07-27

Bug Fixes

• Fixed a bug that prevented viewing and downloading certain older attachments on the test execution screen.

• Fixed a bug that prevented the display of some older images in the test step details and caused an error when updating the test case.

Build 8.13.0 - Release Date: 2023-07-12

New Features, Enhancements & Bug Fix

New Features

Launch CI/CD pipelines from within QTM

• With continuous testing, CI/CD pipelines today are responsible for multiple tasks, including test execution. Integrate QTM with your preferred CI/CD platform, such as Jenkins, Bamboo, Azure DevOps, GitLab Runners, GitHub Actions, and Circle CI, to trigger automated testing pipelines with a single click. Now, testers can save and launch remote CI/CD pipeline jobs directly from QTM. Testers can select and map a configured rule to a test suite, then trigger the pipeline job and automate the uploading of the results after successfully executing the job. This feature enables all testers to participate in test automation and also reduces the overhead of navigating between multiple tools by automating the testing process and reporting results.

Enhancements to Test Execution

• Introduced a timer (stopwatch) for testers to automatically record the time taken in minutes to execute the test case; to accurately measure the actual test execution duration.

• The Test Suite - Test Case tab now displays an indicator to help testers quickly identify parameterized test cases that do not have data values assigned for executions.
  @ Blue Color - Indicates parameterized test cases that do not have data values assigned for executions.
  @ Green Color - Indicates parameterized test cases having values assigned for all parameters.

• Unlinking of the Release/Cycle or Platform associated with closed test executions is restricted for eSignature-enabled projects to prevent accidental unlinking and preserve the test execution records.

Introducing Co-Ownership for Custom Dashboard and Gadgets

• Introduced an ability for owners to share custom gadgets and dashboards with edit permissions; by appointing others as co-owners.

• The super administrator can now view the list of all custom dashboards and report gadgets created by any user in the system and share or assign other users as co-owners, individually or in bulk.

• While deactivating a user, the administrator can now assign another user as co-owner of the gadgets and reports owned by the user getting deactivated.

Enhancements to Attachments

• Inline Attachments - Add inline images to textboxes using the copy & paste; click to view them.

• Attachment Section -

  • Introduced a new thumbnail (strip) view that displays the preview of Attachments; click on the images and files under the Attachments to view them without downloading them.

  • Preview uploaded images while submitting them on the add attachments window.

Miscellaneous Improvements

• Introduced a button to keep the menu panel expanded/collapsed while navigating around modules & pages.

• Introduced a user setting to toggle the auto-pop-up behavior of the QQBot suggestion window allowing users to customize their preferred experience with the bot while viewing the predictions.

• The issue status is now displayed at the top of the issue details screen, alongside the issue key, making it easier for users to focus on it when viewing the complete details.

• The Test Executions export for an eSignature-enabled project in PDF or Word now includes the approval details of the Test Cases.

• The Test Case and Execution export in PDF now supports both landscape and portrait orientation modes. The report header on each page contains the Logo, Background, Project Name, Report Name & Exported Time.

Enhancements to Jira Integration

• The QMetry section within the Jira story and bug page now displays the Owner, Category, and Labels for linked test cases, along with other relevant test case fields providing comprehensive information about the test cases.

• Release 8.13.0 upgrade requires an install/upgrade of the QMetry Jira Integration app latest v2.2.4. For customers using Jira Cloud, the add-on will be auto-upgraded.

• QMetry Jira Integration app v2.2.4 is compatible with Jira Server/DC v9.9.0

Enhancements to eSignature workflow

• Introduced an option to turn off the Approval workflow for test suite executions in the eSignature-enabled projects; with the approval workflow turned off, executions would be system approved by default and ready to execute. The Closure workflow will be in place as before.

• Uploading automation results would require only automation permissions, and users would no longer need Test case & Test Suite Execution permissions for the last approval level.
  
  

Improvements to Automation Test Result Imports 

• Improved performance for automation test results imports using Automation API, QMetry Test Management Plugin for Jenkins, QMetry Test Management Plugin for Maven & QMetry Bamboo Integration app.

• The automation result import process now reuses the existing test case version for which the summary and steps match exactly when the test case has multiple versions.

• Introduced a new parameter "is_matching_required" that allows updating execution status on a linked test case version or latest version by matching test case keys in the result file; instead of creating a new version even if the test summary and steps do not match.

• New test suites can be created in a specified folder while importing automated test results using the "tsFolderPath" parameter.

• The job status and the test suite details of the automation test result imports are now visible in the scheduled tasks section.

• The "test suite key" parameter will no longer be available directly in the automation API response. The automation API response will now provide a "request-id" parameter. A followup API using the "request-id" parameter will return the test suite key and import status. For more details, refer to the API changes section.

• The Description value in the result file for the Cucumber framework will be imported as a Test Case Description when a new version of a test case gets created.

• Added support for importing test case step attachments for the QAF framework.

• Reusing existing test cases is supported using the entity key for the Junit framework.

• For the QAF framework, attachments associated with sub-checkpoints are uploaded to their respective test case steps when uploading automation results.

• For QMetry projects using the internal issue module, the "Error message" and "Trace" for the automated test executions get added as a text attachment to the bug for developer reference.

• Skip status in the automation result file is applied as "Not Applicable" instead of "Not Run" for automation test executions upload.

• Achieve traceability by auto-linking internal requirements with Junit test cases uploaded through automation import using the keyword "requirementEntityKey" to specify the entity key in the result file.

• Achieve traceability by auto-linking requirements synced from external trackers (e.g. Jira, Azure, Rally) with Junit test cases uploaded through automation import using the keyword "requirementExternalKey" to specify the external issue/work item key in the result file.

• Allow specifying of multiple values to "requirementExternalKey", "requirementEntityKey", and Testcasekeys attribute in the Junit result file to link/map multiple requirements to test cases.

Bug Fixes

• Fixed a bug that allowed unsupported Jira field types to be available for mapping in the Jira field configuration settings; this prevents users from selecting the unsupported field type.

• Fixed a bug that prevented syncing the latest test execution comment to QMetry Insights reports.

• Fixed a bug that did not allow uploading SAML metadata files larger than 10kb; this prevented configuring SSO for authentication.

• Fixed a bug that displayed archived releases and cycles on the test cases and requirements link screens.

• Fixed bug that resolves issues for the queries written with substring functions by upgrading the internal reports library.

Build 8.12.3.2 - Release Date: 2023-05-22

Enhancement

• Minor enhancement for an internal migration script, there is no direct impact to customers.

Build 8.12.3.1 - Release Date: 2023-04-24

Enhancements, Compatibility & Bug Fixes

Enhancements

Administrative Enhancements

• The system administrator can now set a time interval for inactive user sessions to log out automatically.

• The system administrator can now configure the organization's logo to the PDF and Word exports for test executions, test cases, and reports and as well as to the email notification template. The system administrator can also permit the project administrators to configure their project logo for the PDF and Word exports for the project.

• Organizations can now configure the audit/change log's retention period of up to 3 years for compliance requirements.

• New projects can have keys that are up to 10 characters long.

Reporting Enhancements

• QMetry Insights now allow the creation of visual and advanced query reports using group by function on custom fields.

• Export the test case and the test execution details to Word for sharing audit and compliance documentation.

Jira Integration Enhancements

• QMetry section inside the Jira story page now displays the Test case execution summary with multiple filters to drill down into summary progress.

• Release 8.12.3.1 upgrade requires an install/upgrade of the QMetry Jira Integration app latest v2.2.3. For customers using Jira Cloud, the add-on will be auto-upgraded.

• QMetry Jira Integration app v2.2.3 is compatible with Jira Server/DC v9.7.0.

Execution Enhancements

• The test suite list view and the test execution section inside the test suite now display the total counts of planned and unassigned test case executions, making it easier for teams to review the test execution assignment status.

Security Enhancements

• QMetry URL now includes security headers such as referrer policy, content security policy and permissions policy.

Bug Fixes

• Fixed a bug that prevented already scheduled custom dashboards from being triggered at the designated time due to daylight savings time changes.

• Fixed a bug that prevented generating custom reports containing the users' table without adding a mandatory project filter.

• Fixed bug that displayed the list values partially while selecting them under advanced filters on list view screens.

• Fixed a bug that caused a project clone initiated with the folder structure option to fail due to an incorrectly checked condition.

• Fixed a bug that incorrectly displayed archived test executions in the Test Executions Approval report for an archived test suite.

Build 8.12.1.1 - Release Date: 2023-02-20

Enhancements & Bug Fixes

Enhancements to the Test Execution Screen

• Introduced a comprehensive dialogue-based "Detail" view of the test execution screen that displays complete details for a test case execution in a more structured way, making it easier for testers to access all the information they need on a single screen. The new view displays details grouped under seven tabs that can be re-ordered, a better layout for step executions, and a consolidated view of the audit history for each test case execution run.

  • Users can choose between the Default (old) or Detail (new) view according to their preference.

  • The newly introduced "Details" tab displays all test case fields without the tester having to navigate to each test case separately.

  • Introduced the "List" and "Grid" views for displaying test step details. Users can choose either view according to their preference.

  • With the newly introduced "Requirements" tab, testers can view requirements associated with the test case under execution.

  • The newly introduced "Attachments" tab displays a consolidated list of attachments added while authoring or executing a test case/step.

  • The newly introduced "Audit log" tab displays test results and change logs separately for each test case execution.

• Comments on Test case execution now allow adding multiple comments by auto-capturing the Username and DateTime stamp.

Enhancement to the Automation Agent

• Trigger and Schedule the automation commands through the Automation Agent from inside the Test Execution.

  • Save the parameterized command in the system-defined field "Automation Script Execution Command" in the Test Suite details. The Automation Agent will trigger and execute the script saved in this field by replacing parameters with values selected in the test suite details.

• The limit of triggering a command through the Automation Agent increased from 255 to 5000 characters.

• A new version of Automation Agent (v8.12.1) compatible with QTM v8.12.1 is available.

Enhancements to Advanced Reporting

• Create custom reports containing fields of external trackers (like Jira, Azure or Rally) synced with the QMetry projects. System administrators can configure settings to display these external trackers fields in the QMetry Insights - Visual Report entities and Advanced Query Report tables.

Bug Fixes

• Fixed bug that prevented displaying Issue Average Aging graph when the report is filtered based on Issue Priority.

• Fixed bug that prevented displaying count for unresolved issues in the Issue Average Aging Report.

Build 8.12.0 - Release Date: 2022-01-11

Enhancements & Bug Fixes

Enhancements to the Test Cases Module

• Enabled creation of the shareable test cases from steps containing data parameters. Shareable test cases with parameterized test steps will refer to the test data specified for the main test case during execution.

• Link defects directly to a test case from the issue section in the test case details. Earlier testers could link defects with test cases through the test execution screen only. The following changes to these features and modules will be applicable:

  • Issues linked directly to the test cases will be auto-linked to the associated requirements of the test case and displayed under the Issue Links section of the Jira page for Jira issues synced as Requirements.

  • Jira issues linked directly to the test cases will display test case details in QMetry's Test case section on the Jira page.

  • Reports - Requirement With or Without Issues, Test case With or Without Issues & Resolved Issue Verification will include the defects linked directly to the test cases.

  • New fields and tables introduced to the Visual/Advanced Query Report module enable the creation of reports containing defects linked directly to the test case or execution screen. Refer to the updated entity relationship diagram for more details.

  • With release 8.12.0, creating a new visual report using fields only from the test case and issue entities will display defects linked directly to the test cases. Creating visual reports that show data on execution defects will require adding fields from all three entities - test cases, issues, and execution. Refer to this blog for the changes to the existing visual reports.

• The Issues section in the test case will display distinct defects linked directly or through test execution. Clicking the execution count will display associated test execution details like the test suite key, summary, release, cycle, platform, build and execution status.

Enhancements to Issue Module

• QMetry's internal issue tracker will display the Associated Releases in the list view and allows filtering issues on the Associated Releases field.

Bug Fixes

• Fixed bug that prevented recording of step numbers in the change log for updates to step execution details on the execution screen.

• Fixed bug that incorrectly activated user despite selecting No on the activation confirmation pop-up.

• Fixed bug that prevented users from changing the mapped folder configured to import Jira issues into QMetry as Requirements.

• Fixed bug that prevented generating the test execution summary by folder report for some projects.

• Fixed bug that prevented users from archiving list values associated with other projects from the current project.

Build 8.11.2 - Release Date: 2022-11-15

Enhancement & Bug Fixes

Enhancement

• Updates to Spark v3.3.1 and JDK v17 in QMetry Insights fix a potential data sync failure caused by a bug in the older spark version.  

Bug Fixes

• Fixed a bug that prevented the loading of test cases in Jira's QMetry test case panel if the test executions were large in number.

• Fixed a bug that prevented displaying user-defined fields in visual reports.

• Fixed a bug that exported test case step executions in an excel or CSV file displaying an incorrect count of defects linked.

• Fixed a bug that prevented syncing Jira stories to the Requirement module for a project integrated with multiple Jira projects by a user that got deactivated later.

• Fixed a bug that displayed an error requiring incorrect build permission while loading the issues and the combined view tab for a requirement.

Build 8.11.0 - Release Date: 2022-10-14

Improvements, Enhancements & Bug Fixes

Improvements & Enhancements

Reporting and Dashboard

• Introduced Planned vs Actual Execution analysis gadget under the Test Execution Summary report to help QA managers understand the current and expected execution rate to meet the release timelines.

• Export complete test execution details in a PDF as audit and compliance evidence. Organizations that have subscribed to the Integration app will get an option to export execution details in a pdf.

• Dashboard gadgets will always display the counts or percentages without a need to hover.

• Dashboard gadgets will preserve the user's preferred graphical or chart data report view. Shared dashboards and PDF export will display the gadget's view according to the owner's preference.

Issue Module

• Attach images/files while creating defects under projects using the internal issue module.

• Add multiple attachments while creating a defect in the integrated external trackers (e.g. Jira, Azure or Rally) from within QMetry.

Change Log

• The change log highlights the difference between old and updated values to make it easier for users to understand the updates.

• Change logs record detailed step-level updates when creating a new version of the test case.

eSignature

• Introduced email notification settings for eSignature-enabled projects to allow project administrators to enable or disable forced notifications on events like review, approval, closure, or a request change.

• Administrators can add up to 50 reviewers and approvers at all levels for an eSignature-enabled project.

• The email notifications on review, approval, closure and request change will contain the asset summary along entity key for easy identification.

Miscellaneous Improvements

• Sync the latest version of the requirement to its linked test cases individually or in bulk using the new "Sync Latest Version of Requirement" option on the requirement screen > test cases tab.

• Sync the latest version of the test case to its linked requirements individually or in bulk using the new "Sync Latest Version of Test Case" option on the test case screen > requirements tab.

• Release 8.11 upgrade requires an install/upgrade of the QMetry Jira Integration app latest v2.2.1. For customers using Jira Cloud, the add-on will be auto upgraded.

Bug Fixes

• Fixed bug that prevented a review of requirements due to an incorrect status applied by bulk edit operation in an e-Signature enabled project.

• Fixed bug that prevented the display of requirements in a project having a user-defined field with the same name as the system field.

Build 8.10.3.1 - Release Date: 2022-07-30

Bug Fixes

• Fixed a bug that prevented copying data with tables and hyperlinks into comments and the actual outcome field on the execution screen.

• Fixed a bug that prevented access to the issue module for some projects due to duplicate epic links.

• Fixed a bug that prevented seamless syncing between Jira stories and QMetry requirements for some projects due to the duplication of some synced issues.

• Fixed a bug that delayed syncing updates from Jira/Azure to QMetry.

• Fixed a bug that gave an error while cloning projects that contain a large number of test executions.

• Fixed a bug that did not fetch all test cases created through Automation API (apiVersion=1) when filtered by "Testing Type".

• Fixed a bug that prevented users having the default QA Manager role from creating a defect into Azure.

• Fixed a bug that did not preserve HTML formatting of Jira descriptions synced to QMetry.

• Fixed a bug that prevented an appropriate error from being displayed when creating issues with descriptions longer than 65553 characters.

Compatibility JIRA Improvements

• `QMetry Jira Integration` app v2.2.0 is released compatible with Jira Software v9.0 and v9.1. Customers hosted on the Jira server/data center will need to update the app manually. 

Build 8.10.3 - Release Date: 2022-06-24

Improvements & Bug Fixes

General Improvements

• QMetry v8.10.3 upgrades all third-party libraries used internally to their latest version making QMetry more secure by removing any existing vulnerabilities.

• Improved UI experience - QMetry web application upgraded with a new version of Angular framework 13.

• QMetry installation is now compatible with Open JDK 17.0.2 & Apache Tomcat 9.0.62.

• QMetry upgrade to v8.10.3 will update the Open JDK to 17.0.2.

• A compatible version of Automation Agent 8.10.3 is available with this QMetry upgrade to v8.10.3. The latest agent supports only Open JDK 17.0.2. Users should upgrade the JDK & Automation Agent post-upgrade. 

Bug Fixes

• Fixed a bug that displayed list values from the current project instead of the selected project after sorting list values while editing the user-defined fields.

• Fixed a bug that prevented unlinking platform from a test suite associated with too many platforms and test cases.

• Fixed a bug that prevented some users from accessing test case folders within a cloned project.

• Fixed a bug that prevented searching users in the user list while sharing custom report gadgets and dashboards.

Build 8.10.0 - Release Date: 2022-03-17

Improvements & Bug Fixes

Miscellaneous Improvements

• The value of the estimated time field on the test case detail screen now accepts up to 99999 minutes.

• Added option to select/unselect all fields on the arrange column menu in the list grids.

• Release 8.10 upgrade requires to install/upgrade the latest version v2.1.8 of Jira Integration - QMetry Enterprise App in Jira. For customers using Jira Cloud, the add-on will be auto-upgraded.

Bug Fixes

• Fixed bug that changed the execution type of manual test execution to automated on the execution screen after manual sync of the latest test case version.

• Fixed bug that prevented navigating backwards on test case steps using shift-tab keys. 

• Fixed bug that allowed updating a sharable test case on the same version for an eSignature enabled project.

• Fixed bug that did not show the screenshots in the comments section of issues synced from Jira.

• Fixed a bug that prevented configure of SAML IDP metadata XML file on offline docker installation.

• Mitigated - Apache Log4J Security vulnerability - CVE-2021-45105 by replacing the Log4j2 libraries with version 2.17.0 on the QMetry report server.

Build 8.10.2 - Release Date: 2022-05-18

Improvements & Bug Fixes

Improvements

Improvements to eSignature & Part 11 compliance 

• Introduced multilevel closure workflow for test execution runs.

  • The closers' user list has been separated from the approvers' list to facilitate the change with this release. The closure workflow will have a new level containing users copied from the final approval workflow level.

  • Added a bulk operation to request a change on test run executions having closures initiated to allow changes before final closure. 

• SAML users can now authenticate assets for Part 11 enabled projects using an authentication token.

• QMetry & LDAP users can now alternatively authenticate test assets for Part 11 enabled projects using an authentication token with settings enabled by the super admin.  

• Administrators can set up to 30 reviewers and approvers at all levels for an eSignature enabled project.

General Improvements 

• For the QAF framework, the attachments associated with sub checkpoints are uploaded to their respective test case steps when uploading automation results.

• For QMetry projects using the internal issue module, the "Error message" and "Trace" for the automated test executions get added as a text attachment to the bug for developer reference. 

• Skip status in the automation result file will be applied as "Not Applicable" instead of "Not Run" for automation test executions upload.

• The total execution count for the test case gets displayed under the 'Test Case' panel in Jira. 

• Release 8.10.2 upgrade requires an install/upgrade of the latest version v2.1.9 of the QMetry Jira Integration app. This version is compatible with Jira software v8.22. 

• Improved UI experience - QMetry web application upgraded with Angular framework version 13. 

Bug Fixes

• Fixed a bug that reset the current folder selection to the root folder post performing bulk operations or moving/copying assets.

• Fixed a bug that prevented displaying test cases for bulk operations when moved/copied to an eSignature enabled project.

• Fixed a bug that prevented displaying attachments and bugs on closed test executions for an eSignature enabled project.

• Fixed message tip on execution screen to guide testers to map missing parameter values for parameterized test cases.

• Fixed a bug that prevented importing automation result file of Robot framework that did not contain test case steps.

Build 8.9.0.5 - Release Date: 2022-02-08

Miscellaneous Fixes

• Compatibility changes specific to Jira API authentication.

• Fixed a bug that prevented the upload of attachments with file extensions .7z, .log, .py (python) and .ps1 (PowerShell).

Build 8.9.0.3- Release Date: 2021-12-30

Bug Fixes

• Mitigated Apache Log4J Critical Security vulnerabilities: CVE-2021-44832 and CVE-2021-45046.

• Fixed a bug that did not retain the data for the expected outcome or last test step column when navigating steps using tab key while authoring a test case.

• Fixed a bug that allowed users to alter project settings without permissions assigned to their role.

• Fixed a bug that displayed archived folders even after clearing the applied filters.

• Fixed a bug that trimmed long folder names while filtering assets by folders on linking screens or performing bulk operations.

• Fixed a bug that displayed an obsolete linkage of an issue under test case details - issue tab for an older test case executed version that is no longer available on the execution screen.

• Fixed a bug that displayed an obsolete record of a test case execution run for an older version under issue details when replaced with the latest test case version on the execution screen.

• Fixed a bug that prevented duplicating test case steps row if it contained images.

• Fixed a bug that did not allow clearing the test execution comments.

• Fixed a bug that prevented searching shareable test cases from the "Ask me anything" field.

• Fixed a bug that deleted data from the hidden test step column after saving the test case.

• Fixed a bug that did not sync the data of the test step user-defined fields to advanced reports after adding a new test step on an existing test case.

Build 8.9.0.2- Release Date: 2021-12-13

Bug Fixes

• Mitigated - Apache Log4J Security vulnerability - CVE-2021-44228 by replacing the Log4j2 libraries with version 2.15.0, for more details read the QMetry advisory.

• Fixed a bug that prevented displaying all releases and cycles in the report filters when Projects are selected using the select all option. 

• Fixed a bug that required extra customization permissions to add labels despite the user role having permissions to modify labels.

Build 8.9.0.1- Release Date: 2021-11-15

Bug Fixes

• Fixed bug that prevented importing test cases from excel.

• Fixed bug that prevented integrating a Gitlab repository when the repository project is a part of a subgroup.

• Fixed bug that created a duplicate step while inserting a step between existing test case steps.

• Fixed bug that added steps with description from the "keyword" attribute when the "name" attribute in the cucumber automation result file is found empty. QMetry now skips the test steps that do not have data in the step "name" attribute.

• Fixed bug that did not display the list of releases and cycles while filtering linked test cases on a requirement or a test suite.

Build 8.9.0 - Release Date: 2021-10-27

Improvements

• Support of user-defined fields on test case steps.

• Option to disable auto-deriving test case execution status from step statuses and vice-versa from project settings.

• Support for the below version control repositories for BDD integrations:

  • GitLab self-managed instances.

  • Azure Git Repos on cloud and private hosting.

• Option to disable authentication required on test step executions for Part 11 compliance enabled projects from eSignature settings.

• Improved UI experience - QMetry web application upgraded with Angular framework version 12.

• `Jira Integration - QMetry Enterprise` app v2.1.7 is released compatible with v8.9. Customers hosted on the Jira server/data center need to update the app manually. This app is upgraded automatically for Jira Cloud customers.

Summarized API changes 

Updated APIs

For more details refer the API changes from v8.8 to v8.9.

→ Known issue: If you face an intermittent issue when a single date is selected from the date range picker control, try removing the filter and select the date again.

Build 8.8.1.2- Release Date: 2021-09-25

Bug Fixes

• Fixed a bug that prevented QMetry <> Jira integration when authenticated using QMetry Jira Integration Addon for Jira server. Users will need to upgrade or install the QMetry Jira Integration app v2.1.6 from the Atlassian Marketplace.

• Fixed a bug that prevented upload of test cases and test executions for Cucumber automation results in the following scenarios:

•  

  • When the "line" attribute in the result file is empty or null. QMetry does not utilize the line attributes and will not parse them anymore.

  • When the "name" attribute for a test step in the result file is empty, the "keyword" attribute gets imported as the step description.

• Fixed a bug that prevented users with default Tester role to access the "My Dashboard" and other System Dashboards.

Build 8.8.1.1- Release Date: 2021-09-07

Improvement & Bug Fixes

Improvement

• Images added to the description and test steps will appear as thumbnails and opens full image on click.

Bug Fixes