/
Release Notes

Release Notes

Owned by Mrunalini Potnis
Last updated: Dec 12, 2024 by Niharika Choudhury
88 min read

Build 8.18.1 - Release Date: 2024-11-22

Summary: New Features, Improvements & Bug Fixes

 

New Features for QMetry Jira Integration

  • QMetry now enhances security and streamlines authentication by supporting OAuth 2.0 for Jira Cloud and Jira Data Center integrations. This feature allows users to securely authorize QMetry to access Jira data without entering their credentials or API tokens, ensuring a more secure and compliant connection between the two tools. QMetry Admins can enable this optional extra security layer from the Integrations menu > Oauth settings to enhance authentication security with Jira. After this setting is enabled, users must authenticate their Jira accounts once using an OAuth verification token to create or update issues.

  • Release v8.18 requires installation/upgrade of the QMetry-Jira Integration app to version 2.2.9. For customers utilizing Jira Cloud, the add-on will upgrade automatically.

 

Improvements to Shareable Test Cases

  • Move shareable test cases, individually or in bulk, between folders within the same project or across different projects, just like regular test cases.

  • Copy shareable test cases, individually or in bulk, within the same project or across different projects, similar to regular test cases.

  • Import or re-import test cases that include linked shareable test cases using an Excel or CSV file. The shareable test cases must already exist in the projects, and the import file should contain the shareable test case key and the associated version to map during the import process.

Improvements to the Dashboards and Reports

  • Global filters are introduced on System and Custom dashboards, enabling users to view and apply common (i.e. shared) filters for all gadgets from the top of the dashboard. Instead of configuring filters for each gadget individually on a dashboard, users can now set shared global filters that apply simultaneously to all gadgets. Users still have the option to set specific and unique filters at the individual gadget level. When the global filters differ from those set on the gadget, an indication will be displayed, making it easier for users to identify discrepancies in the applied filters.

  • The Planned vs. Actual Execution gadget on the Test Execution Summary dashboard is enhanced to help QA teams monitor the progress of actual executions against planned dates. This improvement enables teams to assess current execution rates and determine the required rates to meet delivery timelines based on the planned execution schedule.

  • All gadgets on the Test Execution Summary dashboard can now be filtered using Test Suite Folders.

Improvements to the Custom Reports

  • Pre-defined, ready-made browse folder filters for the Test Case, Test Suite, and Requirements modules are now available for users to add when creating custom reports using the Visual Reports or Advanced Query Reports modules.

  • The automation error messages and error trace fields for test step executions are available in the "teststepexecution" table within the Advanced Query Report module, enabling users to create custom reports using these fields.

Improvements to the Test Execution Screen

  • A new field, 'Planned Date,' has been introduced on the execution screen to help testers plan and track their assigned test case executions on specific dates. With both 'Planned' and 'Executed' dates now available, testers can easily monitor and compare their scheduled and actual execution timelines.

  • New options have been introduced on the Test Execution screen to export Test Executions and Test Cases with selected fields. Testers can export Test Executions including or excluding steps or Test Cases linked to those Test Executions with or without steps, depending on the fields they choose.

  • Two new duration fields, 'Automated TC Execution' and 'Automated Step Execution,' have been introduced on the execution screen to track the time taken for automated test cases and step executions, respectively. The durations are extracted and parsed from the automation result file uploads.

    • The 'Test Case Execution Time (Mins)' and 'Total Execution Time (Mins)' columns for automation executions on the Test Execution screen have been deprecated and will no longer store any values in the future.

  • The 'Test Case Estimated Time (mins)' column has been added to the Test Execution screen, enabling testers to easily view the estimated time for executing a test case.

Improvements to the Test Case Module

  • The option to 'Copy Steps from an Existing Test Case' has been introduced when creating or editing test case steps to enable testers to conveniently copy selected test steps from one test case to another within the same project or across different projects.

 

Improvements to Automation Agent

  • The Automation Agent now supports setting up recurring schedules for multiple test suite executions on the same agent, whether for the same test suite or different ones. When scheduling an execution command for an agent, all upcoming schedules for the agent are displayed, making it easier for testers to identify overlapping tasks. For multiple execution schedules set for the same time on the same agent, the agent will execute them sequentially on a first-come, first-served basis. The agent list screen now displays the total count of tasks 'Scheduled' and 'In Progress' for each agent.

New Features to User Provisioning through SCIM 2.0

  • The QMetry Administrator now has the option to allow QMetry to intelligently allocate and manage user license types from the IAM system when handling user provisioning using SCIM on the instance. In a QMetry instance with both Read-Only and Regular Licenses available:

    • Users with a Read-Only role across all projects will be automatically assigned/converted to a Read-Only License.

    • Users with a Non-Read-Only role in any project will be automatically assigned/converted to a Regular License.

  • When switching a user's license type from read-only to regular or vice versa, it's now optional to unassign the user from all groups if the user holds a Read-Only role across all projects. This rule applies when the user's license type is managed in the IAM system using the custom attribute 'QMetry_User_LicenseType'.

 

Miscellaneous Improvement

  • The latest QMetry release, v8.18.1, introduces support for MySQL v8.0.40 as the default database for installations and upgrades, replacing the previously supported MySQL v8.0.33.

 

Compatibility

  • QMetry Jira Integration App v2.3.0 is compatible with Jira version 10.3.0 and QTM v8.18.1.

 

Bug Fixes

  • Fixed a bug that added an extra comma at the end of the last column for CSV exports of Requirements, Test Cases, Test Suites, Issues, and System and Custom reports.

  • Fixed bug that incorrectly displayed the 'Created By' field for the Azure work item created from within QMetry, showing the name of the user who configured the QMetry Azure integration instead of the user who created it.

  • Fixed a bug that prevented requirements import from Excel due to partially matching values encountered for the lookup list type field.

  • Fixed a bug that prevented viewing and downloading PDF and Word files containing an apostrophe (') or dash (-) in the file name.

  • Fixed a bug that caused an unsupported Jira team picker field type to appear in the integration field mapping configuration, allowing it to sync as both a requirement and issue field.

  • Fixed a bug that prevented assigning project and role for a user, along with user license type update from read-only to regular in the same operation.

  • Fixed a bug that allowed updating the actual outcome and execution status of testcases/steps for a closed test execution when the test execution was closed and another user had the same test execution session open.

  • Fixed a bug that prevented the execution of an advance query report using the DATE_SUB() function due to a parsing error in the WHERE clause.

  • Fixed a bug that prevented testers with execute permissions from adding comments for a testcase run in the Execution Detail View.

  • Fixed a bug that was causing inline attachments to not display in the descriptions of Requirements and Issues synced from Jira.

  • Fixed a bug that displayed a truncated summary for the shareable test case having a long summary when included in another test case.

  • Fixed a bug where words in test case steps were split across lines in edit mode, impacting readability and editing.

  • Fixed a bug where selecting text in a test step caused it to become unselected and the text box to close abruptly in edit mode, disrupting the editing process and making text selection and modification difficult.

  • Fixed a bug that restricted the creation of users with email addresses and usernames containing an apostrophe ('), which also prevented sharing test assets with such users.

  • Fixed a bug that prevented users with test suite view-only permissions from seeing the 'Execute' button in the Test Suite's 'Test Executions' tab, which is needed to view the executions.

  • Fixed a bug that prevented the Jira fields section from loading into requirements in the cloned project if Jira integration was removed from the source project.

  • Fixes a bug that prevented non-admin users from setting build on the execution screen for dependent test cases until the execution screen page was refreshed manually.

  • Fixed a bug that prevented deleting custom dashboards with more than one gadget for certain QTM instances.

Previous Versions

 

 

Build 8.17.1 - Release Date: 2024-08-08

Summary: New Features, Improvements & Bug Fixes

Report Enhancements

  • System and custom report charts now display the total record count, making it easier for users to analyze the data.

  • PDF and Word exports of test cases and test executions now comply with FDA guidelines for regulated industries by displaying 'N/A' for empty fields and sections.

Administrative Enhancements

  • QMetry Super Administrators can now disable the feature at instance level that lets users generate and share embedded URLs for report dashboards with unrestricted access, in line with organizational policies.

  • When cloning a project, a confirmation pop-up is provided to remind administrators that the project will be in read-only mode until cloning is complete, helping them avoid initiating cloning during peak times.

Miscellaneous Enhancements

  • The default order for the Extent of Testing list has been updated so that a higher RPN indicates more intensive testing requirements. Similarly, the Risk Likelihood and Risk Impact lists have also been adjusted to align with this change.

  • In projects with the test case dependency feature enabled and auto-propagate status settings configured, the execution status of a dependent test case will automatically be marked as 'blocked' if its predecessor test case fails.

  • The 'Copy Link' button has been relocated from the Share pop-up to the details screen, and positioned next to the asset key, for easier access.

  • When exporting executions to PDF and Word formats, execution dependencies between test cases will now appear in a separate section for clearer organization.

QMetry Jira Integration App Update - Version 2.2.8

Updated QMetry Jira Integration app v2.2.8 is released, which addresses security vulnerabilities in two libraries used by the Jira app. This update is recommended and compatible with QMetry Application v8.17.0 and above.

 The update addresses the following vulnerabilities:

  • CVE-2022-42003: Uncontrolled resource consumption vulnerability in the Jackson-databind library.

  • CVE-2023-24998: Denial of service vulnerability in the commons-fileupload library.

Bug Fixes

  • Fixed a bug that blocked bulk copying of test cases when the source project had risk-based testing enabled.

  • Fixed a bug that caused tabular gadgets to lose their size and fail to display data correctly when enlarged on the custom dashboard.

  • Fixed a bug that prevented the 'Create Issue' screen from displaying for Jira-integrated projects when the Jira field name had a trailing space.

  • Fixed a bug that prevented all test cases linked directly to a Jira defect from displaying within QMetry's Test Case section on the Jira issue page.

  • Fixed a bug that caused Open API calls with a trailing forward slash to fail, resulting in a 404 error response upon execution.

  • Fixed a bug that prevented filtering test cases, test suites, requirements, and linked issues count with 0.

  • Fixed a bug that prevented filtering a custom gadget simultaneously on multiple date-type fields when designing it using Visual Reports.

  • Fixed a vulnerability due to the Apache library "commons-text-1.9.jar" used in the automation container by upgrading it to v1.11.

  • Fixed a bug that prevented archived projects from appearing on the Edit Fields configuration screen.

  • Fixed a bug that caused the steps to export in the incorrect order in the Excel file exported from the test case module.

  • Fixed a bug that prevented setting the system "read only" role as a default for newly created LDAP/SAML users.

  • Fixed a bug that prevented versioning test cases containing shareable steps and simultaneously syncing them for execution.

 

Build 8.17.0.1 - Release Date: 2024-06-12

Summary: New Features, Improvements & Bug Fixes

New Features

 

Test Case Dependency

  • Test case dependency refers to the relationship where the outcome of one test case depends on the successful execution of another. Managing these dependencies is crucial for ensuring a logical and organized testing process, especially for complex test scenarios.

    • Testers can now define execution dependencies between test cases as Predecessor orSuccessor relationships. This dependency ensures that the predecessor test case must be executed successfully before executing its successor. During execution, testers can automatically notify the execution assignees of successor test cases when their test cases are blocked or unblocked for executions. 

    • Introduced Test case and Test Execution dependency reports that showcase the dependency relationship between multiple test cases and their executions.

    • Project Administrators can choose to enable the feature for defining dependency relationships between test cases and configure the related execution settings. They can also opt to auto-propagate the execution status of predecessor test cases to successor test cases.

SCIM 2.0 Support for User Provisioning and Deprovisioning

  • QMetry now supports System for Cross-domain Identity Management (SCIM) 2.0, enabling seamless integration with identity providers, specifically OKTA, for automated user provisioning and de-provisioning. This feature ensures that only authorized users have access to QMetry, managed through a centralized user management process, maintaining compliance with security policies.

    • The following provisioning actions are currently supported: Push New Users, Push ProfileUpdates, and Push Groups.

    • Users will be automatically created and assigned to respective Projects and Roles when added to OKTA groups and automatically deactivated when removed from OKTA groups.

    • User attribute management, including modifying Username, First Name, Last Name, Alias, and Email ID, is also supported with this feature and can be made only through the identity provider platform.

    • Once SCIM 2.0 is enabled, user updates, creation, or deactivation, as well as project and role assignments, can only be done from the identity provider platform. Project Admins or other users with managing user permissions cannot make these changes directly withinQMetry.​

Risk-Based Analysis

  • Introduced the Risk-Based Testing feature to enhance the testing process by empowering testing teams to systematically identify, assess, and prioritize risks linked with requirements and test cases. This feature enables teams to focus their testing efforts on features with the highest likelihood of risks and potential defects.

    • Risk Definition: Project Administrators can activate the Risk-Based Analysis feature for their project. This functionality automatically creates the necessary risk fields and enables admins to define risks and other related factors, thereby ensuring comprehensive risk management.

    • Risk Association: Testers associate risks with requirements and test cases, assigning their likelihood and impact.

    • Determining the extent of testing: QMetry automatically computes the risk priority number and assigns the appropriate level of testing required for each risk.

    • Reports: Introduced Risk Traceability reports to assist testers in tracing risk factors associated with the requirements and their corresponding test cases, and vice versa.

    • To enable viewing risk-based fields in Jira, an install or upgrade of the QMetry Jira Integration latest app (v2.2.7) is required for the Jira Server and Data Center installations. For customers using Jira Cloud, the add-on will be auto-upgraded.​

Enhancements to Jira Integration

  • Project admins can now deactivate syncing for specific Jira System Fields within QMetry Requirements and Issues for selected Jira Issue Types. These fields include Description, Component, Fix Version, Priority, Labels, Attachments, Affected Version, Environment, and Assignee.

  • Project admins can now sync separate Jira Issue fields for viewing issue details in QMetry and creating issues from QMetry when configuring Jira Issue Types as QMetry Issues.

  • Users should upgrade their QMetry Exploratory Testing plugin to the latest version per the above enhancements and comply with QTM release 8.17.0.1. The latest versions of add-ons are as follows: Chrome 1.2.6, Firefox 1.1.0, and Edge 1.0.6.

Improvements to the Test Case Module

  • The latest execution status of a test case is now displayed on all Test Case List screens across the product. This status gives testers immediate visibility into whether a specific test case has been executed and displays its recent execution state. Project admins can configure parameters to tailor this display, allowing them to choose the display of the latest execution status based on the most recent execution within the current project or across projects. They can also decide whether to include only the recent or all the test case versions for determining the latest test case status.

Bug Fixes

  • Fixed a bug that prevented reordering linked test cases while creating a test suite.

  • Fixed a bug that prevented cloning projects containing test suites with cross-project test cases.

  • Fixed a bug that prevented filtering issues based on cycles within the issue module when a release has one of its cycles archived.

  • Fixed bug that displayed an incorrect message during login when a deleted user previously authenticated via SSO attempts to log in.

  • Fixed a bug that caused test cases export from a cloned project to display an incorrect username in the "created by" field.

  • Fixed a bug that prevented the display of the QMetry Test Case links in the Azure Work Item Links when test cases are associated with requirements from the details page.

  • Fixed a bug that prevented cycles from appearing under the cycle filter for the filtered releases under custom gadgets.

  • Fixed a bug that prevented save and discard buttons from appearing for Actual Outcome and Comments fields on the execution screen for parameterized test cases.

  • Fixed a bug that incorrectly reset the value of the Associated Cycle field to "None" for issues updated through a bulk update.

 

Build 8.16.0.1 - Release Date: 2024-03-07

Summary: New Features & Bug Fixes

New Features
Automation Enhancements

  • Integrate Worksoft CTM to launch the execution of Worksoft Suites directly from within QMetry. After completion of the execution, view the test cases and their execution results in QMetry.

  • Automation test result upload for the JUnit framework will now mark the Aborted and Skipped execution statutes with their matching custom execution statuses within the project. If these matching execution statuses are unavailable in the project, the upload process marks the test executions as Failed and Not Applicable, respectively.

Report Enhancements

  • Export test cases linked to the test suite in PDF and Word formats for review or sharing purposes. Users can choose which test case and step fields to include in the export.

  • Administrators can now control user access to the Login Summary Dashboard by utilizing newly introduced distinct permissions.

  • The Test Execution Summary by Folder reports now include the Test Suite Summary columns in the drill-down view, accompanied by the Key. This enhancement enables testers to identify and distinguish between suites more effectively.

Issue Module Enhancements

  • For the QMetry Inbuilt Issue Module, now associate Issues with cycles along their respective releases. This capability enables users to efficiently monitor defects not tied to a specific test case or execution. Users will need to upgrade their exploratory testing plugin to the latest version to utilize the ability to associate issues created during testing with cycles.

  • Filter issues of Jira integrated projects based on custom fields when linking them to Requirements, Test Cases, and Test Executions.

Test Case and Test Execution Enhancements

  • On creating a test case from the requirement page, the user is now automatically navigated to the requirement's linked test case section, ensuring the focus remains on the requirement. The same flow is improved when creating a test case from the requirement list view.

  • Users can now view custom fields of test entities on the link screens. This feature allows testers to efficiently select test entities based on the combination and configurations of the customer fields, ensuring comprehensive coverage. The custom fields are available for display when linking requirements, test cases, test suites, and issues across the product.

Infrastructure Enhancements

  • The QMetry application is upgraded to Tomcat 10, enhancing security and reliability. For server customers, the release upgrades include the QMetry application bundled with Tomcat10 as the default configuration.


Bug Fixes

  • Fixed error displayed in Jenkins logs when importing the automation test results and monitoring the completion status.

  • Fixed a bug that prevented the menu search from functioning correctly.

  • Fixed permission warning displayed to the users with adequate rights when navigating to the comments section or performing export or bulk operations in the Issue module.

  • Fixed permission warning displayed to the users with adequate rights when navigating the execution screen.

  • Fixed bug that prevented renaming X and Y-axis labels in custom reports through chart settings.

  • Fixed a bug that prevented filtering test cases based on a folder while linking to the test suite when the search criteria contained folders preserved from the last search.

  • Fixed a bug that prevented the export of test executions in PDF and Word formats.

  • Fixed a bug that prevented the display of cross-project test case executions and issues in the traceability report.

  • Fixed a bug that prevented import of test cases from Excel/CSV files when the column mapped to the Summary field wasn't the first column.

  • Fixed a bug that exported test executions to Excel/CSV with incorrect test case and step details in some cases.

  • Fixed a bug that exported requirements and test cases to Excel/CSV with data between HTML and Plaintext fields incorrectly interchanged.

  • Fixed a bug for Firefox ESR v115.7.0 that did not retain the expanded folder structure and switched users back to the root folder on return.

  • Fixed a bug that caused the first IDP-initiated SAML user login attempt to be redirected to the QMetry login page if the previous session had expired.

 

Build 8.15.0.3 - Release Date: 2024-01-25

Bug Fixes

  • Fixed a bug that prevented users from setting assignee for issues in projects integrated with Azure DevOps. 

  • Fixed a bug that caused slowness while updating Actual Outcome and Comments on the test execution screen for test cases containing a large number of steps.

 

Build 8.15.0.2-Release date: 2023-12-18

Bug Fixes

  • Fixed a bug that prevented users from being able to view test suites in the test suite module if the project name gets changed.

  • Fixed a bug that caused the attachment thumbnails to appear blurred and with occasionally displaced images within the thumbnail.

  • Fixed a bug that caused the removed comment on the test execution screen to reappear and prevented testers from resetting the comment field to empty.

  • Fixed a bug that prevented test steps from loading after clearing the applied sorting in the test execution detail view unless the user switched tabs or reloaded the page.

 

Build 8.15.0-Release date: 2023-11-15

New Features, Enhancements & Bug Fixes

New Features
New Features in Automation

  • Integrate seamlessly with Azure DevOps and GitLab pipelines to upload automation results.

  • New Features in Automation Agent -

    • Operate the Automation Agent on Windows, Linux, and Mac OS through the command line interface.

    • Open APIs are now available to schedule, execute, view the status, and download logs of the Automation Agent.

    • Introduced a manage schedule option for the agent, which allows users to alter the scheduled time and execution commands for the run later or recurring triggers.

New Features in Issue Module

  • Auto-generate a two-level folder hierarchy based on Jira fields to facilitate the automatic organization of synchronized requirements from Jira.

  • Introduced support for Jira Sub-Task issue types :

    • Sync Jira sub-task issue types as Requirements or Issues. The requirements and issues synced from Jira now display their respective subtasks in a dedicated new section.

    • Create Jira sub-task issue types as defects for failed executions. The Exploratory Testing Add-ons now support creating sub-task issue types as defects for failed executions.

  • Perform bulk export of all issue details, including their comments in wiki format, from QMetry's inbuilt issue module.

New Features on Collaboration

  • Improve collaboration by tagging your fellow team members in the comments to send them instant email notifications.

  • Easily share a Requirement, Test Case, Test Suite, Test Execution, and Issue link with other users using the following options -

    • Copy a direct link generated using the share feature on the detail screen.

    • Send an email with a custom note using the share feature on the detail screen.

    • Generate the URL with the format <https://<URL>>/#/<AssetType>/<AssetKey>.

New Features in Reports

  • Drill down into custom reports created using Visual Reports by clicking the counts to view detailed information about the records in the gadgets and export the view in CSV, except for cross-table charts.

New Features in Customization

  • Project administrators can now configure default values for system-defined fields separately for every module.

  • Copy or Import Platforms and their associated attributes along with their lists, System and Custom-defined list values, and Labels from one project to another.

Miscellaneous Improvements

  • The folder tree structure for every module now retains the user's recently expanded folder hierarchy while navigating between modules or projects or during screen refresh.

  • The count of assets in the folder hierarchy is displayed next to each folder for quicker reference.

  • Empty filters applied to QMetry-specific fields on the Requirement, Test Case, Test Suite, and inbuilt Issue modules are now preserved based on user preferences when clicked on save and apply button to make search efficient and eliminate the need to re-enable these filters each time.

  • The Test Suite's Test Execution section allows users to rearrange, show/hide, and expand columns. The user's view gets preserved, and the same view is displayed while generating the traceability report on test executions and performing bulk operations on eSignature-enabled projects.

QMetry Jira Integration App Updates

  • Release 8.15.0 upgrade requires an install/upgrade of the QMetry Jira Integration app latest v2.2.6. For customers using Jira Cloud, the add-on will be auto-upgraded.

  • QMetry Jira Integration app v2.2.6 is compatible with Jira Server/DC v9.11.

Bug Fixes

  • Fixed bug that prevented test steps update while unlinking and linking shareable test steps simultaneously.

  • Fixed a bug that appended the test case/step summary of automated test cases created through Junit automation upload with '()' at the end.

  • Fixed a bug that appended the test case/step summary of automated test cases created through Junit automation uploads with a dot at the beginning when the class name does not exist.

  • Fixed bug that prevented the drill-down on the 'Planned Requirements Summary Report'.

  • Fixed bug that prevented the display of the section 'Execution Details Test Suite wise' in the 'Test Execution Summary by Folder Dashboard'.

  • Fixed a bug that displayed duplicate 'Total Test Case Executions' and 'Total Unassigned Test Case Executions' columns in the Test Suite module arrange columns option.

  • Fixed bug that prevented archiving the projects set as default logged-in scope for deactivated users.

  • Fixed a bug that prevented cloning the projects with test cases containing custom fields in test steps.

  • Fixed bug that prevented displaying an appropriate failure reason on the scheduled task and logs for test suites import failure.

  • Fixed bug that prevented deletion of attachments on the execution screen for users with sufficient permissions.

  • Fixed bug that allowed the creation of users more than the license limit, preventing users from logging in to QMetry for concurrent licensing type.