Back to QMetry All Products Help Page
Release Notes
- Mrunalini Potnis
Build 8.10.0 - Release Date: 2022-03-17
Improvements & Bug Fixes
Miscellaneous Improvements
The value of the estimated time field on the test case detail screen now accepts up to 99999 minutes.
Added option to select/unselect all fields on the arrange column menu in the list grids.
Release 8.10 upgrade requires to install/upgrade the latest version v2.1.8 of Jira Integration - QMetry Enterprise App in Jira. For customers using Jira Cloud, the add-on will be auto-upgraded.
Bug Fixes
Fixed bug that changed the execution type of manual test execution to automated on the execution screen after manual sync of the latest test case version.
Fixed bug that prevented navigating backwards on test case steps using shift-tab keys.
Fixed bug that allowed updating a sharable test case on the same version for an eSignature enabled project.
Fixed bug that did not show the screenshots in the comments section of issues synced from Jira.
Fixed a bug that prevented configure of SAML IDP metadata XML file on offline docker installation.
Mitigated - Apache Log4J Security vulnerability - CVE-2021-45105 by replacing the Log4j2 libraries with version 2.17.0 on the QMetry report server.
Previous Versions
Build 8.9.0.5 - Release Date: 2022-02-08
Miscellaneous Fixes
- Compatibility changes specific to Jira API authentication.
- Fixed a bug that prevented the upload of attachments with file extensions .7z, .log, .py (python) and .ps1 (PowerShell).
Build 8.9.0.3- Release Date: 2021-12-30
Bug Fixes
- Mitigated Apache Log4J Critical Security vulnerabilities: CVE-2021-44832 and CVE-2021-45046.
- Fixed a bug that did not retain the data for the expected outcome or last test step column when navigating steps using tab key while authoring a test case.
- Fixed a bug that allowed users to alter project settings without permissions assigned to their role.
- Fixed a bug that displayed archived folders even after clearing the applied filters.
- Fixed a bug that trimmed long folder names while filtering assets by folders on linking screens or performing bulk operations.
- Fixed a bug that displayed an obsolete linkage of an issue under test case details - issue tab for an older test case executed version that is no longer available on the execution screen.
- Fixed a bug that displayed an obsolete record of a test case execution run for an older version under issue details when replaced with the latest test case version on the execution screen.
- Fixed a bug that prevented duplicating test case steps row if it contained images.
- Fixed a bug that did not allow clearing the test execution comments.
- Fixed a bug that prevented searching shareable test cases from the "Ask me anything" field.
- Fixed a bug that deleted data from the hidden test step column after saving the test case.
- Fixed a bug that did not sync the data of the test step user-defined fields to advanced reports after adding a new test step on an existing test case.
Build 8.9.0.2- Release Date: 2021-12-13
Bug Fixes
- Mitigated - Apache Log4J Security vulnerability - CVE-2021-44228 by replacing the Log4j2 libraries with version 2.15.0, for more details read the QMetry advisory.
- Fixed a bug that prevented displaying all releases and cycles in the report filters when Projects are selected using the select all option.
- Fixed a bug that required extra customization permissions to add labels despite the user role having permissions to modify labels.
Build 8.9.0.1- Release Date: 2021-11-15
Bug Fixes
- Fixed bug that prevented importing test cases from excel.
- Fixed bug that prevented integrating a Gitlab repository when the repository project is a part of a subgroup.
- Fixed bug that created a duplicate step while inserting a step between existing test case steps.
- Fixed bug that added steps with description from the "keyword" attribute when the "name" attribute in the cucumber automation result file is found empty. QMetry now skips the test steps that do not have data in the step "name" attribute.
- Fixed bug that did not display the list of releases and cycles while filtering linked test cases on a requirement or a test suite.
Build 8.9.0 - Release Date: 2021-10-27
Improvements
- Support of user-defined fields on test case steps.
- Option to disable auto-deriving test case execution status from step statuses and vice-versa from project settings.
- Support for the below version control repositories for BDD integrations:
- GitLab self-managed instances.
- Azure Git Repos on cloud and private hosting.
- Option to disable authentication required on test step executions for Part 11 compliance enabled projects from eSignature settings.
- Improved UI experience - QMetry web application upgraded with Angular framework version 12.
- `Jira Integration - QMetry Enterprise` app v2.1.7 is released compatible with v8.9. Customers hosted on the Jira server/data center need to update the app manually. This app is upgraded automatically for Jira Cloud customers.
Summarized API changes
Updated APIs
API Name | REST URL | Method | Backward compatibility with 8.8 | Request Change | Response Change |
Create test case | /rest/testcases | POST | Yes | Yes | No |
Update test case | /rest/testcases | PUT | Yes | Yes | No |
For more details refer the API changes from v8.8 to v8.9.
→ Known issue: If you face an intermittent issue when a single date is selected from the date range picker control, try removing the filter and select the date again.
Build 8.8.1.2- Release Date: 2021-09-25
Bug Fixes
- Fixed a bug that prevented QMetry <> Jira integration when authenticated using QMetry Jira Integration Addon for Jira server. Users will need to upgrade or install the QMetry Jira Integration app v2.1.6 from the Atlassian Marketplace.
- Fixed a bug that prevented upload of test cases and test executions for Cucumber automation results in the following scenarios:
- When the "line" attribute in the result file is empty or null. QMetry does not utilize the line attributes and will not parse them anymore.
- When the "name" attribute for a test step in the result file is empty, the "keyword" attribute gets imported as the step description.
- Fixed a bug that prevented users with default Tester role to access the "My Dashboard" and other System Dashboards.
Build 8.8.1.1- Release Date: 2021-09-07
Improvement & Bug Fixes
Improvement
- Images added to the description and test steps will appear as thumbnails and opens full image on click.
Bug Fixes
- Fixed a bug that prevented the upload of attachments having the .tcc file extension.
- Fixed a bug that prevented the syncing of Jira labels to the issue module.
Build 8.8.1- Release Date: 2021-08-16
Improvements & Bug Fixes
Improvements
- Upload an attachment with a file size of up to 300 MB.
Large text fields improvements
Attach images up to 1 MB in size.
Insert tables with the ability to add/delete rows and columns.
Test case steps improvements
Bulk-delete test case steps.
Add hyperlinks while authoring test case steps details.
For QMetry projects that are integrated with an external tracker, the "Error message" and "Trace" for the automated test case get added as an attachment to the bug created for the execution.
Custom dashboard improvements
Copy your dashboard along with its gadgets and view permissions.
Share dashboard to individual users/projects-roles or by generating embedded URLs from the edit dashboard view.
Layout management improvements
Set a section as default for the newly created user-defined fields on the layout.
Replace existing fields on the layout with a spacer to preserve the current view while defining the layout.
Exploratory Testing improvements
For projects using the internal issue module, the create bug screen will now display only the fields enabled for the issue module layout.
Release 8.8.1 requires users to install/upgrade the latest version of QMetry Test Management – Exploratory Testing extension on Chrome (v1.1.1), Firefox (v1.0.6), and Edge (v1.0.2) browsers.
Release 8.8.1 upgrade requires to install/upgrade the latest version v2.1.4 of Jira Integration - QMetry Enterprise App in Jira. For customers using Jira Cloud, the add-on will be auto-upgraded.
QMetry Automation Agent will support Open JDK 11.0.11.
QMetry upgrade to 8.8.1 will update the Open JDK to 11.0.11.
Bug Fix
Fixed a bug that prevented archiving a few list values of system fields for the default project created along with the installation.
- Fixed a bug that prevented copying of test case if the test case owner is deactivated.
Build 8.8.0.1- Release Date: 2021-06-05
Bug Fixes
- Fixed a bug that prevented auto-syncing of Jira issues when their issue type is changed.
- Fixed a bug that prevented QMetry panels from loading in Jira when accessed from the Safari browser.
- Fixed a bug that did not display the gadget reports for updated filters.
- Fixed a bug that triggered approval reminder emails after turning off the notification reminders.
- Fixed a bug that prevented disconnecting the "Jira integration - QMetry Enterprise app" when authenticated with username and password.
- Fixed a bug that prevented Daily API counter to be reset.
Note: "Jira Integration - QMetry Enterprise" app is renamed as "QMetry Jira Integration" app.
Build 8.8 - Release Date: 2021-05-18
New Features & Improvements
Introducing Layout Management (Included as part of Customization App)
- Organize and arrange fields on the create, detail, and bulk operations screen for every module.
- Customize separate field layouts for the create, detail, and bulk operations screen.
- Copy field layout across module screens to maintain consistency.
- Hide unused system or custom fields from the screen without losing their data.
- Create sections and group similar fields for better visibility and accessibility of fields on the screen.
- Show/hide or expand/collapse sections by default to enhance performance.
- Mandatory fields will be highlighted in red while creating an asset if left blank.
- Note: The layout management feature does not apply to the following cases.
- PDF export of test cases.
- Test case detail view in Jira.
- Issue module of a Jira integrated project.
Bulk Operation Improvements
- Filters applied on folders, system, custom, or Jira fields on the module are carried forward to the bulk operations. This allows performing bulk operations by filtering on all the fields. The existing filter options on the bulk operation select record page are discontinued.
- Fields enabled on the module grid are also enabled while selecting records on the bulk operations screen.
- The folder archive/unarchive actions are directly available from the folder tree structure.
eSignature Enhancements
- Requirement Review Workflow :
- Introduced multilevel requirement review workflow to ensure that the linked test cases are authored to cover all use cases of the
requirement. - Updates to a reviewed requirement made in QMetry or synced from Jira will reset its review status to pending, this indicates that the requirement is changed. The reviewer should ensure the linked test cases are updated to cover the changes made to the requirement before marking it as reviewed.
- Add one or more users at each level if there are multiple reviewers in the organization.
- Review or request changes to requirements using bulk operations.
- Introduced multilevel requirement review workflow to ensure that the linked test cases are authored to cover all use cases of the
- Multilevel Approval workflow for Test cases/Test Executions:
- Define a multilevel workflow hierarchy to approve/request changes to the test cases and test executions. The maximum number of approval levels can be defined in the general settings.
- Authorize one or more users at each level if there are multiple approves in the organization.
- Approve or request changes to test cases and test executions using bulk operations.
- Define the interval frequency for reminder email notifications to be sent for the approval of test cases and test executions.
- Introduced new reports related to new features for the new eSignature enabled project.
- Requirement Reviewer Workflow Status - View requirement, its linked test cases, and execution status along with their review and approval details.
- My Pending Requirement to Review - List of requirements pending for review at my "Level" or my review.
- My Pending Test Cases to Approve - List of test cases pending at my approver level for action.
- My Pending Test Execution to Approve/Close - List of test executions pending at my approver level for approval/closure.
Import/Export Improvements
- Import test cases/requirements/internal issues from excel containing multiple sheets of the same format in one attempt.
- Import test cases from excel using a newly introduced open API call.
- Sort test cases in the required order before bulk exporting them to a PDF.
- Export has been moved out of bulk operations and is listed below the import option.
Test Case Module Improvements
- Sync the latest version of a shareable test case to the parent test case without a need to relink it.
- Show/hide input data and expected outcome step fields on the test step grid
Test Suite and Execution Screen Improvements
- Copy an existing test suite with a new release and cycle combination.
- Resize test step columns on the execution screen.
- View the entire content of test steps while executing them using the expand/collapse quick buttons available at the step grid.
- The execution screen now displays more test cases than before, which reduces the scrolling required to reach the desired test cases.
- Execution statues now have a background color to easily distinguish them.
Improvements to Jira Integration
- Epic synced from Jira will now display "Issues in Epic" in a new separate tab to showcase the relationship between the epic and the
issues which are part of it. - Created, Updated, and Resolved dates for issues synced from Jira are now visible on the issue detail page.
- As the issue resolved date is now synced to QMetry, the Resolved Issue Verification report automatically identifies the resolved issues. Hence the resolved status configuration on the edit project obsolete and is discontinued.
- `Jira Integration - QMetry Enterprise` app v2.1.2 is released compatible with v8.8. Customers hosted on the Jira server/data center need to update the app manually. This app is upgraded automatically for Jira Cloud customers.
Introducing Exploratory Testing extension for Edge
“Exploratory Testing” extension is now available on the Edge browser. The Edge extension is compatible with v8.8 and above. Click here to download ”QMetry Test Management Exploratory Testing for Edge” v1.0.0.
Advanced Report Improvements
- Create custom SQL reports to display cumulative data grouped by date/week/month.
- Link to ER diagram for Release 8.8.0.
API Changes
The following is the Summary of existing open APIs changed in release 8.8. For more details, click Details of API changes from v8.7.1 to v.8.8. For more details, click Details of API changes from v8.7.1 to v.8.8.
API Name | REST URL | Method | Backward compatibility with 8.7 | Request Change | Response Change |
---|---|---|---|---|---|
Create or update requirements | /rest/requirements | POST | Yes | Yes | No |
Create or update test cases | /rest/testcases | POST | Yes | Yes | No |
Create or update test suites | /rest/testsuites | POST | Yes | Yes | No |
Create or update issues | /rest/issues | POST | Yes | Yes | No |
Get Test Suite Run IDs | /rest/execution/list/platformHome | POST | Yes | No | Yes |
List Test Case Steps | /rest/testcases/steps/list | POST | Yes | No | Yes |
Get Info | /rest/admin/project/getinfo | GET | Yes | No | Yes |
Fetch Details of a specific test case version | /rest/testcases/list | POST | Yes | No | Yes |
Get Test Suite Run IDs | /rest/execution/list/platformHome | POST | Yes | No | Yes |
Fetch Requirements | /rest/requirements/list/viewColumns | POST | Yes | No | Yes |
Fetch Test Cases | /rest/testcases/list/viewColumns | POST | Yes | No | Yes |
The following is the Summary of new open APIs Added.
API Name | REST Endpoint |
---|---|
Get the list of issues linked to epic imported from Jira | /rest/integration/list/externalData |
Copy test suite with a new release and cycle combination | /rest/testsuites/copyWithNewReleaseCycle |
Import test cases to QMetry from excel | /rest/import/testcase |
Build 8.7.1.3 - Release Date: 2021-03-26
Bug Fixes
- Fixed a bug that utilized all available threads on the server leading to downtime for cloud users.
- Fixed a bug that prevented QMetry Agent to start on Mac OS with Open JDK v11.0.2.
- Fixed a bug that prevented the import of JUnit files that have empty testsuite with no testcases.
- Fixed a bug that restored default column sizes in all list views for new users on refresh.
- Fixed a bug that caused a delay while successively updating test case execution status.
- Fixed a bug that intermittently displayed an incorrect count of issues to be synced from Jira in the scheduler.
Build 8.7.1.2 - Release Date: 2021-03-06
Bug Fixes
- Fixed a bug that was updating Due Date to the previous day of the selected Date in QMetry after an issue was created from QMetry to Jira.
- Fixed a bug that prevented syncing of some requirements and issues for the Jira server edition.
- Fixed a bug that was preventing the display of the full name of users on the Users screen.
- Fixed a bug that was preventing users to log into Azure from QMetry using the standard URL or extended URL.
Build 8.7.1.1 - Release Date: 2021-02-19
Improvements & Bug Fixes
General Improvements
- Support for Azure AD for SAML Integration.
Bug Fixes
- Fixed a bug that prevented creation of duplicate requirements from Jira to QMetry.
- Fixed a bug that caused “QMetry section/panel” hide in new Jira issue view.
Build 8.7.1 - Release Date: 2021-02-01
Improvements & Bug Fixes
General Improvements
- Export an exploratory testing session into a PDF.
- Download all attachments of a test case/test step and their execution in just one click.
- `Jira Integration - QMetry Enterprise` app v2.1.1 is released that is compatible with QTM 8.7.1. Customers using Jira Server/DC need to update the app manually, while it is automatically upgraded for Jira Cloud.
Bug Fixes
- Fixed a bug that did not display the applied filters and tags on gadgets while viewing them on embedded URL or shared dashboards.
- Fixed a bug that prevented the display of pie chart gadgets when filtered only on Jira fields.
- Fixed a bug that prevented adding attachments while creating Rally issues from QMetry.
- Fixed a bug that prevented rich text from being displayed correctly on cross table custom gadgets.
- Fixed a bug that prevented test cases from appearing in the QMetry Insights reports if the test case folder is moved to another folder.
Build 8.7.0.1 - Release Date: 2021-01-25
Bug Fixes
- Fixed a bug that prevented QMetry Automation Agent from starting up again if it was launched with the option "Running on VM" earlier.
- Fixed a bug that caused the error on the selection of due date while logging a defect from QMetry to Jira.
- Fixed a bug that prevented the import of zips containing JSON files while importing results using automation API.
Build 8.7 - Release Date: 2020-12-22
New Features, Improvements & Bug Fixes
General Improvements
- QMetry now supports any International Language (available on request). Currently added support for Español (Spanish). - Introduced Internationalization App.
- Bulk-export up to 50 test cases to a single PDF file.
- QMetry Automation Agent is now supported on Open JDK 11.
- Archive individual test executions to prevent them from getting altered due to changes made to the scope of test suite when reusing test suite for future executions.
- Test cases added to the test suites are not added to the archived test executions.
- Test case linked to archived executions can’t be unlinked from the test suites.
Integration Improvements
- Integrate Azure & Rally to sync work items in QMetry to get complete traceability for Requirements -> Test cases -> Test Suites -> Test Executions -> Bugs.
- Sync Azure/Rally Work Items like User Story/Feature/Epic etc in QMetry as Requirements. The integration is unidirectional, changes made to work items sync real time to QMetry.
- Sync Azure/Rally Work Items like Defect/Issue/Bug etc in QMetry as Issues. The integration is bidirectional, changes made to work items sync real time to QMetry and vice versa. Existing work items can be linked to executions or New work items can be created directly from the test case execution screen.
- Improved Issue traceability in Requirements - Issues linked to test case executions are now auto linked to QMetry requirement under issue tab & also under Jira issue link for stories synced from Jira.
- `Jira Integration - QMetry Enterprise` app v2.1.0 is released compatible with QTM 8.7. Customers using Jira Server/DC need to update the app manually, while it is automatically upgraded for Jira Cloud.
Report Improvements
- New Report - “User Project Role Summary” added to “Login Summary” Dashboard - displays list of all users assigned to different projects along with their roles and status.
- Improved Traceability Report -
- Trace by Requirements/Test Cases/Issues can filtered by any System or External Tracker fields.
- Added “Trace by Test Executions” that allow users to view traceability by filtering executions with specific release/cycles/platform combination.
- Filters applied or columns selected on module grids will apply to traceability report by default. This helps users to reuse the module filters instead of applying those filters again.
- Filter icon on the report gadget displays count of filters applied & hovering the filter icon displays the applied filter.
- Archived Test Executions Runs are excluded from system reports.
- Link to ER diagram for Release 8.7 - Added “isExecutionArchived” in “test execution” which denotes the status of Test Execution as “Archived” or “Unarchived”.
Exploratory Testing Improvements
- “Exploratory Testing” extension is now available on Firefox. This Firefox extension is compatible with release 8.7 and above. Click here to download - QMetry Test Management Exploratory Testing for Firefox (v1.0.3)
- With release 8.7 upgrade users will be required to upgrade the compatible latest version v1.0.8 of QMetry Test Management – Exploratory Testing extension on chrome browser
End of Support for Internet Explorer
We are retiring IE support for QMetry Test Management – Cloud and Server products on 30th June 2021. End of support means we will not fix bugs that are specific to IE and new features will not be supported for IE. QMetry will continue to provide support on Edge. We are expecting all of our customers using QMetry on IE to shift to Edge or Chrome/Firefox. Our support can help you along the way in this transition.
- In 2015, Microsoft released Edge as the browser to supersede Internet Explorer (IE). To allow us to continue to take advantage of modern web standards to deliver improved functionality and the best possible user experience across all of our products, we have decided to end support for IE.
Bug Fixes
- Fixed a bug that did not display test case steps in the correct order of execution when a same shareable test case is used multiple times along with data parameter in the test case.
- Fixed a bug that prevented syncing of deleted labels to QMetry Insights database.
- Fixed a bug that displayed incorrect release and cycles dates due to day light saving changes.
- Fixed a bug that did not export test case entity key for Test Result Log Report.
- Fixed a bug that reset the date filters to default when columns were sorted in the Test Result Log Report.
- Fixed a bug that synced same Jira issues multiple times to QMetry causing them to duplicate in some cases.
- Fixed a bug that prevented auto sync of newly created Jira field values to QMetry filters.
API Changes
The following is the Summary of APIs modified. For more details, click Details of API changes from v8.6.4 to v.8.7.
API Name | REST URL | Method | Backward compatibility with 8.6.4 | Request Change | Response Change |
Get Test Suite Run IDs | /rest/execution/list/platformHome | POST | Yes | No | Yes |
List Test Case Executions | /rest/testcases/execution | POST | Yes | No | Yes |
Fetch Executions for Issue | /rest/execution/getExecutionsForIssue | POST | Yes | No | Yes |
Get List of Issues for a Requirement | /rest/issues/list/ForRQ | POST | Yes | No | Yes |
Fetch Requirement List For Issue | /rest/requirements/list/forIS | POST | Yes | No | Yes |
Fetch Linked Issue of Test Case Step Run | /rest/execution/issue/list/forTCStepRun | POST | Yes | No | Yes |
Build 8.6.4.2 - Release Date: 2020-11-11
Bug Fixes
- Fixed a bug that prevented integrating with bitbucket repository with correct credentials.
- Fixed a bug that caused users to get logged out abruptly while working in QMetry.
- Fixed a bug that prevented the test cases in folders from loading for users who had a custom field enabled on the grid view which was deleted later.
- Fixed a bug that could cause an error resulting in upgrade failure due to duplicate attachments.
Build 8.6.4.1 - Release Date: 2020-10-26
Improvements & Bug Fixes
Improvements
- "Jira integration - QMetry Enterprise" app is now compatible with Atlassian's site rename feature.
Bug Fixes
- Fixed a bug that did not display assignee information when Test Execution Summary Report by Assignee is exported.
- Fixed a bug that scrolled up the grid header while linking assets through bulk operation.
- Fixed a bug that prevented users from logging in to QMetry if password contains plus(+) character.
- Fixed a bug that displayed an error while applying filter to the 'Test Execution Summary by Folder' report.
- Fixed a bug that prevented navigating through test cases using previous and next buttons.
- Fixed a bug that prevented loading of the default dashboard for SAML authenticated users after login.
- Fixed a bug that forcefully logged out users after 15 mins of session idle time when multiple tabs are open.
Build 8.6.4 - Release Date: 2020-10-12
Improvements & Bug Fixes
Improvements
Improvements to Test Case and Test Execution
- Summary and Entity Key are now separate columns on all link test asset screens to allow better sorting and filtering.
- Enhanced test case steps edit experience with an option to open step details in maximized mode.
- Users can view shareable test case steps in the test case without scrolling.
- Test executions with archived release/cycle will be hidden by default.
- Filter requirements by External key while linking them to Test cases and Test Suites.
- Users can hide test steps “Input data” and “Expected Outcome” fields on the execution screen to utilize the space effectively.
- Link Test case to Test suite panel now displays more test cases on the page.
Improvements to Jira Integration
- QMetry authentication from `Jira Integration - QMetry Enterprise` app now supports Open API key (part of Open API app) and two step verification.
- Jira field mapping configuration is now separate for each integrated issue type.
- Test case panel, test case details view and test execution sections in Jira issues now have resizable columns.
- Test case details view in Jira now displays all user defined fields.
- `Jira Integration - QMetry Enterprise` app v2.0.9 is released compatible with QTM 8.6.4. Customers using Jira Server/DC need to update the app manually, while it is automatically upgraded for Jira Cloud. Server customers need to sync the meta data for all the projects integrated with Jira.
Improvements to Reports
- Advance Query Reports database schema tables `Requirements` and `Issues` having field names starting with “Jira” are updated with “Ext”. (part of Advance Report app)
- Download the new ER Diagram 8.6.4.
- For more details refer this page.
- Users will now be able to set any system or custom dashboard as their default dashboard seen after logging in to QMetry.
- Introduced new report `Count of API Requests by User` which shows number of Open API or Automation API calls made by each user at a given time.
- Share dashboards with specific users or all users of a specific role, project combination. (part of Advance Report app)
Improvements to Automation API, Bamboo/Jenkins/Maven Plugins
- Upload automation results of Robot framework.
- Added support for uploading automation results from a Bamboo remote agent server.
- skipWarning parameter have been added that allows to import test cases by truncating summary having more than 255 characters.
- QMetry Test Management for Bamboo (v1.0.9), QMetry Test Management Plugin for Jenkins (v1.10) & QMetry Test Management Plugin for Maven has been released with above supported improvements.
Improvements to QMetry Administration
- QMetry Admin can now enforce two step verification for all users by making it mandatory. (part of Customization app)
- Password expiry related email notifications will be sent to QMetry authenticated users in advance. Organization who have subscribed for customization app can even configure the advance number of days. (part of Customization app)
- Users having two step verification enabled can now use recovery codes to regain access to the accounts.
- Easily filter and find users having two step verification enabled on users list page.
- QMetry Admin using On premise installation can now set a maintenance message that will be displayed on login screen to notify users about a scheduled maintenance. (part of Customization app).
General Improvements
- Export exploratory testing session details, documented test steps and associated defects to a word document. (part of Exploratory Testing app)
- Share defect details over email to users even outside of QMetry.
- Import test cases with longer summaries now truncated to 255 characters using option to `Import with Warning`.
- Gitlab support for BDD integration.
Bug Fixes
- Fixed a bug that prevented cloning of a project when the project has test case or requirement with attachments moved from another project.
- Fixed a bug that prevented auto linking of requirements to test cases when requirement key is specified in the automation result file.
- Fixed a bug that prevented display of all records for a tabular view gadget when dashboard is shared using embedded URL.
- Fixed a bug that displayed the test case execution for a deleted parameter value combination for custom reports generated using the Advanced Query module.
- Fixed a bug that displayed html tags for large text user defined field when test case is exported to a PDF.
- Fixed a bug that prevented proper loading of test case when accessed using URL with test case id.
Summary of Open Rest API Changes
The following APIs have been modified. Here is the detailed difference document. (part of Open API app)
API Name | REST URL | Method | Backward compatibility with 8.6.3 | Request Change | Response Change |
List of Cycles | /rest/admin/cycle/list | POST | Yes | Yes | No |
Add BDD Configuration | /rest/admin/bddConfiguration/add | POST | Yes | Yes | No |
Fetch Executions for Issues | /rest/execution/getExecutionsForIssue | POST | Yes | No | Yes |
Build 8.6.3.4 - Release Date : 2020-09-18
Bug Fix
- Fixed a bug that prevented the test case export to PDF.
Build 8.6.3.3 - Release Date : 2020-09-05
Improvement
- Enhanced performance for group of APIs that are internally used for automation test result executions import.
Bug fixes
- Fixed a bug that displayed incorrect entries for test case executions in custom reports when platforms are un-linked from test suites.
- Fixed a bug that prevented syncing of Jira issue if priority field is not set for any of the imported Jira issues.
Build 8.6.3.2 - Release Date: 2020-08-31
Bug fix
- Fixed a bug that caused advanced query reports to give no output when opened in edit mode.
Build 8.6.3.1 - Release Date: 2020-08-27
Bug Fixes
- Fixed a bug that prevented export of custom field values when test cases are exported in excel/csv.
- Fixed a bug that caused project clone to fail when test case folder from one project is shared to another project.
- Fixed a bug that showed a mandatory status field while creating issues from QMetry to Jira.
Build 8.6.3 - Release Date: 2020-08-17
Improvements & Bug Fixes
Improvements
- Users with QMetry authentication type can enable Two-step Verification as an extra layer of security during login.
- Improved performance for Automation API while importing result files of all frameworks.
- Increased file size limit up to 30 MB for importing result using Automation API.
Bug Fixes
- Fixed a bug that caused the saved mapping for excel sheet import of test cases to reset.
- Fixed a bug that exported a blank PDF in some cases while exporting a test case.
- Fixed a bug that prevented removal of execution records for deleted platforms from QMetry Insights.
- Fixed a bug that prevented loading of test case steps on execution screen when actual outcome or comments had certain html tags.
- Fixed a bug that prevented loading of ‘User Last Login Detail’ report when generated for high number of records.
- Fixed a bug that prevented the download of QMetry IDP metadata files for SAML Configuration, if HTTPS is not configured with globally trusted SSL certificates.
- Fixed a bug that prevented auto-syncing of Jira issues when issue type Bug is renamed in Jira.
- Fixed a bug that prevented use of bullets & numbering in test case steps.
- Fixed a bug that prevented import of automation result file (using Automation API) having multiple occurrences of a testcase.
Build 8.6.2.2 - Release Date: 2020-08-03
Bug Fixes
- Fixed a bug that prevented loading of QMetry on IE browser.
- Fixed a bug that caused pie chart gadgets to disappear on mouse hover.
- Fixed a bug that automatically linked release and cycle to the test cases when a test suite is associated to a release and cycle.
- Fixed a bug that caused custom report sync to stop working after an operation with large amount of data was performed in QMetry.
- Fixed a bug that prevented loading of 'User Last Login Details' report on Login Summary Dashboard when generated with a large number of records.
Build 8.6.2.1 - Release Date: 2020-07-12
New Features/Improvements
Improvements on Test Execution against Builds
- Now testers can assign a build for an individual test case execution. This helps when test cases in a same test suite are executed against multiple builds.
- QA Managers can make build selection mandatory to ensure testers assign test executions against a build.
- QA Mangers can set a default build for a release & cycle combination so that test executions are auto assigned an intended build, so that testers do not have set them manually.
- Now view test case executed build information in the Test case - Test Execution details section along with other execution details.
Improvements to System & Custom Reports
- New system dashboard “Test Execution Summary by Folder” is added under QMetry System reports. This dashboard has two reports :-
- “Test Execution Summary by Test Suite Folder - Chart” - Displays the execution summary for all test suite folders with count of executions for each execution status. This chart can be drilled to view summary of the subfolders.
- “Test Execution Details by Test Suite Folder” report - Display the test execution details for all testcases executed in the test suites for the selected folder.
- New system reports -
- Build Execution Summary - Added under Execution Summary dashboard : This report displays test case executions against Build, for combination of Test suites and Platforms.
- Count of Unique users by date - Added under Login Summary dashboard : This report displays unique number of users logged in daily.
- Users last login details - Added under Login Summary dashboard : This report displays last login date and time for each user.
- Execution Summary report will now display chart colors uniform and matching with the execution status colors.
- Modify colors on your custom report charts as required.
- Every report gadget header now has a reset filter option.
Improvements to Exploratory Testing
- Capture browser Console and Network logs for a session that are helpful for developers to debug failed scenarios. The Console and Network events recorded during the session will be displayed on the Console and Network Tab for that session. These logs will also be added as attachments to the test case created from the session. The new chrome extension 1.0.6 has an option to record these logs.
- Test case created from an exploratory session can now be linked to Requirements & Test Suites from the Exploratory testing screen. The workflow now allows testers to execute the test case by associating it to a test execution from within the session as an evidence of the tested use case.
Note : Release 8.6.2 upgrade requires to install/upgrade the latest version v1.0.6 of QMetry Test Management – Exploratory Testing extension on chrome browser.
Improvements to Jira Integration - QMetry Enterprise app
- QMetry Test case panel in Jira for Story and Bugs now displays:
- Latest test case execution status.
- Section now has two tabs – Test Steps & Executions (New)
- Execution Tab displays :
- Test case executions for a combination of test suite, release, cycle, platform and executed version.
- Linked Bugs and Test logs for the test executions.
- Execution details like - Assigned to, Executed by, Executed on & Estimated time.
- Test Steps tab – displays Test steps of the linked test case version.
- Test case detail page in Jira now displays Execution & Test case details in separate tabs.
- Execution tab displays :
- Test case executions for a combination of test suite, release, cycle, platform and executed version.
- Test case step execution details.
- Linked Bugs, Test logs, Comments for the test executions and test step
- Test case details displays complete test case information.
- Execution tab displays :
- Bugs linked directly to requirements in QMetry will now appear in Jira Story “Issue Link” section.
Note : Release 8.6.2 upgrade requires to install/upgrade the latest version v2.0.7 of Jira Integration - QMetry Enterprise App in Jira. For customer using Jira Cloud the add-on will be auto-upgraded to the latest version.
Miscellaneous Improvements
- System Admins can now regulate project administrators access with more granular permissions for create, modify, delete, clone for projects.
- Audit logs now include events for user details like activation, deactivation, role assignments & authentication type changes.
- Export Test Suite Summary details (without test cases and steps) from Test Suite module using option “Export Test Suite List Summary View”.
- Now expand the folder structure panel to easily view long folder names.
- Execute dependent or independent multiple parallel API calls with Json Batch Support.
- While importing automation test cases using Automation API, test cases with summary length truncated to 255 characters can be imported, by setting new "skipWarning" parameter to 1.
- Server installations : System Administrator can now trigger data sync for custom reports, check the sync progress and download logs from Insights configuration screen.
- Server installations : System Administrator now have an option to disable auto deletion of audit, change and test result logs and retain then forever.
Bug Fixes
- Fixed a bug that prevented deactivating a project, if it was the last logged in project for a deleted user.
- Fixed a bug that prevented removing user access from a project, if it is the last logged in project for the user.
- Fixed a bug that displayed mandatory reporter field as optional while creating a Jira issue from QMetry.
- Fixed a bug that displayed workflow statuses from non-integrated Jira projects while creating/searching issues.
- Fixed a bug that prevented loading My Dashboard for some users due to internal duplication of dashboard ids.
- Fixed a bug that prevented syncing of Jira issue if priority field is not set in any of the synced Jira issues.
- Fixes a bug that prevented loading My Dashboard if Jira username for reporter/assignee contains single quote.
- Fixed a bug that prevented freezing grid header row while scrolling records in a page, across the product.
Summary of Open Rest API Changes
API Name | REST URL | Method | Backward Compatible to 8.6.1 | Request Changed | Response Changed |
List all builds | /rest/admin/drop/list | POST | Yes | No | Yes |
Create build | /rest/admin/drops | POST | Yes | Yes | No |
Get Test Suite Run IDs | /rest/execution/list/platformHome | POST | Yes | No | Yes |
Reset execution statuses on build updates | /rest/execution/resetstatus | POST | Yes | Yes | Yes |
Get List of Fields | /rest/admin/managefield/list | POST | Yes | Yes | Yes |
List Test Case Executions | /rest/testcases/execution | POST | Yes | No | Yes |
Fetch Testcase Run ID | /rest/execution/list/viewColumns | POST | Yes | No | Yes |
Get List of Users | /rest/admin/user/list | POST | Yes | No | Yes |
Bulk Update Run Status | /rest/execution/runstatus/bulkupdate | PUT | Yes | No | Yes |
Create Project | /rest/admin/project | POST | Yes | Yes | No |
Get List of Execution Statuses | /rest/admin/execution/list | POST | Yes | Yes | No |
Build 8.6.1.2 - Release Date: 2020-06-05
Bug fix
- Fixed a bug that caused advanced query reports to give no output when opened in edit mode.
Build 8.6.1.1 - Release Date: 2020-05-07
New Features & Improvements:
- Improved Custom Reporting - QMetry Insights, with two views:
- Visual Report – Allows business users to create simple to complex custom report gadgets by just drag & drop of fields from pre-defined entity views. Easily apply group by, sort, filter & multiple math operations on report columns while creating gadgets.
- Advance Query Report – Allows users to create & execute SQL based custom reports using the Query Builder which has an entire snapshot of the QMetry data synced and accessible from just 15 tables.
- General usability improvements :
- View and Copy SQL queries for Visual & Advanced owned/shared gadgets to create your own gadget report.
- Export graphical gadgets to png, jpeg, SVG vector image, PDF; chart data to XLS & raw reports data to csv.
- Quickly clear applied filters using the new "Reset" button on gadgets.
- Easily "Select/Unselect All" list values available to filter gadget reports.
- Turn on/off summary at row/column level in custom cross table report.
- Enhanced filters to search on multiple values of text columns.
- Improvements to System Reports
- Individual filters are now available for system reports gadgets replacing earlier consolidated filter.
- Filter requirements and test cases by their folders while generating traceability report.
- System gadget reports can also be exported to png, jpeg, SVG vector image, PDF, chart data to XLS, raw reports data to csv.
- Quickly clear applied filters using the new "Reset" button on gadgets.
- "Select/Unselect All" list value options now available to filter gadget reports.
- My Dashboard & System gadget reports will now allow selecting inactive users while generating reports and view their assignments.
- Export now available for "Test Result Log" report" in xls & csv format.
- General usability improvements :
- Default pagination can now be increased up-to 100 records per page.
- Project Keys can now be up to 5 characters in length with support for numbers and certain special characters.
- On enabling SAML authentication, the QMetry URL will auto redirect to the SSO provider login page instead of the QMetry login page.
Bug Fixes
- Fixed a bug that could stop auto syncing of reports data if emoji characters were encountered in requirements synced with Jira.
- Fixed a bug that prevented making the reporter selection mandatory while creating bug from QMetry to Jira.
- Fixed a bug that prevented test suite UDF fields to be displayed in bulk edit if modify customization permissions were off.
- Fixed a bug that prompted SAML authenticated user to change password, when the authentication type is changed from QMetry to SAML.
- Fixed a bug that prevented syncing of Jira issues in some cases when issue type of already synced issue is changed.
- Fixed a bug that prevented display of change log and combined view for test cases which had text with characters unrecognized by utf8 character set.
- Fixed a bug that could cause slowness/downtime if about 1 million test cases are exported with steps.
- Fixed a bug that prevented export of parent test case key column when the child test cases are exported.
- Fixed a bug that did not capture audit log for the project rename event.
Jira Integration - QMetry Enterprise App Changes
- Release 8.6.1.1 upgrade requires to install/upgrade the latest version v2.0.5 of Jira Integration - QMetry Enterprise App in Jira.
Rest APIs changed, added & deprecated
- None
Build 8.6.0.3 - Release Date: 2020-04-03
Summary: Improvements and Bug Fixes
Bug Fixes
- Fixed a permission issue that prevented sharing custom dashboards and gadgets with other users.
- Fixed a bug that skipped syncing those Jira issues for which Jira APIs did not respond with data within 60 seconds.
- Fixed a bug that caused some test case/steps contents to overlap making it unreadable when exported in a PDF.
- Fixed a bug that displayed Releases and Cycles in custom gadgets selection filters for the Projects users do not have access to.
- Fixed a bug that prevented proper display of rich text data in large text fields.
- Fixed a bug that showed incorrect timestamps for added comments.
- Fixed a bug that changed the assignee and reporter fields in QMetry issue module for some of the synced Jira issues.
- Fixed a bug that prevented bulk export of custom fields along with other Test suite fields when export with all fields option is selected.
Build 8.6.0.2 - Release Date: 2020-03-16
Summary: Improvements and Bug Fixes
New Features & Improvements:
- Introduced all New Custom Reporting Module - QMetry Insights, which contains a database schema that is separate from the actual QMetry transactional database and is available for users to write/execute custom queries. The reports DB schema has an entire snapshot of QMetry DB in just 15 tables synced real time that makes the query creation simple. Here is the list of features –
- Create custom 'Gadgets' using the new Query Builder with auto suggest feature that makes query creation easy.
- Reuse gadgets for multiple projects by adding default QMetry filters while creation.
- Share gadgets with specific users or all users of a specific role, project combination.
- Create your own 'Dashboards' with multiple gadgets chosen from system, custom owned or shared gadget repositories.
- Share dashboards with other users or schedule them as email notifications one time or recurring.
- Share view only dashboards outside QMetry using Embedded URLs.
- Export dashboard graphical gadgets to PDF and tables/cross table gadgets to csv.
- Export table/cross table gadgets on a dashboard via Open Rest API’s.
- Improved copy test suites feature by introducing more flexible options.
- Copy with associated platforms, test cases & executed version for selected test case execution statuses.
- Copy with the existing execution status or reset them to not run.
- Copy with the current executed version or force sync test cases to latest versions.
- Copy all associations with Release/Cycle and Platforms.
- Copy with all the assignment or unassign executions.
- Link test assets by providing entity keys separated by comma. Also, skip duplicates optionally to prevent them from being linked again.
- Link Test cases to Test suite using Test case Entity Keys.
- Link Test cases to Test suite using Requirement Entity Keys.
- Link Test cases to Requirement using Test case Entity Keys.
- Link Requirements to Test case using Requirement Entity Keys.
- Link Test suites to Test case using Test suite Entity Keys.
- Link Requirements to Issue using Requirement Entity Keys. (Only for Internal Issue Module - QMetry Issues)
- Bulk execute screen is revamped and is now more powerful with the following new options.
- Execute/Assign test cases to 20 platforms on a single window without scrolling. Limited maximum selection to 20 Platforms at a time.
- Select independent test case cells for execution/assignment.
- Select test cases for a specific platform using column selection.
- Test case columns with details like entity key, summary, order will be frozen and will not scroll along with the platforms horizontally.
- Bulk options will now be displayed as separate buttons.
- View complete Test case summary and Platform summary on mouse hover.
- A new gadget "Test Execution Assignments" is added on My Dashboard.
- This gadget displays all the test case executions assigned to a tester for a unique combination of Project, Release, Cycle, Platform, Test suite, Test case & Executed Version.
- This gadget allows testers to view their Pending and Executed test case assignments by filtering them on Execution Status, Project, Release, Cycle.
- Testers will be directly taken to the execution screen by clicking on "Execute" button for the respective test case run.
- Improved Project Clone.
- Admin user will be able to view the clone process started by any user.
- Clone process now automatically ends after 8 hours of inactivity in process and will unlock the source project.
- User will be allowed to edit custom queries when a project is being cloned.
- New System Report to view test execution summary "Platform Summary By Test Suites" - The reports displays execution summary of the test case runs for a combination of Platform and Test suites.
- Entity Keys will now be auto mapped during reimport of Test cases.
- Filter Platforms on Created date range and Created By while linking them to test suite.
- Performance Improvements
- Jira Integration - Project configuration and Syncing Jira issues.
- Release selection while creating a Cycle.
- API to List Releases.
- Assigning user access to a Project.
- Compatibility with MYSQL 5.7.29 community edition.
- Customers who have not bought the “Advanced Reports – Custom Reporting” would now not need a separate reporting server to run the system reports.
Bug Fixes
- Fixed a bug that did not preserve test case status filter while linking test case to test suite.
- Fixed a bug that did not display test result logs for test case steps on previous executed version when test results are imported using Automation API.
- Fixed a bug that caused test case step order to display incorrectly on the execution screen for certain test suites having very large number of steps and associated with multiple release & platform.
- Fixed a bug that displayed duplicate issue statuses in the status list while searching available issues to be linked on execution screen, for projects integrated with Jira.
- Fixed a bug that prevented integration with Jira Projects having Kanban boards.
- Fixed a bug that displayed incorrect count of linked test cases on Test Suite List view.
- Fixed a bug that prevented creating/syncing Jira issues when priority does not exist/optional Jira field.
Jira Integration - QMetry Enterprise App Changes
- Release 8.6 upgrade requires to install/upgrade the latest version v2.0.4 of Jira Integration - QMetry Enterprise App in Jira.
- If upgrading from v8.5.4 below to 8.6 - Post upgrade mandatory sync of Jira integrated projects is needed to display all the mapped Jira fields in the new Issue module.
Deprecated Features
- Visual analytics reporting - Ability to create custom reports using drag and drop columns. - This feature is being redesigned and will be added back in 8.6.1 - April 2020.
- All existing custom gadgets and dashboard needs to be recreated using QMetry Insights. QMetry Support team will assist to create few sample reports, however any existing custom gadgets and dashboard will not be migrated as is.
Rest API Changes
- API changes from v8.5.6.1 to v8.6.1
- /wiki/spaces/QPro/pages/1080197668 ( Refer this link in case you have missed the API changed from 8.5.4 to 8.5.6.1)
Summarized API changes
API Name | REST URL | Method | Backward Compatible 8.5.6.1 | Request Change | Response Change |
---|---|---|---|---|---|
Copy a Test Suite | /rest/testsuites/copy | PUT | Yes | Yes | No |
Get list of Test Suites for a Test Case | /rest/testsuites/list/forTC | POST | No | No | Yes |
Link Requirement(s) with Test Case | /rest/testcases/link/requirement | PUT | Yes | Yes | No |
Link Test Case(s) to Requirement | /rest/requirements/link/testcases | PUT | Yes | Yes | No |
Link Test Suite(s) to Test Case | /rest/testcases/link/testsuites | PUT | Yes | Yes | No |
Link Test Case(s) to Test Suite | /rest/testsuites/dolink/TCs | PUT | Yes | Yes | No |
Build 8.5.6.1 - Release Date: 2020-02-24
Summary: Improvements and Bug Fixes
Improvements:
- Introduced Issue Module for projects synced with Jira. This will allow testers to view/update Jira issues directly from QMetry (except workflow status).
- QMetry now saves user Jira credentials and uses them for authenticating updates made to Jira issues. Users can modify/revoke their saved Jira credentials from Jira Integration page.
- Introduced "Part 11 Compliance Authentication" for E-signature enabled projects. This option would enable mandatory authentication for test case approval, test suite run status change to in-progress/closed and test case execution status change.
- Sync Jira Epics as requirements with support for limited fields.
- Track test case executions as "Manual" or "Automated" by setting the new "Execution Type" field on execution screen.
- Ability to search assets in filters by using comma separated entity IDs.
- Test execution screen now allows testers to resize test case columns to view complete details.
- Export test assets with only required field that are visible on the list grid; instead of all the fields.
- Issue System Reports - Issue Summary, Issue Open vs Closed - Cumulative & Issue Trend Over Time will now display issues synced for Jira integrated projects.
- Improvements to Bulk Execute screen.
- View platform details and its attributes by clicking the platform name.
- Bulk assign test cases to testers for execution.
- Set "Execution Type" in bulk to track execution type as "Manual" or "Automated".
- QMetry Application is now supported on Safari Browser.
- QMetry Installation is now compatible with Open JDK 11 & Apache Tomcat 9.x.
- Jira Integration support for versions 8.7, 8.6 and 8.5
- Performance Improvements
- Jira Integration - Project configuration and Syncing Jira issues.
- Copying test suites along with associated platforms, release & cycles.
- Export up to 1 million records of the traceability report to CSV and Excel.
Bug Fixes:
- Fixed a bug that prevented syncing requirements in some JIRA integrated projects.
- Fixed a bug that failed to search some issues using global search.
- Fixed a bug that caused elongated hyphens to be replaced with black space when a test case is exported in excel.
- Fixed a bug that did not allowed selecting all records across pages while generating the traceability report.
- Fixed a bug that displayed duplicate issue statuses in the search list for a Jira integrated project.
- Fixed a bug that displayed issue workflow statuses in the search list that are not part of the integrated JIRA Project.
- Fixed a bug that prevented fields from getting auto mapped while importing test assets.
- Fixed a bug that allowed exporting all the assets instead only the filtered assets.
- Fixed a bug that prevented integration with GitHub organization account.
- Fixed a bug that prevented filter to be preserved for Test case Status on link test case to testsuite search.
- Fixed a bug that imported Jira issues to QMetry with the created by user who integrates the Jira project with QMetry project instead of the user with whom the add-on is integrated.
Jira Integration - QMetry Enterprise App Changes:
- Release 8.5.6 upgrade requires to install/upgrade the latest version v2.0.3 of Jira Integration - QMetry Enterprise App in Jira.
- Post upgrade mandatory sync of Jira integrated projects is needed to display all the mapped Jira fields in the new Issue module.
Rest API Changes
Summarized API changes
API Name | REST URL | Method | Backward compatibility with 8.5.4 | Request Change | Response Change |
---|---|---|---|---|---|
Get Details of a Requirement | /rest/requirements/list | POST | Yes | No | Yes |
Fetch Requirement List For Issue | /rest/requirements/list/forIS | POST | Yes | No | Yes |
Get List of Users | /rest/admin/user/list | POST | Yes | No | Yes |
Get List of Testcases in Folder | /rest/testcases/list | POST | Yes | No | Yes |
Get Info Services | /rest/admin/project/getinfo | GET | Yes | No | Yes |
Bulk Update Run Status | /rest/execution/runstatus/bulkupdate | PUT | Yes | Yes | No |
Update Test Case linked to Test Suites with latest version | /rest/testsuites/link/testcaseWithLatestVersion | POST | Yes | Yes | No |
Reset execution status on bulk update | /rest/execution/resetstatus | PUT | Yes | Yes | No |
Get list of all projects | /rest/admin/project/list | POST | Yes | No | Yes |
Get list of all releases in a project | /rest/admin/release/list | POST | No | No | Yes |
Common Request Body Changes in below APIs | |||||
Get Requirement list along with Custom Fields | /rest/requirements/list/viewColumns | POST | Yes | Yes | No |
Get Test Case List along with Custom Fields | /rest/testcases/list/viewColumns | POST | Yes | Yes | No |
Get Test Suite List along with Fields | /rest/testsuites/list/viewColumns | POST | Yes | Yes | No |
List Test Execution Run | /rest/execution/list/viewColumns | POST | Yes | Yes | No |
Get Issue list along with Custom Fields (Only for projects that are not integrated with Jira) | /rest/issues/list/viewColumns | POST | Yes | Yes | No |
Get Test case linked to a Requirement | /rest/testcases/list/forRQ | POST | Yes | Yes | No |
Get List of Issues for a Requirement | /rest/issues/list/ForRQ | POST | Yes | Yes | No |
Fetch Requirement List For Test Case | /rest/requirements/list/forTC | POST | Yes | Yes | No |
Get List of Test suites for a Testcase | /rest/testsuites/list/forTC | POST | Yes | Yes | No |
Get List of Requirements while Linking to a Test suite | /rest/requirements/list/forTS | POST | Yes | Yes | No |
Get Test case linked to a TestSuite | /rest/testcases/list/forTS | POST | Yes | Yes | No |
Get list of issue available for linking or already linked to Test case Step Run | /rest/execution/issue/list/forTCStepRun | POST | Yes | Yes | No |
Get list of Issue available for linking or already linked to Test case Run | /rest/execution/issue/list/forTCRun | POST | Yes | Yes | No |
Fetch Requirement List For Issue | /rest/requirements/list/forIS | POST | Yes | Yes | No |
Search Requirement/Test Case/Test Suite/Issue | /rest/search | POST | Yes | Yes | No |
Deprecated APIs
API Name | Deprecated REST Link | Alternate REST Link |
---|---|---|
Get list of test run under execution | /rest/execution/list/tcr | /rest/execution/list/viewColumns |
Get list of issues linked on Execution or Available for linking | /rest/execution/issue/list |
|
Upload Attachment | /rest/attachments/reference | /rest/attachments |
Update Parameter | /rest/parameter/deleteValue/{parameterValueID} | /rest/parameter/update/{paramID} |
Fetch Testcases linked with RQ | /rest/requirements/testcase/list | /rest/testcases/list/forRQ |
Search Entities | /rest/search/result | /rest/search |
Build 8.5.4.1 - Release Date: 2019-09-26
Summary: Bug Fix
Details:
- Fixed a bug while importing using result import API that caused test case and test suite fields to be blank even though settings for auto-create values are enabled or when the fields are marked mandatory.
Build 8.5.4 - Release Date: 2019-09-24
Summary: New Features & Improvements
Details:
Improvements
- Right-click on entity key to open assets in new tab.
- Show/Hide system field - Testing Type
- Set Test suite and Test case fields while importing automation results using Automation API, Jenkins & Bamboo plugins (Refer APIs Changed Section - Automation API)
- Support for Bit Bucket & Git server version for BDD integration.
- Branch support for Bit Bucket & Git integration for BDD.
- Link test cases to test suites of other projects without switching the project
- Create/update and activate/deactivate rights can now be assigned separately while assigning user modify permission
- Make reporter selection mandatory/optional for creating bug from QMetry to Jira
- Open APIs for BDD Integration. (Refer APIs Added)
Open API Changes
APIs Added
API Purpose | Rest End Point |
Get list of configured BDD source code repositories. | /rest/admin/bddConfiguration/list |
Test a configured BDD source code repository | /rest/admin/bddConfiguration/test |
Configure a new BDD source code repository | /rest/admin/bddConfiguration/add |
Update an existing BDD source code repository | /rest/admin/bddConfiguration/update |
Pull a BDD feature file from configured repository and branch | /rest/requirements/pullFile |
Get list of folder in the repository to fetch the feature file path | /rest/requirements/getBDDFolderTree |
Push a modified BDD feature file to the repository and branch | /rest/requirements/pushFile |
Get list of all the branches associated to the configured repository. | /rest/requirements/getBranchList |
Delete a configured BDD source code repository. | /rest/admin/bddConfiguration/delete |
APIs Changed
List of QMetry APIs changed between 8.5.3.2 to 8.5.4 | |||||
API Purpose | API End Point | Method | Backward Compatible with 8.5.3.2 | Request Change | Response Change |
Link Test suite to a Test case | /rest/testcases/link/testsuites | PUT | Yes | Yes | No |
Get all details of a Requirement | /rest/requirements/list | POST | Yes | No | Yes |
View a Requirement detail | /rest/requirements/detail/data | POST | Yes | No | Yes |
Create Requirements | /rest/requirements | POST | Yes | Yes | No |
Get List of Test cases in a Folder | /rest/testcases/list/ | POST | Yes | No | Yes |
View Test suite details | /rest/testsuites/detail/data | POST | Yes | No | Yes |
Create/Update Test suites. | /rest/testsuites | POST | Yes | Yes | No |
Archive a Requirement Folder | /rest/requirements/folder/archive | POST | Yes | Yes | No |
Unarchive a Requirement Folder | /rest/requirements/folder/unarchive | POST | Yes | Yes | No |
Archive a Testcase Folder | /rest/testcases/folder/archive | POST | Yes | Yes | No |
Unarchive a Test suite Folder | /rest/testcases/folder/unarchive | POST | Yes | Yes | No |
Archive a Test suite Folder | /rest/testsuites/folder/archive | POST | Yes | Yes | No |
Un archive a Test suite Folder | /rest/testsuites/folder/unarchive | POST | Yes | Yes | No |
Fetch Test suites for linking to a Test case | /rest/testsuites/list/forTC | POST | Yes | Yes | No |
Automation API | /rest/import/createandscheduletestresults/1 | POST | Yes | No | Yes |
Build 8.5.3.2 - Release Date: 2019-08-13
Summary: Bugfixes
Details :
- Fixed an issue, that prevented a user to edit custom lists, in spite of having project and customization modify rights.
- Fixed an issue, that prevented users from generating Open API key in spite of having view rights of the integration module.
- Fixed an issue, that prevented other users from generating Exploratory Testing API key if an exploratory testing session for any user is in progress.
Build 8.5.3.1 - Release Date: 2019-08-02
Summary: Bugfixes
Details:
- Fixed a bug that showed a warning for insufficient rights to users while opening a test case, if their role did not have view user settings permissions.
- Fixed a bug that prevented the users to rearrange tabs within test cases, if their role did not have view user settings permissions.
Build 8.5.3 - Release Date: 2019-07-29
Summary: New Features & Improvements
Details:
Improvements
- QMetry Menu is now classified as per the QMetry Apps to easily differentiate respective app features.
- Project admins now have an option to disable auto addition of list values while importing from excel that will prevent users from importing values that are not part of list.
- Deleted requirements and issues synced with Jira will now be auto deleted from QMetry as well.
- Enhanced requirement filters to allow search based on Jira fields.
- Redesigned test asset detail view; now has organizable tabs as per different sections; allowing one click access to users.
- Admin can configure a custom email address within email notification template that will direct users to get support as per the defined organization process. (Only for server edition)
- System fields can now be made mandatory or optional.
- Platform attribute details are now available in test execution section of testcase & test suite
- Approval status of test cases in eSignature enabled projects is now available in the export
- Included HTML/XML editor support in large text fields for text formatting.
- Shareable test case details like key, version and steps are now displayed in the testcases using them.
- Shareable test case steps are now shown under QMetry test cases section in Jira.
- QMetry requirement key is now shown in Jira issue synced with QMetry, clicking on the key opens requirement in QMetry.
- BDD integration now supports QAS framework feature files.
- Revamped QMetry panel in Jira now has separate sections for synced requirement, linked test cases & BDD details.
Deprecated Features
- Auto exception reporting to QMetry - For Server Customers.
Bug Fixes
- Fixed bug that allowed using archived values when imported using excel.
- Fixed bug that caused slowness when editing testcase with large number of steps.
- Fixed bug that renamed dashboard when generated for multiple projects.
- Fixed bug that prevented creating an issue in Jira, if field or values have special characters like comma, quotes or colon.
- Fixed bug that did not validate certain valid email addresses while creating new users.
Note : A compatible version of “Jira Integration – QMetry Enterprise” is also released on 27th July which is mandatory for users to upgrade along with QMetry upgrade.
Open API Changes
APIs Changed
API Purpose | Rest URL | Method | Backward compatible to 8.5.2 | Request Change | Response Change |
View Test Suite Details | /rest/testsuites/detail/data | POST | Yes | No | Yes |
Link Platforms to Test Suite | /rest/testsuites/link/platforms | PUT | Yes | No | Yes |
Unlink Platforms to Test Suite | /rest/testsuites/unlink/platforms | PUT | Yes | No | Yes |
List Test Cases Linked with Shared Test Case | /rest/testcases/list/forSharedTestcase | POST | Yes | Yes | Yes |
Get Issue list along with Custom Fields | /rest/issues/list/viewColumns | POST | Yes | No | Yes |
List Test Case Executions | /rest/testcases/execution | POST | No | No | Yes |
Get Test Suite Run IDs | /rest/execution/list/platformHome | POST | Yes | No | Yes |
List of Platforms Linked to a Test Suite | /rest/testsuites/getplatformwithname | POST | Yes | No | Yes |
Get Test case linked to a TestSuite | /rest/testcases/list/forTS | POST | Yes | Yes | Yes |
Link Test Cases to Test Suite | /rest/testsuites/dolink/TCs | PUT | Yes | No | Yes |
Create Requirement | /rest/requirements | POST | Yes | Yes | No |
Create Test Suite | /rest/testsuites | POST | Yes | Yes | No |
Create Test case(s) | /rest/testcases | POST | Yes | Yes | No |
Get List of all Automation Agents | /rest/admin/agent/read | POST | Yes | No | Yes |
Get Test Case List along with Custom Fields | /rest/testcases/list/viewColumns | POST | No | No | Yes |
List Platform | /rest/admin/platform/list | POST | No | No | Yes |
Clone Project | /rest/admin/project/clone | POST | Yes | No | Yes |
Build 8.5.2.3 - Release Date: 2019-5-7
Summary: Improvement
Improvements
- Added support for SMTP integration that does not require user name and password for authentication.
Build 8.5.2.2 - Release Date: 2019-5-3
Summary: Improvement and Bug Fixes
Improvements
- Import TestNG Results by mapping Test "Name" as Test Case Summary and Test Method "Name" as Test Step.
- Test Category and Priority system list values can be archived.
Bug Fix
- Fixed bug that prevented admins from editing user details if SMTP is not configured.
- Fixed bug that did not allow to un associate Jira custom fields from QMetry modules that were mapped before Release 8.5
Build 8.5.2 - Release Date: 2019-4-13
Summary: Improvement and Bug Fixes
Improvements
- Testcase estimated time is now available while generating custom reports using Visual Analysis.
- Pending Test cases report in My Dashboard displays test cases which are not executed (Not Run status) and assigned to selected user.
- Executed Test cases report in My Dashboard displays test cases which are executed by selected user.
- QMetry - Jira Integration add-on is renamed to “Jira Integration - QMetry Enterprise” in Atlassian Marketplace.
- Jira integration changes to comply with Atlassian GDPR privacy policy
- Improved overall performance and scalability using Redis caching
Bug Fixes
- Fixed bug that caused error while opening a requirement imported from Jira containing double quotes.
- Fixed bug that prevented import of results using Automation API if Test suite has mandatory fields with default values.
- Fixed bug that prevented bulk linking requirements to testcases that had requirements already linked.
- Fixed bug that did not allow scheduling of reports in Chrome.
Fixed bug that gives error while import of results using Automation API if Test suite has mandatory fields with default values.
Fixed bug that display permission error when creating an internal issue.
Fixed bug that did not allow to set assignee while creating issues during exploratory testing; released chrome add-on version 1.0.2
Open API Changes
APIs Added
API Name | Open API |
Create user and map roles | /rest/admin/user/withrole |
Update role/project for user | /rest/admin/user/update/withrole |
Generate/Reset Automation API | /rest/admin/user/generateAutomationAPI |
APIs Modified
List of QMetry APIs changed between 8.5.1 to 8.5.2 | |||||
API Name | Rest URL | Method | Backward Compatible with 8.5.1 | Request Change | Response Change |
Link Testcases to Test suite | /rest/testsuites/dolink/TCs | PUT | Yes | No | Yes |
Release Date: 2019-2-25
Summary: New Features & Improvements
Details:
Test Suite Improvements
- Easily filter test cases that are not planned for execution for a combination of Release and Cycle
- Hide test cases already linked to a test suite to avoid duplicate linkage of test cases
- Latest search filters will be preserved on link test case to test suite screen
- Bulk sync testcases to their latest version on the execution screen
Automation Improvements
- Reuse test cases based on test case key for TestNG framework.
- Configure hierarchy of Test suite, Test case or Test case step while importing automation results for TestNG and JUnit.
Report Improvements
- Test suite execution summary report displays total number of platforms and test cases linked to a test suite.
- Resolved issue verification report displays linkage hierarchy for issue linked at test case or test case step.
- Visual Analytics – added column for reporter & created by for issues imported from Jira.
General Improvements
- Test case description shall be auto added to Issue description when creating an Issue from the execution screen.
- Choose folder while importing requirements from Jira.
- Integration support for Jira version 8.x.
- Quick button to copy API key.
- Test category is sorted alphabetically for easy assignment.
- Sorting of Test assets will be preserved on all modules grids.
- Shared test case will have details of test cases that are using it.
- Improved performance while editing test steps when a test case has a large number of steps.
- Updates made to test case steps are preserved while creating a new version from the detail screen.
Open API Changes
APIs Added
- Get list of Testcases linked to a Shared Testcase
- Auto fill parameter values in data grid
APIs Modified
API Purpose | Rest URL | Method | Backward compatible with 8.5 | Request Change | Response Change | Method Change |
Update Test Case Linked to Test Suite with Latest Version | /testsuites/link/testcaseWithLatestVersion | POST | No | Yes | No | No |
Get List of Testcases while Linking to a Test suite | /testcases/list/forTS | POST | Yes | Yes | Yes | No |
Bulk Update Run Status | /execution/runstatus/bulkupdate | PUT | Yes | No | Yes | No |
Get List of Requirements while Linking to a Test suite | /requirements/list/forTS | POST | Yes | No | Yes | No |
Get List of Testcases for a Requirement | /testcases/list/forRQ | POST | Yes | No | Yes | No |
Get Test Suite List along with Fields | /testsuites/list/viewColumns | POST | Yes | No | Yes | No |
Delete User | /admin/user/delete | PUT | No | No | No | Yes |
Delete Project | /admin/project/delete | PUT | No | No | No | Yes |
Add New Parameters | /parameter | POST | Yes | No | Yes | No |
Get Requirements List along with Fields | /requirements/list/viewColumns | POST | Yes | No | Yes | No |
Get Test Cases List along with Fields | /testcases/list/viewColumns | POST | Yes | Yes | Yes | No |
Create Requirement | /requirements | POST | Yes | No | Yes | No |
Get Issues List along with Fields | /issues/list/viewColumns | POST | Yes | No | Yes | No |
Release Date: 2019-1-16
Summary: New Features & Improvements
Details:
QMetry - Jira Integration Improvements
- Integrate multiple Jira Projects with a single QMetry Project. (More...)
- QMetry-Jira integration requires mandatory installation of QMetry Integration add-on in Jira. Jira integration no more requires authentication with Jira admin credentials. (More...)
- Be on top of the discussions happening on the Jira story as QMetry requirements syncs latest 10 comments made on the story.
- Simplified mapping of Jira custom fields with QMetry Requirements & Issues.
- Sync Jira Labels & Sprints in QMetry for imported Requirements and Issues.
Report Improvements
- New Report - Test Suite Summary report summarizes the count of testcases executed and their execution status for a selected release and cycle.
- New Report - Online Logged in User report displays the list of users logged in to QMetry and their last activity time.
- Top Issue Report, Traceability Report by Issue, Execution - Issue Summary Reports & Test cases with Issues Report now shows bugs linked at Test Case Step.
- Custom Reports are now editable.
- Approval Workflow Report now shows "Approved Date" for Testcases and Test Executions.
- Audit Log Report now shows Data Parameters and Data Grid modifications.
- Change Log Report now displays the name of the field which was edited with it's type and key.
- Generate custom reports separately for Requirements/Issues created in QMetry and imported from Jira.
Test Execution Improvements
- Organize Testcase and Testcase Step columns on execution screen.
- Enable Testcase custom fields on Test execution screen. (Large Text fields are excluded).
- View Estimated and Remaining execution time at Test suite view and Platform view.
- Add/manage builds directly from Test execution screen.
- Archive Test suites before they are deleted.
- Import attachments for test executions via automation API for Cucumber and QAF frameworks.
General Improvements
- Link Requirements, Testcases, Test suites & Issues filtering them by custom fields.
- Archive folders across QMetry. Archiving folders will archive & hide all subfolders and assets under it.
- Testcase Summary and Entity Key are shown on the detail page of testcase link screen in Jira.
- Bulk link Releases/Cycles/Testcases to Requirements imported from Jira.
- Hide/unhide multi look up fields as columns on list grids for all modules.
- Global Project Search gets data for sharable testcases.
- Requirement module would have BDD section visible only when a version control system is configured for the project.
- Archived Releases & Cycles will be hidden from lists across all modules.
- Multiple users could be notified while pushing BDD modifications to VCS.
Deprecated Features
- QMetry Internal Issue module will not be enabled for projects that have Jira integrated.
- Issue can be created from QMetry to Jira but have to edited in Jira.
- Requirements imported from Jira cannot be filtered based on Jira fields in the List grid & Bulk Operations.
- Issues cannot be linked/filtered to Requirements/Test Executions filtered based on custom fields.
- QMetry Test case links created in the Jira Issue link section. (Not needed any more as Testcase links are visible in Test Case Section in Issue)
- Import of Jira Requirements & Issues via user defined JQL. (Not needed any more as Jira QMetry Project mapping requires mapping of Issue Types for Modules.)
- Following Issue Module Reports will not display data for QMetry Projects that are synced with Jira Project, as these reports can be viewed directly in Jira.
1. Issue Summary
2. Issue Leakage Rate
3. Issue Re-Open Rate
4. Issue Average Aging
5. Issue Created vs Resolved
6. Issue Trend Over Time
7. Issue Open vs Closed
API Changes
API's Added | ||
Refer: Open API Documentation | ||
API Name | Rest Link | |
Get Requirement list along with Custom Fields | /rest/requirements/list/viewColumns | |
Get Testcase list along with Custom Fields | /rest/testcases/list/viewColumns | |
Get Test suite list along with Custom Fields | /rest/testsuites/list/viewColumns | |
Get Issue list along with Custom Fields (Only for projects that are not integrated with Jira) | /rest/issues/list/viewColumns | |
Added API to archive folder in Requirement, Testcase and Test suites | /rest/requirements/folder/archive /rest/testcases/folder/archive /rest/testsuites/folder/archive | |
Added API to unarchive folder in Requirement, Testcase and Test suites | /rest/requirements/folder/unarchive /rest/testcases/folder/unarchive /rest/testsuites/folder/unarchive | |
Get List of Requirements linked to Issue. | /rest/requirements/list/forIS | |
Get List of Testcases linked to a Test suite | /rest/testcases/list/forTS | |
Get list of Issue available for linking or already linked to Test case Run | /rest/execution/issue/list/forTCRun | |
Get list of issue available for linking or already linked to Test case Step Run | /rest/execution/issue/list/forTCStepRun | |
Get list of Testcase Step Run for a Test Case execution along with dynamic columns | /rest/execution/tcStepRun/list/viewColumns | |
Get List of Test suites for a Testcase | /rest/testsuites/list/forTC | |
Get List of Issues for a Requirement | /rest/issues/list/forRQ | |
API's Updated | ||
Refer : API Changed from v8.4.4 to 8.5 for more details. | ||
API Name | Rest Link | |
Get List of Requirement Folder and Sub Folders | /rest/requirements/tree | |
Get List of Testcase Folder and Sub Folders | /rest/testcase/tree | |
Get List of Test suite Folder and Sub Folders | /rest/testsuites/tree | |
Get List of Requirements for a Testcase | /rest/requirements/list/forTC | |
Get List of Testcases for a Requirement | /rest/testcases/list/forRQ | |
Get List of Requirements while Linking to a Test suite | /rest/requirements/list/forTS | |
Get List of Testcases while Linking to a Test suite | /rest/testcases/list/forTS | |
API's Deprecated | ||
These API's will be deprecated in March,2019. Instead, use the Alternative Rest Link. | ||
API Name | Deprecated Rest Link | Alternative Rest Link |
Get list of Issue linked to Test case Run | rest/issues/getForTCRun | /rest/execution/issue/list/forTCRun |
Get list of issue linked to Test case Step Run | rest/issues/getForTCStepRun | /rest/execution/issue/list/forTCStepRun |
Get list of Testcase Step Run for a Test Case execution | rest/execution/list/tcsr | /rest/execution/tcStepRun/list/viewColumns |
Release Date: 2018-11-17
Summary: New Features & Improvements
Details:
New Features
- Visual analytics reporting now supports custom fields.
- User can create "new folder" while performing bulk copy/move of test assets.
- "Ask Me Anything" now search data in test steps i.e. step summary, expected outcome and input data.
- Provided option to bulk approve (e-sign) test case & bulk approve/close (e-sign) test suite executions.
Released QMetry Exploratory Testing Add-on v1.3.7 on Chrome store.
General Improvements
- Increased limit for uploading attachment to test assets up to 30 MB for server installations.
- "Include Entities from Sub-Folder" will be auto-enabled for all the modules.
- User can define "Test suite summary" while importing automation results via Automation API/Jenkins/Bamboo/Maven.
- QMetry displays "resolution", "fix version" & "affected version" fields for requirements imported from Jira
- User is warned before closing the test case authoring screen to prevent accidental data loss.
- QMetry Voyager is renamed as QMetry Exploratory Testing.
- View subsequent test assets using Next/Previous button on details screen Improved UI that allows easy scrolling of folder tree, asset grid & pagination on module grids.
- Improved UI that allows quick filter of Test assets on module grids.
Reports Improvement
- Issue Leakage Report can be drilled down to get list of the missed issues.
- New Report - "Issue Average Ageing" Report that displays the average age of unresolved issues for a selected time frame.
- Added External Id column in Issue reports to differentiate between internal and Jira issues.
Bulk operation Improvements
- Task notification displays the number of test assets on which bulk operations are performed.
- Improved performance for bulk copy/move/link TC/Unlink TC to Test suite operations.
Execution Screen Improvements
- Actual Results and Test Step Status of failed testcases will be added to issue description when raised from execution screen.
- Issues created from execution screen will have summary as 'Test case ID + Test Case summary'.
- Issues linked at Test Steps will be displayed at Test Case on the execution screen.
Deprecated Feature
- The avatar/indicator of username is deprecated across all screens in the Product.
API Changes
API's Added | ||
API Name | Rest Link | |
API to Unlink Testcases from Test suite | /rest/testsuites/doUnlink/TCs | |
API to Link Testcases to Test suite | /rest/testsuites/dolink/TCs | |
API to Get Issue (bugs) linked to a Testcase | /rest/issues/getIssuesForTestCase | |
API to Get Executions associated to Issue (bug) | /rest/execution/getExecutionsForIssue | |
API's Updated | ||
API Name | Rest Link | |
List of issues linked to Execution | /rest/execution/issues/list | |
Get Test Case Run IDs | /rest/execution/list/tcr | |
List of Releases | /rest/admin/release/list | |
Update Requirements | /rest/requirements | |
Update Test Cases | /rest/testcases | |
Update TestSuites | /rest/testsuites | |
Update Internal Issues | /rest/issues | |
Update Parameter Values | /rest/parameter/update/{paramID} | |
API's Deprecated | ||
These API's will be deprecated in next 3 months. Instead use the Alternative Rest Link. | ||
API Name | Deprecated Rest Link | Alternative Rest Link |
API to Link Testcases to Test suite | /rest/testsuites/link/testcases | /rest/testsuites/dolink/TCs |
API to Unlink Testcases from Test suite | rest/testsuites/unlink/testcases | /rest/testsuites/doUnlink/TCs |
Release Date: 2018-10-06
Summary: Bug Fixes
- Users can associate release & cycle to test cases, requirements & test suites only if modify project permission is provided.
- Search results in Microsoft Edge does not reset after clearing the search text.
- Fixed bug with horizontal scroll bar on all the module girds and link screens.
- Test suite export does not include parameterized values for Test Steps.
- Post editing test cases/test suite/requirement the focus on selected folder gets reset.
- Bulk delete in Issue Module allows deletion of Jira issues added/linked from within QMetry.
Release Date: 2018-09-15
Summary: Improvements
Improvements
- Performance improvement with support for 2000 users
- Simplified menu options for quick navigation
- Schedule emails for system reports - daily, weekly or monthly
- Import Test cases/Requirement/Issues using xls/csv/xlsx up to 10 mb in size (earlier it was 2 mb).
- Filter Test cases/Requirement/Issues by their Folder Path or Labels while linking and during bulk operations.
- Added project level configuration to identify the issues as resolved based on their workflow statuses. This configuration will define issue reports.
- For eSignature enabled projects, Testcase PDF export includes details of approvals.
- Execute custom commands as per your automation framework using QMetry Agent, without a need to provide details like Project Path, Result file Path, Framework or Build in the Test suite. Read the difference here.
- Schedule automation executions using Automation Agent with support to set recurrence.
- Test executions are differentiated as Automated/Manual. Test suites are no more differentiated as automated or manual.
Rest API
API Changed
- The API response for Get Info Service is changed, till v8.4.1 the response included data for all the projects from v8.4.2 the response would include data for a single project.
- The API request & response for Get Requirement Folders under a given folder is changed.
- The API request & response for Get Test case Folders under a given folder is changed.
- The API request & response for Get Test suite Folders under a given folder is changed.
New API's
- Get List of Audit Logs
- List Test cases for Bulk Operations
- Get Test cases linked to a specific Requirement
- Get Test cases linked to a specific TestSuite
- Get Test Data Parameters in a Test case version linked to a TestSuite
- Get version details of a Test case
- List Requirements for Bulk Operations
- Get Requirements linked to a specific Issue
- Get Requirements linked to a specific Test Suite
- Get Requirements linked to a specific Test case
- Get version details of a Requirement
- Get Issue linked to a TestCaseStep Run
- Get Issue linked to a TestCase Run
Release Date: 2018-08-11
Summary: New Reports
Added New Reports of Issue Trends and Issue Analysis.
Issue Trends:
- Issue Trend Over Time
- Issue Open Vs. Closed - Cumulative
Issue Analysis:
- Issue Velocity compared to Test Cases executed
- Issue Velocity compared to Requirements
- Issue Leakage Rate
- Issue Re-Open Rate
Release Date: 2018-07-07
Summary: New Features & Improvements
New Features
- Introduced E-signature based approval workflow for testcase authorization and test execution
- Enterprise reporting capabilities allows to generate custom matrices based on organization testing process
- Enterprise teams practicing Behavior-Driven Development (BDD) can author, store and sync features files directly to/from Version Control Systems (VCS) like SVN, Git and Bitbucket, using the built-in Gherkin editor in QMetry requirements. The two-way syncing between QMetry & VCS keep developers, testers and product owners up-to-date with the latest source code change commits with automated step definitions. Using QMetry automation agents, test executions could be trigged directly from QMetry. Test cases are smartly created/reused authored based on the feature step definitions and link them to requirements. Test Suite stores the automation execution results ensuring complete feature traceability with requirements.
- Enhance reusability and save effort on creating duplicate test assets by sharing test cases/requirements/issues across projects.
- Test data parameterization allows testers to execute same test case multiple times with different data inputs; without having to create duplicate test cases. Test Data parametrization allow QA teams to store reusable test data in one centralized location, Import existing parameters and data sets & share data across QMetry projects.
- Record sessions using inbuilt exploratory testing capabilities that allow testers to capture screenshots of any content without ever leaving your browser window. Communicate feedback clearly with easy-to-use annotation tools, audio recordings, auto capture details of environment and ensure nothing slips through the cracks while raising bugs. Create test cases directly from sessions without taking efforts to author them manually.
General Improvements
- Quick in place editor on detail screens for all test assets.
- Save duplicate efforts on managing folder structure by cloning them across modules.
- Efficiently manage folders & assets with easy move & copy options.
- Ensure coverage completeness & cut time spent on linking testcases manually to test suites by creating Test suite directly from requirement/requirement folder/testcase/testcase folder
- Creating testcase directly from requirement helps by copying data for common fields.
- Download all attachments of a test asset in a single click.
- Easy management of attachments at entity level instead of versions.
- Export Test cases details in elegant pdf format.
- Reuse custom fields and Platform attribute across projects and modules
Integration Improvements
- Organize requirements synced from Jira to QMetry in folder structure e.g based on sprints, modules, components, features etc
- Manage Jira-QMetry fields mapping separately for requirements and issues
- Remove Jira integration now allows to retain test assets synced by converting them to QMetry internal assets
- 150+ open API's to integrate external tools with QMetry. Revised Swagger documentation with ability to track changes between versions.
UI/UX Improvements
- Easily sequence testcases in a test suite by drag/drop or move options.
- Quick search on menu to reach the desired option.
- Simplified menu options for quick navigation.
Release Date: 2018-06-05
Summary: Bug Fixes
- Improved performance of execution screen while updating the test case status.
- Fixed bug that prevented users from cloning project.
- Fixed bug that prevented users from mapping Jira project with QMetry project.
- Fixed bug that prevented user from mapping Jira field of type “string” with QMetry field.
- Fixed bug that prevented user from accessing Testcase - Automation vs Manual report.
- Fixed bug that prevented user from editing the “executed at” field on execution screen.
- Fixed “Add New Release” API bug that caused the start date to be set same as completion date.
Release Date: 2018-05-19
Summary: New Features & Improvements
New Features
- Collaborate with your team by adding "Comment" on all Test Assets
- Don’t miss any updates on important Test Assets by adding yourself and your team members as "Watcher"
- Create sharable test cases and reduce effort by reusing them in multiple test cases
- Describe granular details by adding attachments to your test steps
- Create/link bugs for failed steps right at the test step level
- Choose to Show/Hide/Resize/Arrange field columns on all module grids to auto save your view preference
- Easily filter test asset by any system/custom fields on all module grids to perform bulk operations
- Add attachments to your test assets by directly pasting them from the clipboard
Improvements
- Creator and Owner will be auto added to watcher list so that they are aware of the updates
- Beautify Test case steps using the Rich Text Editor
- View execution details directly from Test case details
- Test Execution Attachments will now be visible on Test case details - Test Execution tab.
- Easily identify Steps from shared Test cases
- Expand/Collapse all Test cases and Steps in a single click.
- Rich Text/HTML description of imported from Jira to QMetry will be preserved.
- Choose to include/exclude Test Assets from Sub Folders at Parent folder.
- Improved My Profile Page, added option to modify your Jira integration credentials incase those are changed.
- Trace audit trail for comments on Test Assets
- Provided option to view activity log on Execution Screen like Assign Tester, Set Build, Change Execution Time
- Provided option to view Test Execution (Result) logs on execution screen.
- Scheduled Task to include detailed information like Source & Destination Projects, Executor Name.
- Added ability to bulk comments on Test Assets
- Bulk operations will now allow selection of only 1000 assets at time.
Release Date: 2018-05-10
Summary: Improvements & Bug Fixes
Improvements
- While mapping Jira fields with QMetry fields the drop down values are alphabetically sorted.
Bug Fixes
- Fixed bug that prevented bi directional sync of attachments in issues between QMetry and Jira
- Fixed bug that prevented syncing of Issue Owner for issues/stories imported from Jira to QMetry.
Release Date: 2018-05-02
Summary: Improvements & Bug Fixes
Improvements
- Users having project admin rights can now view the license count of the QMetry instance.
Bug Fixes
- Fixed bug that prevented creation of custom fields in a cloned project.
- Fixed bug that prevented the sync of owner and sprint fields of requirements imported from Jira.
- Fixed bug that prevented the sync of custom fields of requirements imported from Jira.
- Fixed bug that prevented user to enter 2 and 4 digit ports in SMTP settings.
- Fixed bug that prevented import of requirements from Jira in a cloned project.
Release Date: 2018-04-20
Summary: New Feature & Improvements
Details
- Link "Test cases from Requirement" while creating a test suite.
- Arrange linked test cases in specific order while creating a test suite.
- Enhanced attachment section to display details like file type, size, date and user.
- Added ability to bulk delete attachments on test assets.
- Added ability to export all test case/Requirements/Issues in a single click. (Removed limitation of 1000 records.)
- Compare test execution for multiple release cycles using the new "Release Cycle" report.
- Easily track test suite execution with development builds.
- Added capability to reuse manual test cases as automated for automation executions on QAF & Cucumber frameworks. Test cases would be reused based on Entity Key or Test case summary.
- Added Execution Type column on the Test Execution Grid.
- QMetry Add-on Improvements:
- Testcase Section - Jira story that is imported in QMetry; now displays linked Test cases details along with steps & attachment in Jira.
- Added option open test case in QMetry from test case details page in Jira.
- Added option to enabled/disabled QMetry panel for Jira projects.
- Integration scheduler now displays details of success/failures during Jira Syncing.
- Dissociation of Jira integration will not delete the already imported issues.
- On logout, existing user session will be notified; if QMetry is logged from another device.
- Email Notification are more detailed and informative.
- Product evaluation registration can only be done only using business email id's.
Release Date: 2018-03-24
Summary: Improvements
Details
- Support for IE11 and Microsoft Edge
- Added refresh button in reports that enables users to view real time data
- Report system exceptions to support team with complete details auto captured
- Improved Password Strength to minimum 8 characters in length with a combination of at least one Uppercase, Lowercase, Number, Special character
- Better control of server resources on cloud, by implementing restrictions on external API calls
1. Max 1000 calls per hour per instance.
2. Max 10000 calls per day per instance.
3. Max 500 Automation API call per day per instance. - Users will get a verification email post registration for an evaluation
- View sync status of Requirements and Issues imported from Jira to QMetry
- LDAP users can login without organization code - For On-premise Installations
- Updated QMetry Test Management License Agreement.
Release Date: 2018-03-10
Summary: New Features
Details
- Ability to Archive / Unarchive platforms. This allows users to get rid of unused platforms without losing data.
- Modify Test Steps and save as new version without changing actual test data
- Intuitive, productivity enhancer Test Execution Screen
- Intuitive, simple UI for maintaining Releases & Cycles
- While creating new customer, mention Organization code of your choice. User will be also asked to verify a Captcha as enhanced security.
- Modify test case execution time stamp at each test case level
- Automated Data retention and cleanup for bulky audit and change logs
- Test Case/Steps to get copied in defect while logging a defect from test execution screen
- Intuitive, friendly JIRA Integration configuration screens
- Choose build number while test execution
- Ability to export Test Executions as Excel/CSV file
- Ability to Perform bulk operations as background job without impacting normal operations.
- Bulk operations can be performed on Test Cases or Requirements or Issues
- Bulk edit, copy, move, delete, archive, unarchive within or Across projects
- Intuitive and flexible UI with ability to filter and choose.
- Bulk link Requirements with Test cases, Issues
- Bulk link Test suites with Platforms, Test cases
- Bulk link Test cases with Requirements
- Bulk edit specific versions of Requirements and Test cases
- Bulk link attachment to any entity.
- Associate Releases and Cycles to Requirements, Test cases & Test suites in Bulk.
Back to QMetry All Products Help Page