Release Notes
Mrunalini Potnis
Jatin Lala
Punit Samtani
Build 8.6.1.2 - Release Date: 2020-06-05
Bug fix
- Fixed a bug that caused advanced query reports to give no output when opened in edit mode.
Build 8.6.1.1 - Release Date: 2020-05-07
New Features & Improvements:
- Improved Custom Reporting - QMetry Insights, with two views:
- Visual Report – Allows business users to create simple to complex custom report gadgets by just drag & drop of fields from pre-defined entity views. Easily apply group by, sort, filter & multiple math operations on report columns while creating gadgets.
- Advance Query Report – Allows users to create & execute SQL based custom reports using the Query Builder which has an entire snapshot of the QMetry data synced and accessible from just 15 tables.
- General usability improvements :
- View and Copy SQL queries for Visual & Advanced owned/shared gadgets to create your own gadget report.
- Export graphical gadgets to png, jpeg, SVG vector image, PDF; chart data to XLS & raw reports data to csv.
- Quickly clear applied filters using the new "Reset" button on gadgets.
- Easily "Select/Unselect All" list values available to filter gadget reports.
- Turn on/off summary at row/column level in custom cross table report.
- Enhanced filters to search on multiple values of text columns.
- Improvements to System Reports
- Export now available for "Test Result Log" report" in xls & csv format.
- General usability improvements :
- Individual filters are now available for system reports gadgets replacing earlier consolidated filter.
- Filter requirements and test cases by their folders while generating traceability report.
- System gadget reports can also be exported to png, jpeg, SVG vector image, PDF, chart data to XLS, raw reports data to csv.
- Quickly clear applied filters using the new "Reset" button on gadgets.
- "Select/Unselect All" list value options now available to filter gadget reports.
- My Dashboard & System gadget reports will now allow selecting inactive users while generating reports and view their assignments.
- Default pagination can now be increased up-to 100 records per page.
- Project Keys can now be up to 5 characters in length with support for numbers and certain special characters.
- On enabling SAML authentication, the QMetry URL will auto redirect to the SSO provider login page instead of the QMetry login page.
Bug Fixes
- Fixed a bug that could stop auto syncing of reports data if emoji characters were encountered in requirements synced with Jira.
- Fixed a bug that prevented making the reporter selection mandatory while creating bug from QMetry to Jira.
- Fixed a bug that prevented test suite UDF fields to be displayed in bulk edit if modify customization permissions were off.
- Fixed a bug that prompted SAML authenticated user to change password, when the authentication type is changed from QMetry to SAML.
- Fixed a bug that prevented syncing of Jira issues in some cases when issue type of already synced issue is changed.
- Fixed a bug that prevented display of change log and combined view for test cases which had text with characters unrecognized by utf8 character set.
- Fixed a bug that could cause slowness/downtime if about 1 million test cases are exported with steps.
- Fixed a bug that prevented export of parent test case key column when the child test cases are exported.
- Fixed a bug that did not capture audit log for the project rename event.
Jira Integration - QMetry Enterprise App Changes
- Release 8.6.1.1 upgrade requires to install/upgrade the latest version v2.0.5 of Jira Integration - QMetry Enterprise App in Jira.
Rest APIs changed, added & deprecated
- None
Previous Versions
Build 8.6.0.3 - Release Date: 2020-04-03
Summary: Improvements and Bug Fixes
Bug Fixes
- Fixed a permission issue that prevented sharing custom dashboards and gadgets with other users.
- Fixed a bug that skipped syncing those Jira issues for which Jira APIs did not respond with data within 60 seconds.
- Fixed a bug that caused some test case/steps contents to overlap making it unreadable when exported in a PDF.
- Fixed a bug that displayed Releases and Cycles in custom gadgets selection filters for the Projects users do not have access to.
- Fixed a bug that prevented proper display of rich text data in large text fields.
- Fixed a bug that showed incorrect timestamps for added comments.
- Fixed a bug that changed the assignee and reporter fields in QMetry issue module for some of the synced Jira issues.
- Fixed a bug that prevented bulk export of custom fields along with other Test suite fields when export with all fields option is selected.
Build 8.6.0.2 - Release Date: 2020-03-16
Summary: Improvements and Bug Fixes
New Features & Improvements:
- Introduced all New Custom Reporting Module - QMetry Insights, which contains a database schema that is separate from the actual QMetry transactional database and is available for users to write/execute custom queries. The reports DB schema has an entire snapshot of QMetry DB in just 15 tables synced real time that makes the query creation simple. Here is the list of features –
- Create custom 'Gadgets' using the new Query Builder with auto suggest feature that makes query creation easy.
- Reuse gadgets for multiple projects by adding default QMetry filters while creation.
- Share gadgets with specific users or all users of a specific role, project combination.
- Create your own 'Dashboards' with multiple gadgets chosen from system, custom owned or shared gadget repositories.
- Share dashboards with other users or schedule them as email notifications one time or recurring.
- Share view only dashboards outside QMetry using Embedded URLs.
- Export dashboard graphical gadgets to PDF and tables/cross table gadgets to csv.
- Export table/cross table gadgets on a dashboard via Open Rest API’s.
- Improved copy test suites feature by introducing more flexible options.
- Copy with associated platforms, test cases & executed version for selected test case execution statuses.
- Copy with the existing execution status or reset them to not run.
- Copy with the current executed version or force sync test cases to latest versions.
- Copy all associations with Release/Cycle and Platforms.
- Copy with all the assignment or unassign executions.
- Link test assets by providing entity keys separated by comma. Also, skip duplicates optionally to prevent them from being linked again.
- Link Test cases to Test suite using Test case Entity Keys.
- Link Test cases to Test suite using Requirement Entity Keys.
- Link Test cases to Requirement using Test case Entity Keys.
- Link Requirements to Test case using Requirement Entity Keys.
- Link Test suites to Test case using Test suite Entity Keys.
- Link Requirements to Issue using Requirement Entity Keys. (Only for Internal Issue Module - QMetry Issues)
- Bulk execute screen is revamped and is now more powerful with the following new options.
- Execute/Assign test cases to 20 platforms on a single window without scrolling. Limited maximum selection to 20 Platforms at a time.
- Select independent test case cells for execution/assignment.
- Select test cases for a specific platform using column selection.
- Test case columns with details like entity key, summary, order will be frozen and will not scroll along with the platforms horizontally.
- Bulk options will now be displayed as separate buttons.
- View complete Test case summary and Platform summary on mouse hover.
- A new gadget "Test Execution Assignments" is added on My Dashboard.
- This gadget displays all the test case executions assigned to a tester for a unique combination of Project, Release, Cycle, Platform, Test suite, Test case & Executed Version.
- This gadget allows testers to view their Pending and Executed test case assignments by filtering them on Execution Status, Project, Release, Cycle.
- Testers will be directly taken to the execution screen by clicking on "Execute" button for the respective test case run.
- Improved Project Clone.
- Admin user will be able to view the clone process started by any user.
- Clone process now automatically ends after 8 hours of inactivity in process and will unlock the source project.
- User will be allowed to edit custom queries when a project is being cloned.
- New System Report to view test execution summary "Platform Summary By Test Suites" - The reports displays execution summary of the test case runs for a combination of Platform and Test suites.
- Entity Keys will now be auto mapped during reimport of Test cases.
- Filter Platforms on Created date range and Created By while linking them to test suite.
- Performance Improvements
- Jira Integration - Project configuration and Syncing Jira issues.
- Release selection while creating a Cycle.
- API to List Releases.
- Assigning user access to a Project.
- Compatibility with MYSQL 5.7.29 community edition.
- Customers who have not bought the “Advanced Reports – Custom Reporting” would now not need a separate reporting server to run the system reports.
Bug Fixes
- Fixed a bug that did not preserve test case status filter while linking test case to test suite.
- Fixed a bug that did not display test result logs for test case steps on previous executed version when test results are imported using Automation API.
- Fixed a bug that caused test case step order to display incorrectly on the execution screen for certain test suites having very large number of steps and associated with multiple release & platform.
- Fixed a bug that displayed duplicate issue statuses in the status list while searching available issues to be linked on execution screen, for projects integrated with Jira.
- Fixed a bug that prevented integration with Jira Projects having Kanban boards.
- Fixed a bug that displayed incorrect count of linked test cases on Test Suite List view.
- Fixed a bug that prevented creating/syncing Jira issues when priority does not exist/optional Jira field.
Jira Integration - QMetry Enterprise App Changes
- Release 8.6 upgrade requires to install/upgrade the latest version v2.0.4 of Jira Integration - QMetry Enterprise App in Jira.
- If upgrading from v8.5.4 below to 8.6 - Post upgrade mandatory sync of Jira integrated projects is needed to display all the mapped Jira fields in the new Issue module.
Deprecated Features
- Visual analytics reporting - Ability to create custom reports using drag and drop columns. - This feature is being redesigned and will be added back in 8.6.1 - April 2020.
- All existing custom gadgets and dashboard needs to be recreated using QMetry Insights. QMetry Support team will assist to create few sample reports, however any existing custom gadgets and dashboard will not be migrated as is.
Rest API Changes
- API changes from v8.5.6.1 to v8.6.1
- /wiki/spaces/QPro/pages/1080197668 ( Refer this link in case you have missed the API changed from 8.5.4 to 8.5.6.1)
Summarized API changes
API Name | REST URL | Method | Backward Compatible 8.5.6.1 | Request Change | Response Change |
---|---|---|---|---|---|
Copy a Test Suite | /rest/testsuites/copy | PUT | Yes | Yes | No |
Get list of Test Suites for a Test Case | /rest/testsuites/list/forTC | POST | No | No | Yes |
Link Requirement(s) with Test Case | /rest/testcases/link/requirement | PUT | Yes | Yes | No |
Link Test Case(s) to Requirement | /rest/requirements/link/testcases | PUT | Yes | Yes | No |
Link Test Suite(s) to Test Case | /rest/testcases/link/testsuites | PUT | Yes | Yes | No |
Link Test Case(s) to Test Suite | /rest/testsuites/dolink/TCs | PUT | Yes | Yes | No |
Build 8.5.6.1 - Release Date: 2020-02-24
Summary: Improvements and Bug Fixes
Improvements:
- Introduced Issue Module for projects synced with Jira. This will allow testers to view/update Jira issues directly from QMetry (except workflow status).
- QMetry now saves user Jira credentials and uses them for authenticating updates made to Jira issues. Users can modify/revoke their saved Jira credentials from Jira Integration page.
- Introduced "Part 11 Compliance Authentication" for E-signature enabled projects. This option would enable mandatory authentication for test case approval, test suite run status change to in-progress/closed and test case execution status change.
- Sync Jira Epics as requirements with support for limited fields.
- Track test case executions as "Manual" or "Automated" by setting the new "Execution Type" field on execution screen.
- Ability to search assets in filters by using comma separated entity IDs.
- Test execution screen now allows testers to resize test case columns to view complete details.
- Export test assets with only required field that are visible on the list grid; instead of all the fields.
- Issue System Reports - Issue Summary, Issue Open vs Closed - Cumulative & Issue Trend Over Time will now display issues synced for Jira integrated projects.
- Improvements to Bulk Execute screen.
- View platform details and its attributes by clicking the platform name.
- Bulk assign test cases to testers for execution.
- Set "Execution Type" in bulk to track execution type as "Manual" or "Automated".
- QMetry Application is now supported on Safari Browser.
- QMetry Installation is now compatible with Open JDK 11 & Apache Tomcat 9.x.
- Jira Integration support for versions 8.7, 8.6 and 8.5
- Performance Improvements
- Jira Integration - Project configuration and Syncing Jira issues.
- Copying test suites along with associated platforms, release & cycles.
- Export up to 1 million records of the traceability report to CSV and Excel.
Bug Fixes:
- Fixed a bug that prevented syncing requirements in some JIRA integrated projects.
- Fixed a bug that failed to search some issues using global search.
- Fixed a bug that caused elongated hyphens to be replaced with black space when a test case is exported in excel.
- Fixed a bug that did not allowed selecting all records across pages while generating the traceability report.
- Fixed a bug that displayed duplicate issue statuses in the search list for a Jira integrated project.
- Fixed a bug that displayed issue workflow statuses in the search list that are not part of the integrated JIRA Project.
- Fixed a bug that prevented fields from getting auto mapped while importing test assets.
- Fixed a bug that allowed exporting all the assets instead only the filtered assets.
- Fixed a bug that prevented integration with GitHub organization account.
- Fixed a bug that prevented filter to be preserved for Test case Status on link test case to testsuite search.
- Fixed a bug that imported Jira issues to QMetry with the created by user who integrates the Jira project with QMetry project instead of the user with whom the add-on is integrated.
Jira Integration - QMetry Enterprise App Changes:
- Release 8.5.6 upgrade requires to install/upgrade the latest version v2.0.3 of Jira Integration - QMetry Enterprise App in Jira.
- Post upgrade mandatory sync of Jira integrated projects is needed to display all the mapped Jira fields in the new Issue module.
Rest API Changes
Summarized API changes
API Name | REST URL | Method | Backward compatibility with 8.5.4 | Request Change | Response Change |
---|---|---|---|---|---|
Get Details of a Requirement | /rest/requirements/list | POST | Yes | No | Yes |
Fetch Requirement List For Issue | /rest/requirements/list/forIS | POST | Yes | No | Yes |
Get List of Users | /rest/admin/user/list | POST | Yes | No | Yes |
Get List of Testcases in Folder | /rest/testcases/list | POST | Yes | No | Yes |
Get Info Services | /rest/admin/project/getinfo | GET | Yes | No | Yes |
Bulk Update Run Status | /rest/execution/runstatus/bulkupdate | PUT | Yes | Yes | No |
Update Test Case linked to Test Suites with latest version | /rest/testsuites/link/testcaseWithLatestVersion | POST | Yes | Yes | No |
Reset execution status on bulk update | /rest/execution/resetstatus | PUT | Yes | Yes | No |
Get list of all projects | /rest/admin/project/list | POST | Yes | No | Yes |
Get list of all releases in a project | /rest/admin/release/list | POST | No | No | Yes |
Common Request Body Changes in below APIs | |||||
Get Requirement list along with Custom Fields | /rest/requirements/list/viewColumns | POST | Yes | Yes | No |
Get Test Case List along with Custom Fields | /rest/testcases/list/viewColumns | POST | Yes | Yes | No |
Get Test Suite List along with Fields | /rest/testsuites/list/viewColumns | POST | Yes | Yes | No |
List Test Execution Run | /rest/execution/list/viewColumns | POST | Yes | Yes | No |
Get Issue list along with Custom Fields (Only for projects that are not integrated with Jira) | /rest/issues/list/viewColumns | POST | Yes | Yes | No |
Get Test case linked to a Requirement | /rest/testcases/list/forRQ | POST | Yes | Yes | No |
Get List of Issues for a Requirement | /rest/issues/list/ForRQ | POST | Yes | Yes | No |
Fetch Requirement List For Test Case | /rest/requirements/list/forTC | POST | Yes | Yes | No |
Get List of Test suites for a Testcase | /rest/testsuites/list/forTC | POST | Yes | Yes | No |
Get List of Requirements while Linking to a Test suite | /rest/requirements/list/forTS | POST | Yes | Yes | No |
Get Test case linked to a TestSuite | /rest/testcases/list/forTS | POST | Yes | Yes | No |
Get list of issue available for linking or already linked to Test case Step Run | /rest/execution/issue/list/forTCStepRun | POST | Yes | Yes | No |
Get list of Issue available for linking or already linked to Test case Run | /rest/execution/issue/list/forTCRun | POST | Yes | Yes | No |
Fetch Requirement List For Issue | /rest/requirements/list/forIS | POST | Yes | Yes | No |
Search Requirement/Test Case/Test Suite/Issue | /rest/search | POST | Yes | Yes | No |
Deprecated APIs
API Name | Deprecated REST Link | Alternate REST Link |
---|---|---|
Get list of test run under execution | /rest/execution/list/tcr | /rest/execution/list/viewColumns |
Get list of issues linked on Execution or Available for linking | /rest/execution/issue/list |
|
Upload Attachment | /rest/attachments/reference | /rest/attachments |
Update Parameter | /rest/parameter/deleteValue/{parameterValueID} | /rest/parameter/update/{paramID} |
Fetch Testcases linked with RQ | /rest/requirements/testcase/list | /rest/testcases/list/forRQ |
Search Entities | /rest/search/result | /rest/search |
Build 8.5.4.1 - Release Date: 2019-09-26
Summary: Bug Fix
Details:
- Fixed a bug while importing using result import API that caused test case and test suite fields to be blank even though settings for auto-create values are enabled or when the fields are marked mandatory.
Build 8.5.4 - Release Date: 2019-09-24
Summary: New Features & Improvements
Details:
Improvements
- Right-click on entity key to open assets in new tab.
- Show/Hide system field - Testing Type
- Set Test suite and Test case fields while importing automation results using Automation API, Jenkins & Bamboo plugins (Refer APIs Changed Section - Automation API)
- Support for Bit Bucket & Git server version for BDD integration.
- Branch support for Bit Bucket & Git integration for BDD.
- Link test cases to test suites of other projects without switching the project
- Create/update and activate/deactivate rights can now be assigned separately while assigning user modify permission
- Make reporter selection mandatory/optional for creating bug from QMetry to Jira
- Open APIs for BDD Integration. (Refer APIs Added)
Open API Changes
APIs Added
API Purpose | Rest End Point |
Get list of configured BDD source code repositories. | /rest/admin/bddConfiguration/list |
Test a configured BDD source code repository | /rest/admin/bddConfiguration/test |
Configure a new BDD source code repository | /rest/admin/bddConfiguration/add |
Update an existing BDD source code repository | /rest/admin/bddConfiguration/update |
Pull a BDD feature file from configured repository and branch | /rest/requirements/pullFile |
Get list of folder in the repository to fetch the feature file path | /rest/requirements/getBDDFolderTree |
Push a modified BDD feature file to the repository and branch | /rest/requirements/pushFile |
Get list of all the branches associated to the configured repository. | /rest/requirements/getBranchList |
Delete a configured BDD source code repository. | /rest/admin/bddConfiguration/delete |
APIs Changed
List of QMetry APIs changed between 8.5.3.2 to 8.5.4 | |||||
API Purpose | API End Point | Method | Backward Compatible with 8.5.3.2 | Request Change | Response Change |
Link Test suite to a Test case | /rest/testcases/link/testsuites | PUT | Yes | Yes | No |
Get all details of a Requirement | /rest/requirements/list | POST | Yes | No | Yes |
View a Requirement detail | /rest/requirements/detail/data | POST | Yes | No | Yes |
Create Requirements | /rest/requirements | POST | Yes | Yes | No |
Get List of Test cases in a Folder | /rest/testcases/list/ | POST | Yes | No | Yes |
View Test suite details | /rest/testsuites/detail/data | POST | Yes | No | Yes |
Create/Update Test suites. | /rest/testsuites | POST | Yes | Yes | No |
Archive a Requirement Folder | /rest/requirements/folder/archive | POST | Yes | Yes | No |
Unarchive a Requirement Folder | /rest/requirements/folder/unarchive | POST | Yes | Yes | No |
Archive a Testcase Folder | /rest/testcases/folder/archive | POST | Yes | Yes | No |
Unarchive a Test suite Folder | /rest/testcases/folder/unarchive | POST | Yes | Yes | No |
Archive a Test suite Folder | /rest/testsuites/folder/archive | POST | Yes | Yes | No |
Un archive a Test suite Folder | /rest/testsuites/folder/unarchive | POST | Yes | Yes | No |
Fetch Test suites for linking to a Test case | /rest/testsuites/list/forTC | POST | Yes | Yes | No |
Automation API | /rest/import/createandscheduletestresults/1 | POST | Yes | No | Yes |
Build 8.5.3.2 - Release Date: 2019-08-13
Summary: Bugfixes
Details :
- Fixed an issue, that prevented a user to edit custom lists, in spite of having project and customization modify rights.
- Fixed an issue, that prevented users from generating Open API key in spite of having view rights of the integration module.
- Fixed an issue, that prevented other users from generating Exploratory Testing API key if an exploratory testing session for any user is in progress.
Build 8.5.3.1 - Release Date: 2019-08-02
Summary: Bugfixes
Details:
- Fixed a bug that showed a warning for insufficient rights to users while opening a test case, if their role did not have view user settings permissions.
- Fixed a bug that prevented the users to rearrange tabs within test cases, if their role did not have view user settings permissions.
Build 8.5.3 - Release Date: 2019-07-29
Summary: New Features & Improvements
Details:
Improvements
- QMetry Menu is now classified as per the QMetry Apps to easily differentiate respective app features.
- Project admins now have an option to disable auto addition of list values while importing from excel that will prevent users from importing values that are not part of list.
- Deleted requirements and issues synced with Jira will now be auto deleted from QMetry as well.
- Enhanced requirement filters to allow search based on Jira fields.
- Redesigned test asset detail view; now has organizable tabs as per different sections; allowing one click access to users.
- Admin can configure a custom email address within email notification template that will direct users to get support as per the defined organization process. (Only for server edition)
- System fields can now be made mandatory or optional.
- Platform attribute details are now available in test execution section of testcase & test suite
- Approval status of test cases in eSignature enabled projects is now available in the export
- Included HTML/XML editor support in large text fields for text formatting.
- Shareable test case details like key, version and steps are now displayed in the testcases using them.
- Shareable test case steps are now shown under QMetry test cases section in Jira.
- QMetry requirement key is now shown in Jira issue synced with QMetry, clicking on the key opens requirement in QMetry.
- BDD integration now supports QAS framework feature files.
- Revamped QMetry panel in Jira now has separate sections for synced requirement, linked test cases & BDD details.
Deprecated Features
- Auto exception reporting to QMetry - For Server Customers.
Bug Fixes
- Fixed bug that allowed using archived values when imported using excel.
- Fixed bug that caused slowness when editing testcase with large number of steps.
- Fixed bug that renamed dashboard when generated for multiple projects.
- Fixed bug that prevented creating an issue in Jira, if field or values have special characters like comma, quotes or colon.
- Fixed bug that did not validate certain valid email addresses while creating new users.
Note : A compatible version of “Jira Integration – QMetry Enterprise” is also released on 27th July which is mandatory for users to upgrade along with QMetry upgrade.
Open API Changes
APIs Changed
API Purpose | Rest URL | Method | Backward compatible to 8.5.2 | Request Change | Response Change |
View Test Suite Details | /rest/testsuites/detail/data | POST | Yes | No | Yes |
Link Platforms to Test Suite | /rest/testsuites/link/platforms | PUT | Yes | No | Yes |
Unlink Platforms to Test Suite | /rest/testsuites/unlink/platforms | PUT | Yes | No | Yes |
List Test Cases Linked with Shared Test Case | /rest/testcases/list/forSharedTestcase | POST | Yes | Yes | Yes |
Get Issue list along with Custom Fields | /rest/issues/list/viewColumns | POST | Yes | No | Yes |
List Test Case Executions | /rest/testcases/execution | POST | No | No | Yes |
Get Test Suite Run IDs | /rest/execution/list/platformHome | POST | Yes | No | Yes |
List of Platforms Linked to a Test Suite | /rest/testsuites/getplatformwithname | POST | Yes | No | Yes |
Get Test case linked to a TestSuite | /rest/testcases/list/forTS | POST | Yes | Yes | Yes |
Link Test Cases to Test Suite | /rest/testsuites/dolink/TCs | PUT | Yes | No | Yes |
Create Requirement | /rest/requirements | POST | Yes | Yes | No |
Create Test Suite | /rest/testsuites | POST | Yes | Yes | No |
Create Test case(s) | /rest/testcases | POST | Yes | Yes | No |
Get List of all Automation Agents | /rest/admin/agent/read | POST | Yes | No | Yes |
Get Test Case List along with Custom Fields | /rest/testcases/list/viewColumns | POST | No | No | Yes |
List Platform | /rest/admin/platform/list | POST | No | No | Yes |
Clone Project | /rest/admin/project/clone | POST | Yes | No | Yes |
Build 8.5.2.3 - Release Date: 2019-5-7
Summary: Improvement
Improvements
- Added support for SMTP integration that does not require user name and password for authentication.
Build 8.5.2.2 - Release Date: 2019-5-3
Summary: Improvement and Bug Fixes
Improvements
- Import TestNG Results by mapping Test "Name" as Test Case Summary and Test Method "Name" as Test Step.
- Test Category and Priority system list values can be archived.
Bug Fix
- Fixed bug that prevented admins from editing user details if SMTP is not configured.
- Fixed bug that did not allow to un associate Jira custom fields from QMetry modules that were mapped before Release 8.5
Build 8.5.2 - Release Date: 2019-4-13
Summary: Improvement and Bug Fixes
Improvements
- Testcase estimated time is now available while generating custom reports using Visual Analysis.
- Pending Test cases report in My Dashboard displays test cases which are not executed (Not Run status) and assigned to selected user.
- Executed Test cases report in My Dashboard displays test cases which are executed by selected user.
- QMetry - Jira Integration add-on is renamed to “Jira Integration - QMetry Enterprise” in Atlassian Marketplace.
- Jira integration changes to comply with Atlassian GDPR privacy policy
- Improved overall performance and scalability using Redis caching
Bug Fixes
- Fixed bug that caused error while opening a requirement imported from Jira containing double quotes.
- Fixed bug that prevented import of results using Automation API if Test suite has mandatory fields with default values.
- Fixed bug that prevented bulk linking requirements to testcases that had requirements already linked.
- Fixed bug that did not allow scheduling of reports in Chrome.
Fixed bug that gives error while import of results using Automation API if Test suite has mandatory fields with default values.
Fixed bug that display permission error when creating an internal issue.
Fixed bug that did not allow to set assignee while creating issues during exploratory testing; released chrome add-on version 1.0.2
Open API Changes
APIs Added
API Name | Open API |
Create user and map roles | /rest/admin/user/withrole |
Update role/project for user | /rest/admin/user/update/withrole |
Generate/Reset Automation API | /rest/admin/user/generateAutomationAPI |
APIs Modified
List of QMetry APIs changed between 8.5.1 to 8.5.2 | |||||
API Name | Rest URL | Method | Backward Compatible with 8.5.1 | Request Change | Response Change |
Link Testcases to Test suite | /rest/testsuites/dolink/TCs | PUT | Yes | No | Yes |
Release Date: 2019-2-25
Summary: New Features & Improvements
Details:
Test Suite Improvements
- Easily filter test cases that are not planned for execution for a combination of Release and Cycle
- Hide test cases already linked to a test suite to avoid duplicate linkage of test cases
- Latest search filters will be preserved on link test case to test suite screen
- Bulk sync testcases to their latest version on the execution screen
Automation Improvements
- Reuse test cases based on test case key for TestNG framework.
- Configure hierarchy of Test suite, Test case or Test case step while importing automation results for TestNG and JUnit.
Report Improvements
- Test suite execution summary report displays total number of platforms and test cases linked to a test suite.
- Resolved issue verification report displays linkage hierarchy for issue linked at test case or test case step.
- Visual Analytics – added column for reporter & created by for issues imported from Jira.
General Improvements
- Test case description shall be auto added to Issue description when creating an Issue from the execution screen.
- Choose folder while importing requirements from Jira.
- Integration support for Jira version 8.x.
- Quick button to copy API key.
- Test category is sorted alphabetically for easy assignment.
- Sorting of Test assets will be preserved on all modules grids.
- Shared test case will have details of test cases that are using it.
- Improved performance while editing test steps when a test case has a large number of steps.
- Updates made to test case steps are preserved while creating a new version from the detail screen.
Open API Changes
APIs Added
- Get list of Testcases linked to a Shared Testcase
- Auto fill parameter values in data grid
APIs Modified
API Purpose | Rest URL | Method | Backward compatible with 8.5 | Request Change | Response Change | Method Change |
Update Test Case Linked to Test Suite with Latest Version | /testsuites/link/testcaseWithLatestVersion | POST | No | Yes | No | No |
Get List of Testcases while Linking to a Test suite | /testcases/list/forTS | POST | Yes | Yes | Yes | No |
Bulk Update Run Status | /execution/runstatus/bulkupdate | PUT | Yes | No | Yes | No |
Get List of Requirements while Linking to a Test suite | /requirements/list/forTS | POST | Yes | No | Yes | No |
Get List of Testcases for a Requirement | /testcases/list/forRQ | POST | Yes | No | Yes | No |
Get Test Suite List along with Fields | /testsuites/list/viewColumns | POST | Yes | No | Yes | No |
Delete User | /admin/user/delete | PUT | No | No | No | Yes |
Delete Project | /admin/project/delete | PUT | No | No | No | Yes |
Add New Parameters | /parameter | POST | Yes | No | Yes | No |
Get Requirements List along with Fields | /requirements/list/viewColumns | POST | Yes | No | Yes | No |
Get Test Cases List along with Fields | /testcases/list/viewColumns | POST | Yes | Yes | Yes | No |
Create Requirement | /requirements | POST | Yes | No | Yes | No |
Get Issues List along with Fields | /issues/list/viewColumns | POST | Yes | No | Yes | No |
Release Date: 2019-1-16
Summary: New Features & Improvements
Details:
QMetry - Jira Integration Improvements
- Integrate multiple Jira Projects with a single QMetry Project. (More...)
- QMetry-Jira integration requires mandatory installation of QMetry Integration add-on in Jira. Jira integration no more requires authentication with Jira admin credentials. (More...)
- Be on top of the discussions happening on the Jira story as QMetry requirements syncs latest 10 comments made on the story.
- Simplified mapping of Jira custom fields with QMetry Requirements & Issues.
- Sync Jira Labels & Sprints in QMetry for imported Requirements and Issues.
Report Improvements
- New Report - Test Suite Summary report summarizes the count of testcases executed and their execution status for a selected release and cycle.
- New Report - Online Logged in User report displays the list of users logged in to QMetry and their last activity time.
- Top Issue Report, Traceability Report by Issue, Execution - Issue Summary Reports & Test cases with Issues Report now shows bugs linked at Test Case Step.
- Custom Reports are now editable.
- Approval Workflow Report now shows "Approved Date" for Testcases and Test Executions.
- Audit Log Report now shows Data Parameters and Data Grid modifications.
- Change Log Report now displays the name of the field which was edited with it's type and key.
- Generate custom reports separately for Requirements/Issues created in QMetry and imported from Jira.
Test Execution Improvements
- Organize Testcase and Testcase Step columns on execution screen.
- Enable Testcase custom fields on Test execution screen. (Large Text fields are excluded).
- View Estimated and Remaining execution time at Test suite view and Platform view.
- Add/manage builds directly from Test execution screen.
- Archive Test suites before they are deleted.
- Import attachments for test executions via automation API for Cucumber and QAF frameworks.
General Improvements
- Link Requirements, Testcases, Test suites & Issues filtering them by custom fields.
- Archive folders across QMetry. Archiving folders will archive & hide all subfolders and assets under it.
- Testcase Summary and Entity Key are shown on the detail page of testcase link screen in Jira.
- Bulk link Releases/Cycles/Testcases to Requirements imported from Jira.
- Hide/unhide multi look up fields as columns on list grids for all modules.
- Global Project Search gets data for sharable testcases.
- Requirement module would have BDD section visible only when a version control system is configured for the project.
- Archived Releases & Cycles will be hidden from lists across all modules.
- Multiple users could be notified while pushing BDD modifications to VCS.
Deprecated Features
- QMetry Internal Issue module will not be enabled for projects that have Jira integrated.
- Issue can be created from QMetry to Jira but have to edited in Jira.
- Requirements imported from Jira cannot be filtered based on Jira fields in the List grid & Bulk Operations.
- Issues cannot be linked/filtered to Requirements/Test Executions filtered based on custom fields.
- QMetry Test case links created in the Jira Issue link section. (Not needed any more as Testcase links are visible in Test Case Section in Issue)
- Import of Jira Requirements & Issues via user defined JQL. (Not needed any more as Jira QMetry Project mapping requires mapping of Issue Types for Modules.)
- Following Issue Module Reports will not display data for QMetry Projects that are synced with Jira Project, as these reports can be viewed directly in Jira.
1. Issue Summary
2. Issue Leakage Rate
3. Issue Re-Open Rate
4. Issue Average Aging
5. Issue Created vs Resolved
6. Issue Trend Over Time
7. Issue Open vs Closed
API Changes
API's Added | ||
Refer: Open API Documentation | ||
API Name | Rest Link | |
Get Requirement list along with Custom Fields | /rest/requirements/list/viewColumns | |
Get Testcase list along with Custom Fields | /rest/testcases/list/viewColumns | |
Get Test suite list along with Custom Fields | /rest/testsuites/list/viewColumns | |
Get Issue list along with Custom Fields (Only for projects that are not integrated with Jira) | /rest/issues/list/viewColumns | |
Added API to archive folder in Requirement, Testcase and Test suites | /rest/requirements/folder/archive /rest/testcases/folder/archive /rest/testsuites/folder/archive | |
Added API to unarchive folder in Requirement, Testcase and Test suites | /rest/requirements/folder/unarchive /rest/testcases/folder/unarchive /rest/testsuites/folder/unarchive | |
Get List of Requirements linked to Issue. | /rest/requirements/list/forIS | |
Get List of Testcases linked to a Test suite | /rest/testcases/list/forTS | |
Get list of Issue available for linking or already linked to Test case Run | /rest/execution/issue/list/forTCRun | |
Get list of issue available for linking or already linked to Test case Step Run | /rest/execution/issue/list/forTCStepRun | |
Get list of Testcase Step Run for a Test Case execution along with dynamic columns | /rest/execution/tcStepRun/list/viewColumns | |
Get List of Test suites for a Testcase | /rest/testsuites/list/forTC | |
Get List of Issues for a Requirement | /rest/issues/list/forRQ | |
API's Updated | ||
Refer : API Changed from v8.4.4 to 8.5 for more details. | ||
API Name | Rest Link | |
Get List of Requirement Folder and Sub Folders | /rest/requirements/tree | |
Get List of Testcase Folder and Sub Folders | /rest/testcase/tree | |
Get List of Test suite Folder and Sub Folders | /rest/testsuites/tree | |
Get List of Requirements for a Testcase | /rest/requirements/list/forTC | |
Get List of Testcases for a Requirement | /rest/testcases/list/forRQ | |
Get List of Requirements while Linking to a Test suite | /rest/requirements/list/forTS | |
Get List of Testcases while Linking to a Test suite | /rest/testcases/list/forTS | |
API's Deprecated | ||
These API's will be deprecated in March,2019. Instead, use the Alternative Rest Link. | ||
API Name | Deprecated Rest Link | Alternative Rest Link |
Get list of Issue linked to Test case Run | rest/issues/getForTCRun | /rest/execution/issue/list/forTCRun |
Get list of issue linked to Test case Step Run | rest/issues/getForTCStepRun | /rest/execution/issue/list/forTCStepRun |
Get list of Testcase Step Run for a Test Case execution | rest/execution/list/tcsr | /rest/execution/tcStepRun/list/viewColumns |
Release Date: 2018-11-17
Summary: New Features & Improvements
Details:
New Features
- Visual analytics reporting now supports custom fields.
- User can create "new folder" while performing bulk copy/move of test assets.
- "Ask Me Anything" now search data in test steps i.e. step summary, expected outcome and input data.
- Provided option to bulk approve (e-sign) test case & bulk approve/close (e-sign) test suite executions.
Released QMetry Exploratory Testing Add-on v1.3.7 on Chrome store.
General Improvements
- Increased limit for uploading attachment to test assets up to 30 MB for server installations.
- "Include Entities from Sub-Folder" will be auto-enabled for all the modules.
- User can define "Test suite summary" while importing automation results via Automation API/Jenkins/Bamboo/Maven.
- QMetry displays "resolution", "fix version" & "affected version" fields for requirements imported from Jira
- User is warned before closing the test case authoring screen to prevent accidental data loss.
- QMetry Voyager is renamed as QMetry Exploratory Testing.
- View subsequent test assets using Next/Previous button on details screen Improved UI that allows easy scrolling of folder tree, asset grid & pagination on module grids.
- Improved UI that allows quick filter of Test assets on module grids.
Reports Improvement
- Issue Leakage Report can be drilled down to get list of the missed issues.
- New Report - "Issue Average Ageing" Report that displays the average age of unresolved issues for a selected time frame.
- Added External Id column in Issue reports to differentiate between internal and Jira issues.
Bulk operation Improvements
- Task notification displays the number of test assets on which bulk operations are performed.
- Improved performance for bulk copy/move/link TC/Unlink TC to Test suite operations.
Execution Screen Improvements
- Actual Results and Test Step Status of failed testcases will be added to issue description when raised from execution screen.
- Issues created from execution screen will have summary as 'Test case ID + Test Case summary'.
- Issues linked at Test Steps will be displayed at Test Case on the execution screen.
Deprecated Feature
- The avatar/indicator of username is deprecated across all screens in the Product.
API Changes
API's Added | ||
API Name | Rest Link | |
API to Unlink Testcases from Test suite | /rest/testsuites/doUnlink/TCs | |
API to Link Testcases to Test suite | /rest/testsuites/dolink/TCs | |
API to Get Issue (bugs) linked to a Testcase | /rest/issues/getIssuesForTestCase | |
API to Get Executions associated to Issue (bug) | /rest/execution/getExecutionsForIssue | |
API's Updated | ||
API Name | Rest Link | |
List of issues linked to Execution | /rest/execution/issues/list | |
Get Test Case Run IDs | /rest/execution/list/tcr | |
List of Releases | /rest/admin/release/list | |
Update Requirements | /rest/requirements | |
Update Test Cases | /rest/testcases | |
Update TestSuites | /rest/testsuites | |
Update Internal Issues | /rest/issues | |
Update Parameter Values | /rest/parameter/update/{paramID} | |
API's Deprecated | ||
These API's will be deprecated in next 3 months. Instead use the Alternative Rest Link. | ||
API Name | Deprecated Rest Link | Alternative Rest Link |
API to Link Testcases to Test suite | /rest/testsuites/link/testcases | /rest/testsuites/dolink/TCs |
API to Unlink Testcases from Test suite | rest/testsuites/unlink/testcases | /rest/testsuites/doUnlink/TCs |
Release Date: 2018-10-06
Summary: Bug Fixes
- Users can associate release & cycle to test cases, requirements & test suites only if modify project permission is provided.
- Search results in Microsoft Edge does not reset after clearing the search text.
- Fixed bug with horizontal scroll bar on all the module girds and link screens.
- Test suite export does not include parameterized values for Test Steps.
- Post editing test cases/test suite/requirement the focus on selected folder gets reset.
- Bulk delete in Issue Module allows deletion of Jira issues added/linked from within QMetry.
Release Date: 2018-09-15
Summary: Improvements
Improvements
- Performance improvement with support for 2000 users
- Simplified menu options for quick navigation
- Schedule emails for system reports - daily, weekly or monthly
- Import Test cases/Requirement/Issues using xls/csv/xlsx up to 10 mb in size (earlier it was 2 mb).
- Filter Test cases/Requirement/Issues by their Folder Path or Labels while linking and during bulk operations.
- Added project level configuration to identify the issues as resolved based on their workflow statuses. This configuration will define issue reports.
- For eSignature enabled projects, Testcase PDF export includes details of approvals.
- Execute custom commands as per your automation framework using QMetry Agent, without a need to provide details like Project Path, Result file Path, Framework or Build in the Test suite. Read the difference here.
- Schedule automation executions using Automation Agent with support to set recurrence.
- Test executions are differentiated as Automated/Manual. Test suites are no more differentiated as automated or manual.
Rest API
API Changed
- The API response for Get Info Service is changed, till v8.4.1 the response included data for all the projects from v8.4.2 the response would include data for a single project.
- The API request & response for Get Requirement Folders under a given folder is changed.
- The API request & response for Get Test case Folders under a given folder is changed.
- The API request & response for Get Test suite Folders under a given folder is changed.
New API's
- Get List of Audit Logs
- List Test cases for Bulk Operations
- Get Test cases linked to a specific Requirement
- Get Test cases linked to a specific TestSuite
- Get Test Data Parameters in a Test case version linked to a TestSuite
- Get version details of a Test case
- List Requirements for Bulk Operations
- Get Requirements linked to a specific Issue
- Get Requirements linked to a specific Test Suite
- Get Requirements linked to a specific Test case
- Get version details of a Requirement
- Get Issue linked to a TestCaseStep Run
- Get Issue linked to a TestCase Run
Release Date: 2018-08-11
Summary: New Reports
Added New Reports of Issue Trends and Issue Analysis.
Issue Trends:
- Issue Trend Over Time
- Issue Open Vs. Closed - Cumulative
Issue Analysis:
- Issue Velocity compared to Test Cases executed
- Issue Velocity compared to Requirements
- Issue Leakage Rate
- Issue Re-Open Rate
Release Date: 2018-07-07
Summary: New Features & Improvements
New Features
- Introduced E-signature based approval workflow for testcase authorization and test execution
- Enterprise reporting capabilities allows to generate custom matrices based on organization testing process
- Enterprise teams practicing Behavior-Driven Development (BDD) can author, store and sync features files directly to/from Version Control Systems (VCS) like SVN, Git and Bitbucket, using the built-in Gherkin editor in QMetry requirements. The two-way syncing between QMetry & VCS keep developers, testers and product owners up-to-date with the latest source code change commits with automated step definitions. Using QMetry automation agents, test executions could be trigged directly from QMetry. Test cases are smartly created/reused authored based on the feature step definitions and link them to requirements. Test Suite stores the automation execution results ensuring complete feature traceability with requirements.
- Enhance reusability and save effort on creating duplicate test assets by sharing test cases/requirements/issues across projects.
- Test data parameterization allows testers to execute same test case multiple times with different data inputs; without having to create duplicate test cases. Test Data parametrization allow QA teams to store reusable test data in one centralized location, Import existing parameters and data sets & share data across QMetry projects.
- Record sessions using inbuilt exploratory testing capabilities that allow testers to capture screenshots of any content without ever leaving your browser window. Communicate feedback clearly with easy-to-use annotation tools, audio recordings, auto capture details of environment and ensure nothing slips through the cracks while raising bugs. Create test cases directly from sessions without taking efforts to author them manually.
General Improvements
- Quick in place editor on detail screens for all test assets.
- Save duplicate efforts on managing folder structure by cloning them across modules.
- Efficiently manage folders & assets with easy move & copy options.
- Ensure coverage completeness & cut time spent on linking testcases manually to test suites by creating Test suite directly from requirement/requirement folder/testcase/testcase folder
- Creating testcase directly from requirement helps by copying data for common fields.
- Download all attachments of a test asset in a single click.
- Easy management of attachments at entity level instead of versions.
- Export Test cases details in elegant pdf format.
- Reuse custom fields and Platform attribute across projects and modules
Integration Improvements
- Organize requirements synced from Jira to QMetry in folder structure e.g based on sprints, modules, components, features etc
- Manage Jira-QMetry fields mapping separately for requirements and issues
- Remove Jira integration now allows to retain test assets synced by converting them to QMetry internal assets
- 150+ open API's to integrate external tools with QMetry. Revised Swagger documentation with ability to track changes between versions.
UI/UX Improvements
- Easily sequence testcases in a test suite by drag/drop or move options.
- Quick search on menu to reach the desired option.
- Simplified menu options for quick navigation.
Release Date: 2018-06-05
Summary: Bug Fixes
- Improved performance of execution screen while updating the test case status.
- Fixed bug that prevented users from cloning project.
- Fixed bug that prevented users from mapping Jira project with QMetry project.
- Fixed bug that prevented user from mapping Jira field of type “string” with QMetry field.
- Fixed bug that prevented user from accessing Testcase - Automation vs Manual report.
- Fixed bug that prevented user from editing the “executed at” field on execution screen.
- Fixed “Add New Release” API bug that caused the start date to be set same as completion date.
Release Date: 2018-05-19
Summary: New Features & Improvements
New Features
- Collaborate with your team by adding "Comment" on all Test Assets
- Don’t miss any updates on important Test Assets by adding yourself and your team members as "Watcher"
- Create sharable test cases and reduce effort by reusing them in multiple test cases
- Describe granular details by adding attachments to your test steps
- Create/link bugs for failed steps right at the test step level
- Choose to Show/Hide/Resize/Arrange field columns on all module grids to auto save your view preference
- Easily filter test asset by any system/custom fields on all module grids to perform bulk operations
- Add attachments to your test assets by directly pasting them from the clipboard
Improvements
- Creator and Owner will be auto added to watcher list so that they are aware of the updates
- Beautify Test case steps using the Rich Text Editor
- View execution details directly from Test case details
- Test Execution Attachments will now be visible on Test case details - Test Execution tab.
- Easily identify Steps from shared Test cases
- Expand/Collapse all Test cases and Steps in a single click.
- Rich Text/HTML description of imported from Jira to QMetry will be preserved.
- Choose to include/exclude Test Assets from Sub Folders at Parent folder.
- Improved My Profile Page, added option to modify your Jira integration credentials incase those are changed.
- Trace audit trail for comments on Test Assets
- Provided option to view activity log on Execution Screen like Assign Tester, Set Build, Change Execution Time
- Provided option to view Test Execution (Result) logs on execution screen.
- Scheduled Task to include detailed information like Source & Destination Projects, Executor Name.
- Added ability to bulk comments on Test Assets
- Bulk operations will now allow selection of only 1000 assets at time.
Release Date: 2018-05-10
Summary: Improvements & Bug Fixes
Improvements
- While mapping Jira fields with QMetry fields the drop down values are alphabetically sorted.
Bug Fixes
- Fixed bug that prevented bi directional sync of attachments in issues between QMetry and Jira
- Fixed bug that prevented syncing of Issue Owner for issues/stories imported from Jira to QMetry.
Release Date: 2018-05-02
Summary: Improvements & Bug Fixes
Improvements
- Users having project admin rights can now view the license count of the QMetry instance.
Bug Fixes
- Fixed bug that prevented creation of custom fields in a cloned project.
- Fixed bug that prevented the sync of owner and sprint fields of requirements imported from Jira.
- Fixed bug that prevented the sync of custom fields of requirements imported from Jira.
- Fixed bug that prevented user to enter 2 and 4 digit ports in SMTP settings.
- Fixed bug that prevented import of requirements from Jira in a cloned project.
Release Date: 2018-04-20
Summary: New Feature & Improvements
Details
- Link "Test cases from Requirement" while creating a test suite.
- Arrange linked test cases in specific order while creating a test suite.
- Enhanced attachment section to display details like file type, size, date and user.
- Added ability to bulk delete attachments on test assets.
- Added ability to export all test case/Requirements/Issues in a single click. (Removed limitation of 1000 records.)
- Compare test execution for multiple release cycles using the new "Release Cycle" report.
- Easily track test suite execution with development builds.
- Added capability to reuse manual test cases as automated for automation executions on QAF & Cucumber frameworks. Test cases would be reused based on Entity Key or Test case summary.
- Added Execution Type column on the Test Execution Grid.
- QMetry Add-on Improvements:
- Testcase Section - Jira story that is imported in QMetry; now displays linked Test cases details along with steps & attachment in Jira.
- Added option open test case in QMetry from test case details page in Jira.
- Added option to enabled/disabled QMetry panel for Jira projects.
- Integration scheduler now displays details of success/failures during Jira Syncing.
- Dissociation of Jira integration will not delete the already imported issues.
- On logout, existing user session will be notified; if QMetry is logged from another device.
- Email Notification are more detailed and informative.
- Product evaluation registration can only be done only using business email id's.
Release Date: 2018-03-24
Summary: Improvements
Details
- Support for IE11 and Microsoft Edge
- Added refresh button in reports that enables users to view real time data
- Report system exceptions to support team with complete details auto captured
- Improved Password Strength to minimum 8 characters in length with a combination of at least one Uppercase, Lowercase, Number, Special character
- Better control of server resources on cloud, by implementing restrictions on external API calls
1. Max 1000 calls per hour per instance.
2. Max 10000 calls per day per instance.
3. Max 500 Automation API call per day per instance. - Users will get a verification email post registration for an evaluation
- View sync status of Requirements and Issues imported from Jira to QMetry
- LDAP users can login without organization code - For On-premise Installations
- Updated QMetry Test Management License Agreement.
Release Date: 2018-03-10
Summary: New Features
Details
- Ability to Archive / Unarchive platforms. This allows users to get rid of unused platforms without losing data.
- Modify Test Steps and save as new version without changing actual test data
- Intuitive, productivity enhancer Test Execution Screen
- Intuitive, simple UI for maintaining Releases & Cycles
- While creating new customer, mention Organization code of your choice. User will be also asked to verify a Captcha as enhanced security.
- Modify test case execution time stamp at each test case level
- Automated Data retention and cleanup for bulky audit and change logs
- Test Case/Steps to get copied in defect while logging a defect from test execution screen
- Intuitive, friendly JIRA Integration configuration screens
- Choose build number while test execution
- Ability to export Test Executions as Excel/CSV file
- Ability to Perform bulk operations as background job without impacting normal operations.
- Bulk operations can be performed on Test Cases or Requirements or Issues
- Bulk edit, copy, move, delete, archive, unarchive within or Across projects
- Intuitive and flexible UI with ability to filter and choose.
- Bulk link Requirements with Test cases, Issues
- Bulk link Test suites with Platforms, Test cases
- Bulk link Test cases with Requirements
- Bulk edit specific versions of Requirements and Test cases
- Bulk link attachment to any entity.
- Associate Releases and Cycles to Requirements, Test cases & Test suites in Bulk.