| Table of Contents |
|---|
...
The following table shows the execution results of the test cases executed multiple times.
Test Case Name | Test 1 | Test 2 | Test 3 | Test 4 | Test 5 | Test 6 | Test 7 | Test 8 | Flaky or Non-flaky? |
|---|---|---|---|---|---|---|---|---|---|
Test Case A | Pass | Pass | Pass | Pass | Pass | Pass | Pass | Pass | Non-flaky |
Test Case B | Fail | Fail | Fail | Fail | Fail | Fail | Fail | Fail | Non-flaky |
Test Case C | Pass | Pass | Fail | Fail | Pass | Fail | Pass | Fail | Flaky |
Use Cases:
QA Managers/Testers get to view the risk probability associated with the test cases under test.
The flaky score on the execution screen shows the tester the probability of risk while executing the test case.
| Info |
|---|
Flaky Score is calculated only for the executed test cases and is determined based on the latest X number of executions. The Flaky Score ranges between 0 (Not Flaky) and 1 (Flaky). |
Required Permissions:
Users should have the following QMetry Intelligence permissions to configure and generate Flaky Score:
...
Users can then opt to show/hide the Flaky Score column on the test case list view, test cycle > test cases tab, test execution screen, and Test Case/Acceptance Criteria section on the Jira story page. The Flaky Score is also displayed on the test case detail page.
...
The following table interprets the intensity of the flaky score in accordance with its derived calculation and color code.
Flaky Score | Intensity of Flakiness |
|---|---|
 | High |
 | Medium |
 | Low |
View Flaky Score on Test Case List View
...
Click on the Flaky Score to view the traceability report for the test case, which show shows the test case is associated with which requirements, test cycles, defects, and execution results. The report helps you analyze the Flaky Score further.
...