Introduction

QTM4J has introduced an AI-powered, innovative approach to assess the flakiness of test cases by calculating a "Flaky Score" derived from their execution history; this insightful feature empowers testers an ability to identify test cases whose future execution status is non-deterministic. A flaky test case refers to one that exhibits non-deterministic behavior when executed repeatedly within the same code and environment, resulting in intermittent successes and failures. The crucial first step towards gaining control over flaky tests is identifying them. Flaky tests have the potential to slow down testing pipelines and erode confidence in testing processes. Today determining test case flakiness requires a manual comparison of test results from multiple runs, which is time-consuming. However, with QMetry Intelligence, this process is now automated, saving valuable time and effort for testers and developers.

QA Managers can define and configure settings according to their specific testing processes for calculating the flaky score, ensuring its relevance to their testing methodologies.

For Example,

The following table shows the execution results of the test cases executed multiple times.

Use Cases:

• QA Managers/Testers get to view the risk probability associated with the test cases under test.

• The flaky score on the execution screen shows the tester the probability of risk while executing the test case.