Temporary service disruption: QMetry Test Management Cloud on 5th Feb, 2024

Temporary service disruption: We are experiencing an unplanned outage of the QMetry Test Management - Cloud, which began on February 5th, 2024 06.35 AM PST to 07.05 AM PST. This outage caused the QMetry application to be unresponsive and inaccessible to users.

All events regarding this downtime are updated on this page.

Day

Time (PST)

Event Details

Day

Time (PST)

Event Details

5th Feb

07:05 am

  • QMetry services are restored. Root cause analysis and Preventive Actions applicable will be shared soon.

5th Feb

06:35 am

  • QMetry Test Management became unresponsive - Users are experiencing extreme slowness when accessing the QMetry application hosted on the cloud. They are currently unable to log in or perform any actions within the application.

  • QMetry Teams are working on high priority to restore the services back to normal. Based on the initial analysis, QMetry services should be restored soon.

Root Cause Analysis

During our investigation, it was identified that the MyDashboard system report query was causing an excessive utilization of the database CPU, resulting in decreased performance and outage.

Preventive Actions

To address this issue, an essential indexing has been added on relevant database tables that constitute the system My Dashboard report queries. This optimization significantly reduces the query's resource consumption, thereby preventing such issues in the future.