Generate Test Cases from Story Page or Test Case Module

Introduction

The Generate Test Cases and Test Steps using QI feature allows testers to auto-generate functional test cases using QMetry Intelligence (QI) directly from the Story Page or the Test Case Module. Furthermore, testers can utilize QI to generate the test case description, pre-condition, and test steps in an existing test case, with options to either update the existing version or create a new version.

This document describes the Generate Test Cases from Story Page or Test Case Module feature.

→ Prerequisite: The Enable users to generate test cases either from the Story Page or from the Test Case Module settings should be enabled under Apps > Manage your apps > QI Configuration as described in the article Auto-Generate Test Cases and Test Steps using QMetry Intelligence (QI) | QMetry Intelligence Configuration.

→ Enable users to generate test cases from either the Story Page or Test Case Module. (Default: Disabled)

Settings

Description

Enabled

Users can generate test cases from the Test Case list view and from the Story detail page using the AI-enabled feature.

Disabled

Users can not access the AI-enabled test case creation feature to generate test cases from the Test Case list view and from the Story detail page.

Once you configure the required settings for QI, you can see the Generate test cases with QI button on the Test Case list view and on the Story detail page.

Notes:

  • If test cases have been generated from a Story, that Story will be linked to all the test cases. All these test cases will be associated with the Story and will be displayed under the Test Case/Acceptance section.

  • If the test cases have been generated using the requirement description on the fly, that requirement description will not be associated with the test cases as a Story.

  • The test cases are generated at the root level in the Test Case module by default unless the Folder Path is defined in the Detail tab while generating the test cases.

  • To produce high-quality test cases, the requirement description should consist of a minimum of 30 words and a maximum of 1500 words.

Guidelines for Story Description

To create effective test cases, some guidelines should be considered while drafting the Story description.

  • Description Details: The Story should have sufficient description details to let the QI analyze the requirements, identify the critical scenarios, and generate test cases out of it. You can modify the Story description to ensure the maximum requirement coverage by test cases.

  • Structured Format: The Story should include a clear and well-structured explanation of the feature.

  • Acceptance Criteria: The Story description should cover the acceptance criteria to define the feature’s expected behavior. The decomposed stories give better results.

  • Description Length: The description should be between 30 to 1500 words.

You can generate test cases from the Test Case List View as well as from the Story detail page.

Generate Test Cases from Test Case List View

The AI model utilizes the Summary and Description of the Story to generate the corresponding test cases. If the story does not have sufficient description details to generate a test case, a notification message will pop up.

Based on the Story details, the AI models decide to create single or multiple test cases. The test cases are created with Summary, Description, Precondition, and Steps.
Each auto-generated test case includes the step details as follows.

  • Step Summary and Expected Outcome.

  • Test Data will be generated if the sample data or input data are part of the Story description.

Follow the steps mentioned below to generate test cases from the Test Case module.

Steps

1. Go to the Test Case module.

2. Click on the Generate test cases with QI button at the top.

image-20240810-084551.png

You can create test cases (A) from an existing Story or (B) by entering the Description for the requirement.

(A) Create Test Cases from an Existing Story

If you want to create test cases from an existing story, follow the steps mentioned below.

1. Open the Select Story tab.

The screen displays entities as per the configuration done for the Story issue type for the project under Project Settings > QMetry Project Settings > Issue Type > Story.

You can select the Story of the cross-projects to generate test cases.

You can also apply filters on Issue Type, Priority, and Status to narrow down the entity search.

2. Select a Story on the screen from which you want to generate probable test cases.

3. Click on the Generate Test Case button at the bottom.

image-20240214-061532.png

It opens the Generate Test Cases and Test Steps with QI screen, which also shows the Story ID and Summary at the top to make it easy to identify the Story from which the test cases are being generated.

The screen shows the list of QI-generated test cases on the panel at the left. The panel displays the count of test cases created.

The Steps and other details related to the test case are displayed on the screen at the right.

The requirement from which the test cases are being generated is shown at the top. You can expand the section to view more details of the requirement description.

You can add/edit details for the test cases.

Please review the test case before utilizing it. Modify or reject test cases as necessary. The generated test case will be auto-linked to the story. Further modifications can be made after the test cases are created.

 

Steps Tab

The Steps tab displays the Test Case Description, Precondition, and Step details.

The following is an expanded view of the Steps tab.

You can reject or accept the generated test cases individually. You can manually make edits in the test cases and step details before the acceptance.

You can clone an existing step and can also delete the step. You can access the options by clicking on the ellipsis (…) icon for the step.

Detail Tab

The Detail tab displays system fields and custom fields. You can fill in all the required fields for the test case.

  • Folder Path: The test cases are generated within the "QI Generated" system folder by default. To create a test case in a different folder, specify the folder path in this field. If left empty, the test case will be created at the root level in the Test Case module.

Copy fields to all generated test cases: If you want to copy the entered field values to all other generated test cases, click on this button at the top. The entered details for the current test case will be copied to all test cases at once. You do not have to enter the details in all the generated test cases one by one.

Test Case Approval

You can reject or accept the generated test cases individually.

There are two buttons for approval.

  • Accept: All the generated test cases are accepted by default. If you want to accept a declined test case, select the test case and click on the Accept button.

  • Decline: Click on the Decline button to disapprove the test case. This test case will be omitted when you generate the test cases. If you decline any of the test cases, it is prefixed with the mark.

Navigation

You can click on the test case at the left to view its details at the right. You can also use the arrow buttons to move to the previous or next test cases.

Generate Test Cases

You can only generate test cases out of the Accepted test cases.

Once you are done with adding or updating test case details for all the test cases and approval of the test cases, click on the Generate Test Cases button to generate test cases.

The test case generation process is initiated. You can see the progress on the screen at left.

The test cases are created at the root level in the Test Case module by default. If you want to create the test cases in a particular folder, select the Folder Path in the Detail tab while generating the test cases.

The test cases are generated and linked to the Story.

All the generated test cases have the Story linked to them.

(B) Create Test Cases from Requirement Description

If you want to create test cases from the Description of Requirement, follow the steps mentioned below.

If the test cases have been generated using the requirement description on the fly, that requirement description will not be associated with the test cases as a Story.

1. Open the Enter Description tab.

The screen displays a text box to enter the description.

2. Enter the description for the requirement in the text box.

Note: The description of requirements will be utilized to generate test cases. To produce high-quality test cases, the requirement description should consist of a minimum of 30 words and a maximum of 1500 words.

3. Click on the Generate Test Case button at the bottom.

Once you click on the Generate Test Case button either following the option (A) or (B), the next screen titled Generate Test Case Details and Test Steps with QI opens.

The screen shows the list of QI-generated test cases on the panel at the left.

The Steps and other details related to the test case are displayed on the screen at the right.

You can add/edit details for the test cases.

Steps Tab

The Steps tab displays the Test Case Description, Precondition, and Step details.

Detail Tab

The Detail tab displays system fields and custom fields. You can fill in all the required fields for the test case.

  • Folder Path: If you want to create the test case in a specific folder, select the folder path in this field. Otherwise, the test cases will be generated at the root level in the Test Case module by default.

Copy fields to all generated test cases: If you want to copy the entered field values to all other generated test cases, click on this button at the top. The entered details for the current test case will be copied to all test cases at once. You do not have to enter the details in all the generated test cases one by one.

Test Case Approval

There are two buttons for approval.

  • Accept: All the generated test cases are accepted by default. If you want to accept a declined test case, select the test case and click on the Accept button.

  • Decline: Click on the Decline button to disapprove the test case. This test case will be omitted when you generate the test cases. If you decline any of the test cases, it is prefixed with the mark.

Navigation

You can click on the test case at the left to view its details at the right. You can also use the arrow buttons to move to the previous/next test cases.

Generate Test Cases

You can only generate test cases out of the Accepted test cases.

Once you are done with adding/updating test case details for all the test cases and approval of the test cases, click on the Generate Test Cases button to generate test cases.

The test cases are created at the root level in the Test Case module by default.

If test cases have been generated from a Story, that Story will be linked to all the test cases.

Generate Test Cases from Story Detail Page

You can generate probable test cases from the Story detail page using the AI-powered feature.

Steps to generate test cases with QI

1. Click on the Generate test cases with QI button under the Test Case/Acceptance Criteria section on the Story detail page.

→ If the Story does not have any test cases linked to it, the Generate Test Cases with QI button appears in the center of the page under the Test Case/Acceptance Criteria section.

→ If the Story has test cases already linked to it, the Generate Test Cases with QI button appears above the list of linked test cases under the Test Case/Acceptance Criteria section.

It opens the Generate Test Cases and Test Steps with QI screen, which also shows the Story ID and Summary at the top to make it easy to identify the Story from which the test cases are being generated.

The screen shows the list of QI-generated test cases on the panel at the left. The panel displays the count of test cases created.

The Steps and other details related to the test case are displayed on the screen at the right.

The Story from which the test cases are being generated is shown at the top. You can expand the section to view more details of the Story description.

You can add/edit details for the test cases.

Steps Tab

The Steps tab displays the Test Case Description, Precondition, and Step details.

The Test Data column for steps remains hidden by default. If you want to reveal the column, access the Hide/Show/Re-arrange Columns menu and opt to display the Test Data column on the screen.

Detail Tab

The Detail tab displays system fields and custom fields. You can fill in all the required fields for the test case.

  • Folder Path: If you want to create the test case in a specific folder, select the folder path in this field. Otherwise, the test cases will be generated at the root level in the Test Case module by default.

Copy fields to all generated test cases: If you want to copy the entered field values to all other generated test cases, click on this button at the top. The entered details for the current test case will be copied to all test cases at once. You do not have to enter the details in all the generated test cases one by one.

Test Case Approval

There are two buttons for approval.

  • Accept: All the generated test cases are accepted by default. If you want to accept a declined test case, select the test case and click on the Accept button.

  • Decline: Click on the Decline button to disapprove the test case. This test case will be omitted when you generate the test cases.

If you decline any of the test cases, it is prefixed with the mark.

Navigation

You can click on the test case at the left to view its details at the right. You can also use the arrow buttons to move to the previous/next test cases.

Generate Test Cases

You can only generate test cases out of the Accepted test cases.

Once you are done with adding/updating test case details for all the test cases and approval of the test cases, click on the Generate Test Cases button to generate test cases.

The test case generation process is initiated.

You can see the progress on the screen at left.

The test cases are created at the root level in the Test Case module by default.

The test cases are generated and linked to the Story.

All the generated test cases have the Story linked to them.

View Statistics

The QQBot displays the following statistics of Test Cases Created Using QI and Test Cases Updated/Versioned Using QI.

  • Total Test Cases created in current session

  • Total Test Cases created or updated the logged-in user using QI across all projects

  • Total Test Cases created or updated the by all users using QI across all projects

  • Approximate Time Saving (in hours): Approximate Time Savings are estimated based on the assumption that it takes about 30 minutes to create a test case of medium complexity.

The test cases are placed within the “QI Generated” folder, which is automatically generated by the system. If you want to place the test case in a different folder, specify the folder path in the Detail tab during test case generation. If this field is left empty, the test case will be created at the root level in the Test Case module.

Provide Your Quick Feedback

You can provide a quick feedback on test case details or steps generated through QMetry Intelligence. If you find inaccuracies, omissions, or areas for improvement, you can give feedback directly in the QMetry Intelligence interface. The feedback and information will be used for improving the feature.

Thumbs Up

You can select either of the following options to indicate what you like:

  • Contextually Aligned Details & Steps

  • Comprehensive Coverage

  • Clear, Logical & Detailed Steps

  • Consistent Terminology & Formatting

  • Accurate & Relevant Steps

  • Others

→ Others: You can enter your feedback by entering text up to 2000 characters in the box.

Thumbs Down

You can select either of the following options to indicate which you expect improvements:

  • Contextual Errors & Incorrect Steps

  • Incomplete Coverage

  • Insufficient Detail & Lack Clarity

  • Poorly Structured Steps

  • Redundant or Irrelevant Steps

  • Others

→ Others: You can enter your feedback by entering text up to 2000 characters in the box.

You can also select the following check boxes to report a specific issue.

  • The Test Case Summary and Description aren’t accurate enough.

  • The Test Case Steps and Pre-conditions aren’t accurate enough.

Known Limitations

  • The model will not process the images, videos, attachments, tabular content, code blocks, certain ASCII characters, or hyperlinks while generating test cases.

  • The model may occasionally generate repeated test steps or incorrect details. Therefore, it is advisable to always review the generated test cases before incorporating them into actual usage.

  • Test Data for Test Case Steps is not generated.

  • The number of test cases generated depends on the AI model and may vary each time.

  • The model will not process descriptions with more than 1500 words. If the description is lengthy, not all the test cases may be covered during generation.