Data driven testing

Run test against multiple scenarios

The data driven testing feature allows you to run a single test against multiple scenarios using different test data combinations. This is achieved by creating and utilizing test datasets.

Examples:

1. Testing a login form with various usernames and passwords to verify authentication.
2. Testing a search feature with diverse keywords to validate results and handling of invalid inputs.
3. Testing a registration form with varying user inputs to ensure data validation and acceptance criteria.
4. Testing a shopping cart with different product combinations and quantities to assess calculations and error handling.
5. Testing a checkout process with diverse payment methods and shipping addresses to verify functionality and edge cases.

Create Test Dataset

Upload a CSV file:

1. Click Test dataset from the desktop app or web page.
2. Click Add Test Dataset to upload a csv file.
3. Select a CSV file containing your test dataset.
4. Ensure the file meets the following requirements:
   • CSV format
   • Consistent number of columns in each row
   • Values not exceeding 1000 characters
   • Maximum of 100 rows and 40 columns
   • At least one row of data in addition to the header row
5. Give the dataset a unique name.

Validate Dataset

Once the csv file is uploaded and dataset is created successfully, you can verify the data by looking at the data table.

Optionally map a scenario name column:

• Once a test dataset is created successfully, you can map any column from the dataset as scenario column
• It is used in build report and other places as a label to represent the particular row

Using Test Dataset in Tests

You can import any column from the dataset, similar to importing variables.

1. Within a test, navigate to the step details.
2. Click the + button and choose Import a value from test data.
3. Select or link a dataset from the list. If you do not have any dataset created, you can create a new test dataset here by uploading a CSV file.
4. Choose the column you want to use from all the columns in the test dataset that you chose in previous step.

Test Execution with Test Dataset

Local execution:

Local replay automatically uses the first row (excluding the header) from the dataset.

Cloud execution:

• Run the test against each row of data in the test dataset.
• Build reports list each execution individually.
• Multiple executions of a test are grouped in the report. Observe the highlighted text, which represents the scenario column data previously mapped to the test.
• Each execution is counted towards test execution usage for billing purposes.