Data driven testing

Run test against multiple scenarios

The data driven testing feature allows you to run a single test against multiple scenarios using different test data combinations. This is achieved by creating and utilizing test datasets.

Examples:

1. Testing a login form with various usernames and passwords to verify authentication.
2. Testing a search feature with diverse keywords to validate results and handling of invalid inputs.
3. Testing a registration form with varying user inputs to ensure data validation and acceptance criteria.
4. Testing a shopping cart with different product combinations and quantities to assess calculations and error handling.
5. Testing a checkout process with diverse payment methods and shipping addresses to verify functionality and edge cases.

Creating Test Dataset

Upload a CSV file:

• Click on “Test Data” option from the desktop app or web page
• Click on “Upload a CSV file” button
• Select a CSV file containing your test dataset
• Ensure the file meets the following requirements:
  1. CSV format
  2. Consistent number of columns in each row
  3. Values not exceeding 1000 characters
  4. Maximum of 100 rows and 40 columns
  5. At least one row of data in addition to the header row
• Give the dataset a unique name

Validate Dataset

• Once the csv file is uploaded and dataset is created successfully, you can verify the data by looking at the data table

Optionally map a scenario name column:

• Once a test dataset is created successfully, you can map any column from the dataset as scenario column
• It is used in build report and other places as a label to represent the particular row

Using Test Dataset in Tests

You can import any column from dataset similar to how you import variables

1. Within a test, navigate to the step details
2. Click on “+” button and choose “Import a value from test data”
3. Select/Link any dataset from the list. If you do not have any dataset created, you can create a new test dataset from here also by uploading a csv file
4. Choose the column you want to use from all the columns in the test dataset that you chose in previous step

Test Execution with Test Dataset

Local execution:

• Local replay automatically uses the first row (excluding the header) from the dataset.

Cloud execution:

• Run the test against each row of data in the test dataset
• Build reports list each execution individually
• Multiple executions of a test are grouped in the report. Observe the highlighted text which represents the scenario column data earlier mapped corresponding to the test
• Each execution is counted towards test execution usage for billing purposes