Create a Data-Driven Test Case

Last modified: November 19, 2024

Introduction

This how-to explains data-driven testing, a functionality of ATS. With data-driven testing, you can run the same test case with different data sheets without manually entering the new information in the case. ATS executes a test case for each record in the primary dataset.

This how-to teaches you how to do the following:

  • Create a primary dataset with different datasheets in ATS
  • Create an Excel file to upload in ATS
  • Create a primary dataset using an Excel file
  • Use the primary dataset in a test case
  • Understand the result log of a data-driven test case

This how-to uses the Company Expenses app as an example. In the how-to, you will create data for the following fields in the Company Expenses app:

  • Amount
  • Date
  • Type
  • Description

An example test case is used to illustrate how to connect the dataset to a test case.

Prerequisites

Before starting with this how-to, make sure you have the following prerequisites in place:

Creating a Primary Data Set within ATS

The following steps explain how to create a primary dataset within ATS. If you want to create a primary dataset from an Excel file, please see chapter four.

  1. Open your app in ATS and go to the Test Cases menu item.

  2. Click the Test Data tab.

  3. Click New Data Set

    When you click the New Data Set, the New Data Set dialog box opens.

  4. Enter a name for your dataset in the Name field. Remember that you must find the dataset later, so give it a unique and corresponding name.

  5. Enter a description for your dataset in the Description field. Providing a clear description of what data is found inside is advisable.

  6. Click Save.

Creating Data Set Fields

The following steps explain how to add dataset fields to your primary dataset.

  1. Click the name of the dataset.

  2. Click New Field.

  3. When you click New Field, the New Field dialog box opens. Enter Amount in the name field. This field represents the expense amount in the Company Expenses app. By using the exact label from the Mendix app, it becomes easier to connect the fields from your dataset to the right action.

  4. The amount in the Company Expenses app can only be a number. Select Number as the datatype.

  5. Click Save

Repeat steps 1 to 5 for these fields in the Company Expenses app:

  • Date
  • Type
  • Description

The result will look comparable to the image below:

Next, you create a record for the dataset fields.

Creating Records

To create a record for your dataset fields, follow these steps:

  1. Click the Records tab.

  2. Click New Record:

    The New Record dialog box opens:

  3. Enter the desired values for each field and click Save:

Repeat step 2 and step 3 as many times as you want. In our example, we create a record for each expense type:

  • Accommodation
  • Meal
  • Other
  • Supplies
  • Transport

The records look like this:

You can also update your records from Excel. For details on how to do this, see Creating a Primary Data Set with Excel.

Creating the Excel File

The following steps explain how to create the right Excel file and how it should look. You will need this file in Creating a Primary Data Set with Excel.

  1. Open Excel and create a new file. ATS implements the values in the first row as dataset fields and all the rows beyond the first row as records. This is an example:

  2. Create the dataset fields you need:

    • Amount
    • Date
    • Type
    • Description

  3. Now you must add records. Create a record for each expense type available, five in total:

    • Accommodation
    • Meal
    • Other
    • Supplies
    • Transport

  4. Save the Excel file so that you can use it in the next section.

Creating a Primary Data Set with Excel

The following steps explain how to create and update a primary dataset from an Excel file. You will use the file you created in 4 Creating the Excel File.

  1. Open your app in ATS and go to the Test Cases menu item.

  2. Click the Test Data tab.

  3. Click New Data Set.

    When you click the New Data Set, the New Data Set dialog box opens.

  4. Enter a name for your dataset in the Name field. Remember that you must find the dataset later, so giving it a unique and corresponding name is advisable.

  5. Enter a description for your dataset in the Description field. Providing a clear description of what data is found inside is advisable.

  6. Check the Create/Update fields from file box.

  7. Select the Excel file you created in 4 Creating the Excel File.

  8. Click Save.

Now you have a new primary dataset using an Excel file.

Updating the Primary Data Set Using an Excel File

To update a primary dataset using an Excel file, follow these steps:

  1. Click the name of the dataset.

  2. Click the Records tab.

  3. Click Export to Excel:

    You now download an Excel file containing the dataset.

  4. Save the file to your local computer so that you can make changes.

  5. Change the description of all records to “ATS excel description 1” etc.

  6. Click Import from Excel inside the Records tab:

    This will open the Import records dialog box.

  7. Select the file you altered in steps 4–5.

  8. Click Import.

ATS updates the changed records:

Great! You have updated the primary dataset using an Excel file.

Connecting the Primary Data Set to Your Test Case

The following steps explain how to connect the primary dataset to your test case. An example test case is used in this chapter. For more information, see How to Create a Test Case.

  1. Open your test case and click the Test Data tab.

  2. Click the arrow icon:

    The Select Data Set dialog box opens.

  3. Search for the primary dataset.

  4. Select the dataset.

  5. Click Save.

    Connect the primary dataset to your test case.

  6. Now you need to connect the dataset fields to the right test steps, so click the Test Steps tab.

  7. Select the test step to which you want to connect a dataset field.

  8. Search for and select the first dataset field:

Repeat this process for all the dataset fields you want to connect.

Data-Driven Results

The following steps explain how to read and understand the results of a data-driven test case. An example is used in which the data-driven test case is already run.

  1. Open your app and click the Test Runs menu item.

  2. Click the result of the data-driven test case.

    This opens the Result Log page, where ATS displays the result of each run record.

  3. Click one of the results:

  4. To see the record used by this execution, click the Data Records tab:

    This displays all the values in the record:

    You can use the breadcrumbs to return to the overview Result Log:

Conclusion

You now know how to do the following:

  • Create a primary dataset within ATS
  • Create an Excel file to upload in ATS
  • Create a primary dataset using an Excel file
  • Update a primary dataset using an Excel file
  • Connect the primary dataset to your test case
  • Analyze the result of a data-driven test case

Next Up

You now learned how to create a dataset and how to use that data in your test case. The next how-to is How to Use Precondition in Test Cases. You find an overview of all the how-tos and the structure on the ATS 2 How-Tos page. We advise you to follow the predefined structure.