Generating test case and test suite execution records automatically

Use test case execution records and test suite execution records to specify the execution environments for each test case and test suite and to track the status of each test run. A wizard is provided for generating test case execution records and test suite execution records automatically.

Before you begin

Before you can generate test case execution records or test suite execution records, you must have created at least one test case or one test suite.

Procedure

To generate test case execution records or test suite execution records automatically:

  1. Do one of the following:
    • From an open test case, select Test Case Execution Records.
    • From an open test suite, select Test Suite Execution Records.
  2. Click the Generate New Test Case Execution Records or Generate New Test Suite Execution Records icon (Generate new test execution record).

    This starts the wizard to generate test case execution records or test suite execution records. After the wizard starts, you can cancel by clicking the X in the upper right corner.

  3. Select a Test Plan and Test Iteration from the lists.

    Test iterations are the various phases or iterations in your test plan. Test iterations are only available when you select a particular test plan.

  4. Optional: Select an Owner for the test case or test suite execution records.
    Note: You can choose to have an owner automatically assigned when the execution record is executed by setting the Automatically assign executer as owner to Test Case and Test Suite execution record if owner is not assigned execution preference. For information on how to set the preference, see Test execution preferences.
  5. Optional: Select a Channel for the test case or test suite execution records. Choosing a channel guides test environment selection by restricting options for test environment reuse and suggesting attributes for test environment generation.
  6. If you have previously defined your test environments, click Reuse Existing Test Environments, select the test environments to reuse, and click Next.
  7. If you have not previously defined your test environments, click Generate Test Environments.
    1. Select one or several environment attributes from each column.

      The number of test case execution records or test suite execution records created depends on the number of attributes selected, the level of coverage that you choose, and the Advanced Properties (Inclusions, Exclusions, and Weightings) that you select.

      Note: Advanced Properties may not be visible until you select at least two attributes from one of the columns of attributes.
    2. In the Generation Properties section, select the level of coverage that you want.

      Use this setting and the Advanced Properties setting to fine-tune the test case execution records or test suite execution records that will be generated.

      • Choose Minimal to ensure that each selected attribute is covered at least once, with no attempt to cover specific combinations of attributes. For example, if you select one attribute from three columns, three test case execution records or test suite execution records are created, ensuring that each selected attribute is covered at least once.
      • Choose Medium - pair-wise interaction to ensure that each combination of paired attributes is covered at least once.
      • Choose Large - three-way interaction to ensure that each three-way combination of attributes is covered at least once.
      • Choose All - all permutations to ensure that all combinations of attributes are covered at least once.
      Note: The coverage options only become available when you start selecting attributes. The greater the selected coverage, the more attributes and columns that you must select.
    3. Click Advanced Properties to display a window with three tabs: Inclusions, Exclusions, and Weightings.
      • Click Exclusions to specify the attribute combinations to explicitly exclude.
      • Click Inclusions to specify the attribute combinations to always include.
      • Click Weightings to set the weight or importance of each attribute relative to the other values for that attribute.
    4. Click Next.

      The wizard creates a preview of the Generated Test Environments from which the test case execution records or test suite execution records will be generated.

  8. Optional: Select the test environments that you plan to commit to and click Next. If the Project Properties, Execution Record Preferences are set to allow changes for this record type, the test environment can be updated later. If this preference is not selected, the test environment can only be set when the execution record is created.
    The wizard creates a preview of the generated test case execution records or test suite execution records.
    Tip: You can create unique names for each test case execution record or test suite execution record by selecting the To make the new test environment names unique, add a prefix to the generated name option.
  9. Select the test case execution records or test suite execution records that you want to keep.
  10. Optionally, decide how you want to group the generated test case execution records or test suite execution records by selecting one of the choices in the Group By list.
  11. Click Finish.

    The wizard generates the test case execution records or test suite execution records according to the criteria you have selected.

  12. Click Save to add the test case execution records or test suite execution records to the test case or test suite.

Results

After the test case execution records or test suite execution records are generated, you can select one and run it.

Test Case Execution Records - Examples

The following table shows four different sets of settings for generating test case execution records. In row 2, the Coverage is changed from Minimal to Medium. In row 3, three more modifications are made, and in row 4, only one more modification is made. Each change results in an increase in the number of test case execution records that are created.

Table 1. Examples of test case execution records
Example Browsers selected CPUs selected OS selected Coverage Inclusions & Exclusions Weighting Result (TERs created)
1 Firefox, IE Intel i386, PowerPC® Windows, SUSE Minimal None Priority to Firefox, Intel, & Windows 2
2       Medium     4
3 Firefox, IE, Safari   Windows, SUSE, Mac OS X     Safari and Mac OS X priority 3. 9
4       Large     18

video icon Video

Jazz.net channel
Software Education channel

learn icon Courses

IoT Academy
Skills Gateway

ask icon Community

Jazz.net
Jazz.net forums
Jazz.net library

support icon Support

IBM Support Community
Deployment wiki