Rolling up results for test suite execution records

You can create a consolidated result of multiple executions of the same test suite execution record by using the roll-up operation. The new rolled-up result is formed by merging previous results of the same test suite execution record.

About this task

You can combine the previous results of a test suite execution record and create a new result.

Consider a test suite that has four test cases associated with it. When you run the test suite, two test cases fail and two test cases pass. The overall result of the test suite is failed. You can rerun the same test suite and skip the test cases that already passed. In the second execution, the remaining two test cases pass and the overall result of the second execution is passed. You can now combine the two sets of results and create a new result by using the Roll Up option, which then becomes the current result of the test suite. The rolled-up result contains verdicts from the most recent execution result. If the verdict is missing or deferred for some steps, the previous result is used as the verdict for that step.

If the results that participate in the roll-up operation are associated with the same build record, the rolled-up result is also associated with the same build record.

Note:
  • In progress results are not included in the roll-up operation. You must either complete or cancel the execution to include the result in the roll-up operation.
  • If any two steps in the test suite have the same test case and test script, you receive an error message and the roll-up operation is not performed.

Procedure

  1. In the Test Suite Execution Records section of a test suite, click the Run icon (Run) to run an existing test suite execution record or create a test suite execution record.
  2. In the test suite execution console, execute the test cases and provide the verdict for the steps as passed or failed.
  3. Rerun the test suite execution record.
  4. On the Run Test Suite page, click the Exclude Passed from Execution (Exclude Passed Test Cases) to exclude the test cases or steps that passed in the previous run.
  5. In the test suite execution console, execute the remaining test cases and provide the verdict as passed.
  6. In the Test Suite Execution Records section of a test suite, click the Action Menu icon (Expand/Collapse).
  7. Select Roll Up Test Suite Results and then click Roll Up.
  8. Click OK.

    A new result is created. You can view the result details by clicking the result in the Last Result column. The start time of the result is taken from the first execution and the end time of the result is taken from the latest execution of the test suite.

  9. Optional: If a new test case is added to a test suite, you can rerun the test suite execution record and skip the execution of previous test suite. On the Run Test Suite page, select the test cases that are already executed and then click the Exclude from Execution icon (Exclude Execution). Provide the verdict for the steps and complete the execution.
  10. Optional: Click the Action Menu icon (Expand/Collapse). Select Roll Up Test Suite Results and then click Roll Up with Options. On the Select test suite results to roll up page, select the test suite results that you want to use for the roll-up operation. Click OK.

    You can view the details of the newly created result in the Result Details section of a test suite execution record.

  11. Optional: You can click the Change column display settings icon (Change display settings) and add the Last Rolled-Up Result column in the test suite execution record table view. You can view the status of the last rolled-up result.

video icon Video

Jazz.net channel
Software Education channel

learn icon Courses

IoT Academy
Skills Gateway

ask icon Community

Jazz.net
Jazz.net forums
Jazz.net library

support icon Support

IBM Support Community
Deployment wiki