Quality management predefined reports

The Quality Management application includes a number of predefined reports that you can use to analyze your test runs and identify trends in your project. The predefined reports are organized into reporting categories, such as defect reports, requirements reports, and test case reports.

You run the reports directly in the Quality Management application interface.

Each report has a Parameters section, listing the criteria that you can use to run that report. If you use the same report and parameters repeatedly, you can make a copy of the report and save the parameters for easy access. Many of the reports are interactive and allow you to expand upon the information that is presented in the report. You can click on links, bar graphs, and pie charts to see additional details.

You can add new report resources to the list of deployed report resources in a project or team area, see Deploying new report resources.

Important: After an administrator enables configuration management, project data is sent only to Lifecycle Query Engine (LQE) data sources. Business Intelligence and Reporting Tools (BIRT) reports, IBM® Cognos® reports, and historical data reports that use an Engineering Lifecycle Management or an external data warehouse as a data source will not work and are not shown on the Reports menu.
You can report on configuration-enabled projects in these ways:
  • Report Builder: Choose an LQE-based data source, create reports, and export them to spreadsheets, IBM Engineering Lifecycle Optimization - Publishing, Microsoft Word, PDF documents, and HTML files. You can export graphs to image files or documents. For details, see Authoring reports with Report Builder.
  • Template-based reporting in ELM applications: Generate simple, document-style reports.
  • Engineering Publishing: Create document-style reports that include a cover page, table of contents, and copyright statement. For details, see Authoring document-style reports.

Dashboard versions of reports

Some of the reports have dashboard versions that are optimized for displaying on dashboards when the screen size is limited. These micro reports are substituted for the parent reports when you add the report widget from the Quality Management category to your dashboard.

Interactive reports

An interactive report includes graphical elements that you can click to reveal additional data. For example, if you click the Passed bar in a bar chart, a list is displayed of all TCERs for which the last execution result is "Passed."

Product integrations and report data

The default reports that come with IBM Engineering Test Management are BIRT-based reports. BIRT reports can be either "live" or "data warehouse" reports. Live reports use only data from Engineering Test Management, so product integrations do not affect the reports. Data warehouse reports show data that is in the data warehouse that Engineering Test Management uses. If the data from other applications, such as work items from the Change and Configuration Management (CCM) application, is in the same data warehouse, the data is available for reporting. Therefore, the functionality and accuracy of reports and widgets that depend on product integration data are affected if the data is not in the data warehouse.

For example, information from Rational ClearQuest is not supported when using the Java ETL; however, it is supported when using the Data Manager ETL. The Jazz Reporting Service data collection component (DCC) also supports Rational ClearQuest information. If the Engineering Test Management information was populated into the data warehouse by using the Data Manager or DCC, and Rational ClearQuest information was also being collected using ETLs to the data warehouse, the reports related to work items will show that data.

For more information about which service providers or integrations affect data warehouse micro reports, see the report descriptions in the following table. For more information about products that integrate with Engineering Test Management, see Integrations with Engineering Test Management on Jazz.net.

Name Type RQM 2.x RQM 4.x RQM 5.x Dashboard version (micro report) Interactive Description
Defect list Defects Live Data warehouse Data warehouse No Yes See Defect reports.
Defects arrival and resolution Defects Data warehouse Data warehouse Data warehouse Yes No Supports defects from an OSLC CCM service provider. See Defects reports.
Execution Status by Test Suite using TSER Count (Live) Execution NA Live Live No Yes See Execution reports.
Execution Status by Test Suite using Weight (Live) Execution NA Live Live No Yes See Execution reports.
Execution Status using Weight (Live) Execution Live Live Live Yes Yes See Execution reports.
Execution Trend Execution Data warehouse Data warehouse Data warehouse Yes No See Execution reports.
Execution Status by Owner using TER Count (Live) Execution Live Live Live Yes Yes See Execution reports.
*Execution Status by Machine using TER Count (Live) Execution Live Live Deprecated Yes Yes See Execution reports.
Execution Status by Milestones using TCER Count (Live) Execution NA Live Live Yes Yes Execution reports
Execution Status by Milestones using Weight (Live) Execution NA Live Live Yes Yes Execution reports
Execution Status by Owner using Weight (Live) Execution Live Live Live Yes Yes See Execution reports.
Execution and defects by owner Execution Live Data warehouse Data warehouse No Yes See Execution reports.
*Execution Status by Machine using Weight (Live) Execution Live Live Deprecated Yes Yes See Execution reports.
Execution Status by Test Case Category using TER Count (Live) Execution NA Live Live No Yes See Execution reports.
Execution Status by Test Case Category using Weight (Live) Execution NA Live Live No Yes See Execution reports.
Execution Status using TER Count (Live) Execution Live Live Live Yes Yes See Execution reports.
TER Listing (Live) Execution Live Live Live No Yes See Execution reports.
TER Status Counts (Live) Execution Live Live Live No Yes See Execution reports.
TER Status Counts Name (Live) Execution Live Live Live No Yes See Execution reports.
Test Case Results Details of Test Suite Results (Live) Execution NA Live Live No Yes See Execution reports.
TSER Listing (Live) Execution NA Live Live Yes Yes See Execution reports.
TSER Status by Owner using TSER Count (Live) Execution NA Live Live No Yes See Execution reports.
TSER Status by Owner using Weight (Live) Execution NA Live Live No Yes See Execution reports.
TSER Status using Test Case Count (Live) Execution NA Live Live No Yes See Execution reports.
TSER Status using Weight (Live) Execution NA Live Live No No See Execution reports.
*Request Response Time Lab Manager Data warehouse Data warehouse Deprecated Yes No Displays average response time for lab resource requests.
*Lab Resource Usage Lab Manager Data warehouse Data warehouse Deprecated No No Displays the rate at which lab resources, that are included in lab resource groups, are reserved within a specified time period.
*Requests by State (Live) Lab Manager Live Live Deprecated No No Displays all of the requests for lab resources by the states of the requests.
Plan Requirements Coverage by Test Case Requirements Live Data warehouse Data warehouse Yes Yes Supports requirements from an OSLC RM service provider. See Requirements reports.
Plan Requirements Coverage Detail Requirements Live Data warehouse Data warehouse No Yes See Requirements reports.
Plan Requirements Not Covered Detail Requirements Live Data warehouse Data warehouse No Yes See Requirements reports.
Plan Requirements Execution using TCER Count Requirements Live Data warehouse Data warehouse Yes Yes Supports requirements from an OSLC RM service provider. See Requirements reports.
Plan Test Cases Not Covering Requirements Requirements Live Data warehouse Data warehouse No Yes See Requirements reports.
Requirements Traceability Requirements Live Data warehouse Data warehouse No Yes See Requirements reports.
Plan Requirements Execution using Weight Requirements Live Data warehouse Data warehouse Yes Yes Supports requirements from an OSLC RM service provider. See Requirements reports.
Plan Requirements Defect Impact Requirements Live Data warehouse Data warehouse No Yes See Requirements reports.
Scorecard Scorecard Live Data warehouse Data warehouse No No Displays an overview of test case status, test execution counts and result points, and defect counts.
Execution by Test Schedule (Live) Summary Live Live Live No Yes See Summary reports.
Tester Report using TCER Count Summary Live Data warehouse Data warehouse Yes Yes Supports work items from an OSLC CCM service provider. See Summary reports.
Tester Report using Weight Summary Live Data warehouse Data warehouse Yes Yes Supports work items from an OSLC CCM service provider. See Summary reports.
Test artifact States (Live) Test case NA Live Live No Yes Chart-based report that shows counts of test cases, test scripts, and test suites by their state, such as Draft and Under Review.

See Test case reports.

Test cases by Team Test case Live Live Live No Yes Lists test cases by team name. The results display the team names, test case names, category types, category names, test case owners, and test case weights.

See Test case reports.

Test Case Coverage by TCER Test case NA Live Live Yes Yes Chart-based report that shows the counts of TERs and their states by test case.

See Test case reports.

Test Case Coverage by Test Script Test case NA Live Live Yes Yes Chart-based report that shows the number of test scripts that are associated with test cases.

See Test case reports.

Test cases by Test Environment Test case Live Live Live No Yes Lists test cases by configuration. The results display the configurations, test case names, category types, and category names.

See Test case reports.

Test cases Test case Live Live Live No Yes Lists test cases. The results display the test case names, along with their category types, their category names, and the dates they were last modified.

See Test case reports.

Test case Review Test case Live Data warehouse Data warehouse No Yes Displays a range of test case details. The results display three charts, one showing test case details, one showing requirements work items, and one showing other work item by test case.

See Test case reports.

Test cases by Development State (Live) Test case Live Live Live No Yes Lists test cases by creation state. The results display the test plan names, test case names, and test case states.

See Test case reports.

Test cases Impacted by Defects Test case Live Data warehouse Data warehouse No Yes Lists the test cases and test suites associated with defects. The results display test cases, test suites and their associated defects.

See Test case reports.

Test scripts by Development State (Live) Test script NA Live Live Yes Yes Tabular report that lists test scripts and their state, such as Draft and Approved.

See Test case reports.

Test suites by Development State (Live) Test suite NA Live Live Yes Yes Tabular report that lists test suites and their state, such as Draft and Approved.

See Test case reports.

Note: * The reports that were deprecated in version 5.0 will continue to be available in existing project areas.
You can add new report resources to the list of deployed report resources in a project or team area, see Deploying new report resources.
Note: Two new report resources were created: "TER Status Counts Name" and "Micro TER Status Counts Name". These two new resources will display the same information as the original reports ("TER Status Counts" and "Micro TER Status Counts"), the only difference will be that the Iteration parameter will be selected based on name and not in item id.

video icon Video

Jazz.net channel
Software Education channel

learn icon Courses

IoT Academy
Skills Gateway

ask icon Community

Jazz.net
Jazz.net forums
Jazz.net library

support icon Support

IBM Support Community
Deployment wiki