Test coverage optimization - basic question
I was going through the RQM product info page and below thing was mentioned for test coverage optimization. How will RQM have the intelligence to automatically identify and select the minimum number of tests required for a given level of environment coverage? If it has to be 100% test coverage then all the configurations has to be tested.
Thanks!
Test coverage optimization
Many applications are built to support multiple environments. Such environments can be composed of different operating systems, different browsers or different hardware configurations. For testers, this poses a significant challenge, as the time required to complete testing increases exponentially with the number of supported configurations.
IBM Rational Quality Manager includes technology that is designed to automatically identify and select the minimum number of tests required for a given level of environment coverage. This enables testers to ensure that they optimize configuration coverage within their time or resource constraints.
Thanks!
Test coverage optimization
Many applications are built to support multiple environments. Such environments can be composed of different operating systems, different browsers or different hardware configurations. For testers, this poses a significant challenge, as the time required to complete testing increases exponentially with the number of supported configurations.
IBM Rational Quality Manager includes technology that is designed to automatically identify and select the minimum number of tests required for a given level of environment coverage. This enables testers to ensure that they optimize configuration coverage within their time or resource constraints.
One answer
The important distinction is whether or not your business requires full coverage of all platforms, or all permutations.
For instance: consider a testing matrix that includes Win32, Linux, DB2, and Derby.
Full 100% coverage of all permutations would be:
Win32 + Derby
Win32 + DB2
Linux + Derby
Linux + DB2
100% coverage, however, could mean:
Win32 + Derby
Linux + DB2
The fact of the matter is that many businesses have such a large matrix that they can not get 100% coverage across all permutations.
The Test Environment generation wizard in RQM provides a sophisticated way to try and manage that risk - it will generate 100% coverage with the minimum permutations. You can also weight individual "pieces" for relative importance and include "must have" or "mustn't have" permutations.
Hope this helps.
For instance: consider a testing matrix that includes Win32, Linux, DB2, and Derby.
Full 100% coverage of all permutations would be:
Win32 + Derby
Win32 + DB2
Linux + Derby
Linux + DB2
100% coverage, however, could mean:
Win32 + Derby
Linux + DB2
The fact of the matter is that many businesses have such a large matrix that they can not get 100% coverage across all permutations.
The Test Environment generation wizard in RQM provides a sophisticated way to try and manage that risk - it will generate 100% coverage with the minimum permutations. You can also weight individual "pieces" for relative importance and include "must have" or "mustn't have" permutations.
Hope this helps.