RQM and Test Case and Test Execution Progress Bars - calculation query
Current version is 5.0.2 ifix 24
So I've been around this tool for a long time and I'm still flumoxed as to how the progress bars are calculating out the numbers. So can somebody shed some light on what the issue might be ?
So I have a plan with 203 test cases and corresponding test case execution records. All have a weight of 1.
The progress bar is showing 20 --> 203 - which should mean I have executed 20 of the 203 should it not ? yet if I drill down on the progress bar, I have 175 not run which means I must have executed 28 records - so why does my progress bar only say 20 ?
To add to this, we have 9 Test Case Suites in the same plan, each also have Test Suite execution records. - the suites weights are calculated out by the number of test cases within. So my total weight over all 9 suites (based on test cases included in the suites) is 205.
We have completed 7 points based on test case weight in the suites - shouldn't that be leaving a progress bar that show 7 --> 205 when in fact it showing 7 - 150
Thanks in advance for any input
Comments
Bharath Rao
Oct 24 '19, 11:57 p.m.Hello Karen,
Karen Steele
Oct 25 '19, 9:12 a.m.Yes the execution records were all generated directly in the test plan after the suites and test cases were added.
Karen Steele
Oct 25 '19, 11:50 a.m.By way of example, this suite has 48 total weight points, there are 2 points deferred, 9 failed and 21 passed points. The view shows very different numbers other than the weight which matches. Data Warehouse lag ?
Don Yang
Oct 28 '19, 9:16 p.m.Karen Steele
Oct 30 '19, 8:35 a.m.Don't seem to be able to add an attachment (is there a document perhaps that explains how the counts are rolled up - I haven't been able to find one)
Total Test Cases = 901
Counts blow taken from clicking on the bar above and using the results details to group by Last Result (total count before grouping was 901)
Passed Points = 169 - correct
Deferred = 4 - correct
Perm Failed = 8 - correct
Failed = 9 - correct
In Progress = 2 – not listed
Inconclusive = 11 - incorrect above shows 2
Not Run = 705
Points attempted 188 – does not match up with numbers above – shouldn’t this be the count of all of the above except perhaps in progress ? which is not 188 – progress should be in my mind 901 – not run = 196 as progress