TER Status Counts report .. "Points"?
2 answers
... this report shows information by "points"; e.g. for a Test Plan; how many Points have passed, how many Points have failed, etc.
What do these "Points" correlate to?!
What does this report mean??
Hi John,
Thanks for your message. I wasn't sure exactly which report you are referring to, however, "Points Passed, Points Failed, etc" typically refer to the individual points that were generated during the execution of a TER.
For instance, suppose you are executing a TER with a Test Case of weight 100, that has a manual test script with two steps. If the first step passes, and the second step is blocked, the results would be similar to below:
Points Passed - 50
Points Blocked - 50
Points Unattempted/Not Started - 50
I hope that helps clarify, and if I misunderstood your question at all please let me know.
Thanks,
Matt
johnmatt wrote:
should have be counted the same. In general, a system test case that is
complex and has a long duration is "worth" more than a simple FVT test
case that test one boundary of an API. The weighting is an arbitrary
way of conveying the equality. Also if the test does not fully pass the
amount you give for passing and failing again can be somewhat arbitrary
as well. One way as suggested is that you can use the number of steps
that worked as a percent times the total weight. That is one way and
there are many ways you can assign "partial credit" The goal is
hopefully to do it consistently so the results are meaningful.
.. this report shows information by "points"; e.g. for a
Test Plan; how many Points have passed, how many Points have failed,
etc.
What do these "Points" correlate to?!
What does this report mean??
Points are a way of bringing equality to test cases. Not all test cases
should have be counted the same. In general, a system test case that is
complex and has a long duration is "worth" more than a simple FVT test
case that test one boundary of an API. The weighting is an arbitrary
way of conveying the equality. Also if the test does not fully pass the
amount you give for passing and failing again can be somewhat arbitrary
as well. One way as suggested is that you can use the number of steps
that worked as a percent times the total weight. That is one way and
there are many ways you can assign "partial credit" The goal is
hopefully to do it consistently so the results are meaningful.