Unable to import test execution results with steps
Has anyone had any success in using the RQM Excel Importer tool to import Test Case Execution Results containing multiple steps?
For instance, importing a single Test Case, with a linked Test Script (containing multiple Test Steps), and Test Case Execution Record (for that test case), and a single Test Case Execution Result for that TER. I know it sounds like a tall ask. But it should be possible right?
I modelled an Excel Importer CFG file from a sample that contained a Test Script (with multiple Test Step) which was linked to a Test Case. In the same way, I believe an Execution Result (with multiple Test Steps) could be linked to a Execution Record. Though when I try and form my CFG file in the same manner, it fails to correctly create a Test Case Execution Result.
I know this may sound like an ambitious import. Pulling 4 artifacts into RQM with one CFG file. Though there still seems to be an inability to simply link TERs with Execution Results containing more than one step.
Note that the only sample for Execution Results that comes with the Excel Importer will only create an Execution Result without any steps. I'm trying to import one that does have steps.
Below I've pasted the CFG data for which I've had the most success with. Quite surprisingly, this CFG, and associated spreadsheet (not included here) is able to:
1. Create a single Test Script
2. Create a single Test Case and link to the Test Script above
3. Create a single Test Execution Record and link to the Test Case above
4. Create a single Test Execution Result and link to the Test Execution Record, Test Case and the Test Script above.
Really good. BUT ....
Unfortunately, what isn't working is the Test Execution Result isn't populated correctly when displayed through RQM's web user interface. Sure, the header of the Test Execution Result looks correct. Has a correct state, TER linked, Test Case linked and Test Script linked. Though in the "Result Details" section of the page, where individual steps are normally displayed with a pass/fail result, only the text "undefined" appears against a single test step. The "Description", "Expected Results" and "Actual Results" fields are empty. Very close, but not quite working.
The big issue I'm having in the CFG below is the "er:stepResults" tags. If I try different techniques, by including and removing the "er:" prefix, the results of the import are slightly different. And importing to "file" instead of "repository" shows me that the XML files themselves alter in structure according to whether I include or don't include "er:" prefixes. I can't quite seem to get a clean XML produced that looks like:
<stepResults>
<stepResult>
<result>pass</result>
<description>step 1 description</description>
etc...
</stepResult>
</stepResults>
Can't seem to find any other examples of successful Execution Result imports with steps in these forums.
Can anyone help?
// My CFG starts here
testscript.XLSStartRow=5
testscript.XLSArtifactID=B2
testscript.dc:title=C2
testscript.dc:description=D2
testscript.steps.type="execution"
testscript.steps.description=H
testscript.steps.title=G
testscript.steps.name=G
testscript.steps.expectedResult=I
testcase.XLSLink=testscript
testcase.dc:title=C2
testcase.dc:description=D2
executionworkitem.XLSLink=testcase
executionworkitem.dc:title=C2
executionworkitem.dc:description=D2
executionresult.XLSStartRow=5
executionresult.XLSLink=executionworkitem
executionresult.testscript=Link("../testscript/TC1")
executionresult.dc:title=C2
executionresult.dc:description=D2
executionresult.jzalm:state=E2
executionresult.er:stepResults.er:stepResult.stepType="execution"
executionresult.er:stepResults.er:stepResult.result=K
executionresult.er:stepResults.er:stepResult.startTime=L
executionresult.er:stepResults.er:stepResult.expectedResult=I
executionresult.er:stepResults.er:stepResult.actualResult=J
executionresult.er:stepResults.er:stepResult.description=H
executionresult.XLSDelimeter=\n
// My CFG ends here
For instance, importing a single Test Case, with a linked Test Script (containing multiple Test Steps), and Test Case Execution Record (for that test case), and a single Test Case Execution Result for that TER. I know it sounds like a tall ask. But it should be possible right?
I modelled an Excel Importer CFG file from a sample that contained a Test Script (with multiple Test Step) which was linked to a Test Case. In the same way, I believe an Execution Result (with multiple Test Steps) could be linked to a Execution Record. Though when I try and form my CFG file in the same manner, it fails to correctly create a Test Case Execution Result.
I know this may sound like an ambitious import. Pulling 4 artifacts into RQM with one CFG file. Though there still seems to be an inability to simply link TERs with Execution Results containing more than one step.
Note that the only sample for Execution Results that comes with the Excel Importer will only create an Execution Result without any steps. I'm trying to import one that does have steps.
Below I've pasted the CFG data for which I've had the most success with. Quite surprisingly, this CFG, and associated spreadsheet (not included here) is able to:
1. Create a single Test Script
2. Create a single Test Case and link to the Test Script above
3. Create a single Test Execution Record and link to the Test Case above
4. Create a single Test Execution Result and link to the Test Execution Record, Test Case and the Test Script above.
Really good. BUT ....
Unfortunately, what isn't working is the Test Execution Result isn't populated correctly when displayed through RQM's web user interface. Sure, the header of the Test Execution Result looks correct. Has a correct state, TER linked, Test Case linked and Test Script linked. Though in the "Result Details" section of the page, where individual steps are normally displayed with a pass/fail result, only the text "undefined" appears against a single test step. The "Description", "Expected Results" and "Actual Results" fields are empty. Very close, but not quite working.
The big issue I'm having in the CFG below is the "er:stepResults" tags. If I try different techniques, by including and removing the "er:" prefix, the results of the import are slightly different. And importing to "file" instead of "repository" shows me that the XML files themselves alter in structure according to whether I include or don't include "er:" prefixes. I can't quite seem to get a clean XML produced that looks like:
<stepResults>
<stepResult>
<result>pass</result>
<description>step 1 description</description>
etc...
</stepResult>
</stepResults>
Can't seem to find any other examples of successful Execution Result imports with steps in these forums.
Can anyone help?
// My CFG starts here
testscript.XLSStartRow=5
testscript.XLSArtifactID=B2
testscript.dc:title=C2
testscript.dc:description=D2
testscript.steps.type="execution"
testscript.steps.description=H
testscript.steps.title=G
testscript.steps.name=G
testscript.steps.expectedResult=I
testcase.XLSLink=testscript
testcase.dc:title=C2
testcase.dc:description=D2
executionworkitem.XLSLink=testcase
executionworkitem.dc:title=C2
executionworkitem.dc:description=D2
executionresult.XLSStartRow=5
executionresult.XLSLink=executionworkitem
executionresult.testscript=Link("../testscript/TC1")
executionresult.dc:title=C2
executionresult.dc:description=D2
executionresult.jzalm:state=E2
executionresult.er:stepResults.er:stepResult.stepType="execution"
executionresult.er:stepResults.er:stepResult.result=K
executionresult.er:stepResults.er:stepResult.startTime=L
executionresult.er:stepResults.er:stepResult.expectedResult=I
executionresult.er:stepResults.er:stepResult.actualResult=J
executionresult.er:stepResults.er:stepResult.description=H
executionresult.XLSDelimeter=\n
// My CFG ends here
One answer
Hi Sean,
would you please try to change the confg for executionresult
from
executionresult.er:stepResults.er:stepResult.stepType="execution"
executionresult.er:stepResults.er:stepResult.result=K
executionresult.er:stepResults.er:stepResult.startTime=L
executionresult.er:stepResults.er:stepResult.expectedResult=I
executionresult.er:stepResults.er:stepResult.actualResult=J
executionresult.er:stepResults.er:stepResult.description=H
to
executionresult.er:stepResults.er:steptype="execution"
executionresult.er:stepResults.er:result=K
executionresult.er:starttime=L
executionresult.er:stepResults.er:expectedresult=I
executionresult.er:stepResults.er:actualResult=J
executionresult.er:stepResults.description=H
and have a try?
Comments
Shashank Bellary
Jul 24 '12, 8:48 a.m.Hello can you please share the excel sheet you are using..