It's all about the answers!

Ask a question

Quality Management job in DCC fails


Sany Maamari (13243751) | asked Apr 03 '15, 8:10 a.m.
edited Apr 03 '15, 10:43 a.m.
Hello,
My DCC job fails with this error (weird error)

04/03/2015 13:58:07,264 [dcc_etl_RQM_ODS_RQMResourceGroup0_consumer_0] ERROR CRRCD4602E The real value of the VALUE column of the RQM_Category mapping table and the RIODS."TEST_CATEGORY" database table cannot be retrieved. Check the current incoming row values:     {/content/category/categoryType/@href=null : false, /archived=true : false, /purged=true : false, /id=_z7hi4klLEeSAEuuHhdrDFw : false, /content/category/title=null : false}04/03/2015 13:58:07,264 [dcc_etl_RQM_ODS_RQMResourceGroup0_consumer_0] ERROR 04/03/2015 13:58:07,264 [dcc_etl_RQM_ODS_RQMResourceGroup0_resource_0] ERROR CRRCD4302E The RQM_Category_R : /secure/service/com.ibm.rqm.integration.service.IIntegrationService/resources/category?etlmode=true&includeArchived=true : /feed/entry resource was retrieved, but not transformed and loaded into the data warehouse.java.util.concurrent.ExecutionException: com.ibm.rational.datacollection.etl.exception.ETLException: CRRCD4600E The retrieved resources could not be processed because of an error.    at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:233)    at java.util.concurrent.FutureTask.get(FutureTask.java:94)    at com.ibm.rational.datacollection.etl.tasks.ETLSubTask.call(ETLSubTask.java:229)    at com.ibm.rational.datacollection.etl.tasks.ETLSubTask.call(ETLSubTask.java:1)    at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:314)    at java.util.concurrent.FutureTask.run(FutureTask.java:149)    at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:908)    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:931)    at java.lang.Thread.run(Thread.java:773)Caused by: com.ibm.rational.datacollection.etl.exception.ETLException: CRRCD4600E The retrieved resources could not be processed because of an error.    at com.ibm.rational.datacollection.etl.consumer.DataConsumer.call(DataConsumer.java:326)    at com.ibm.rational.datacollection.etl.consumer.DataConsumer.call(DataConsumer.java:1)    ... 5 moreCaused by: com.ibm.rational.datacollection.etl.exception.ETLException:     at com.ibm.rational.datacollection.etl.utils.ETLExecutionUtil.generateOutRow(ETLExecutionUtil.java:1376)    at com.ibm.rational.datacollection.etl.utils.ETLExecutionUtil.executePreparedStatement(ETLExecutionUtil.java:156)    at com.ibm.rational.datacollection.etl.consumer.DataConsumer.call(DataConsumer.java:297)    ... 6 moreCaused by: java.lang.NullPointerException    at com.ibm.rational.datacollection.etl.utils.ETLExecutionUtil.getValueFromLocalTranfomArtifactDeletedIfPurged(ETLExecutionUtil.java:2238)    at com.ibm.rational.datacollection.etl.utils.ETLExecutionUtil.getLocalTransformValue(ETLExecutionUtil.java:806)    at com.ibm.rational.datacollection.etl.utils.JDBCUtil.getRealValue(JDBCUtil.java:1733)    at com.ibm.rational.datacollection.etl.utils.ETLExecutionUtil.generateOutRow(ETLExecutionUtil.java:1360)    ... 8 more04/03/2015 13:58:07,491 [dcc_etl_RQM_ODS_RQMResourceGroup0] ERROR CRRCD4309E The java.util.concurrent.ExecutionException: com.ibm.rational.datacollection.etl.exception.ETLException: CRRCD4302E The RQM_Category_R : /secure/service/com.ibm.rqm.integration.service.IIntegrationService/resources/category?etlmode=true&includeArchived=true : /feed/entry resource was retrieved, but not transformed and loaded into the data warehouse. resource was retrieved, but cannot be transformed and loaded.04/03/2015 13:58:07,491 [dcc_etl_RQM_ODS_RQMResourceGroup0] INFO CRRCD3100I The fetcher thread pool executor is shut down successfully. 04/03/2015 13:58:07,491 [dcc_etl_RQM_ODS_RQMResourceGroup0] INFO CRRCD3100I The consumer thread pool executor is shut down successfully. 04/03/2015 13:58:07,491 [dcc_etl_RQM_ODS_RQMResourceGroup0] INFO CRRCD3100I The fetcher thread pool executor is shut down successfully. 04/03/2015 13:58:07,491 [dcc_etl_RQM_ODS_RQMResourceGroup0] ERROR com.ibm.rational.datacollection.etl.exception.ETLException: CRRCD4516E This SQL statement cannot be execute: SELECT MODIFIEDSINCE, LOADTYPE FROM CONFIG.DCS_ETL_INFO WHERE RESGROUP_ID='c45567e4bce514030d0dc7174f92f21a' AND RESOURCE_ID='22d5b86e0052a34419b8aaa78969dc82'.    at com.ibm.rational.datacollection.etl.utils.JDBCUtil.getResourceModifiedSince(JDBCUtil.java:453)    at com.ibm.rational.datacollection.etl.tasks.ETLTask.call(ETLTask.java:103)    at com.ibm.rational.datacollection.etl.tasks.ETLTask.call(ETLTask.java:1)    at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:314)    at java.util.concurrent.FutureTask.run(FutureTask.java:149)    at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:908)    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:931)    at java.lang.Thread.run(Thread.java:773)Caused by: com.ibm.db2.jcc.am.SqlNonTransientConnectionException: [jcc][t4][10335][10366][4.17.28] Invalid operation: Connection is closed. ERRORCODE=-4470, SQLSTATE=08003    at com.ibm.db2.jcc.am.fd.a(fd.java:737)    at com.ibm.db2.jcc.am.fd.a(fd.java:66)    at com.ibm.db2.jcc.am.fd.a(fd.java:128)    at com.ibm.db2.jcc.am.Connection.checkForClosedConnection(Connection.java:5873)    at com.ibm.db2.jcc.am.Connection.createStatementX(Connection.java:2281)    at com.ibm.db2.jcc.am.Connection.createStatementX(Connection.java:910)    at com.ibm.db2.jcc.am.Connection.createStatement(Connection.java:902)    at com.ibm.rational.datacollection.etl.utils.JDBCUtil.getResourceModifiedSince(JDBCUtil.java:446)    ... 7 more


Does someone hava any idea on how to resolve it ?
Thanks for the help

Comments
Matthew Owenby commented Apr 10 '15, 9:21 a.m. | edited Apr 10 '15, 9:22 a.m.

Did this ever get resolved?  I am experiencing the same issue in my RQM instance.


Gustavo Reis commented May 15 '15, 8:25 a.m.

Same problem here.

2 answers



permanent link
Kevin Ramer (4.5k8183200) | answered Apr 03 '15, 9:31 a.m.
Besides this:

java.lang.Thread.run(Thread.java:773)Caused by: com.ibm.db2.jcc.am.SqlNonTransientConnectionException: [jcc][t4][10335][10366][4.17.28] Invalid operation: Connection is closed. ERRORCODE=-4470, SQLSTATE=08003    at

You might want to check db2 diagnostic log ( db2diag -help for tips ).   DB2 server doesn't give an explanation of this error code ( db2 \? SQL4470 for example ).  

Beyond that searching the wild-wild-web leads one to think this would be a client side ( DCC ) issue.

Comments
Sany Maamari commented Apr 03 '15, 9:34 a.m.

Hi Kevin,
Yes, I think that it is DCC side error. It worked yesterday, it doesn't work anymore today.
Thanks for your help


Kevin Ramer commented Apr 03 '15, 9:39 a.m. | edited Apr 03 '15, 9:39 a.m.

As the error specifically mentions "connection is closed", maybe too many connections were made/attempted versus the database configuration ( MAXAPPLS ).  That's where the db2 diagnostics may help.


Sany Maamari commented Apr 03 '15, 10:43 a.m.

Ok,
I've executed the db2diag exe and found no error (today, day of the DCC execution) only Events about the automatic change of the Locklist and Pckcachesz.


Kevin Ramer commented Apr 03 '15, 11:18 a.m.

Well, I've no DCC installed (yet)... My understanding is that collections are supposed to run at various times (rather than the once / day of the data warehouse jobs), so I'm not much beyond what I've already mentioned. 

Are other DCC jobs succeeding -always- while the QM job fails ?


Sany Maamari commented Apr 07 '15, 3:38 a.m.

 Hi Kevin, 

Well yes, all the other jobs succeed, only some of the QM jobs fails (2 out of 3). I think that it is defect in RQM that makes the DCC jobs fail to proceed. From my point of view, the defect in RQM is in removed but undeleted Keywords in test scripts. I'm telling this because for some test scripts that uses Keywords, I'm unable to duplicate them for a reason that I don't understand well.


permanent link
Don Yang (7.7k21109138) | answered May 18 '15, 3:47 a.m.
It is likely you are hitting the defect:
https://jazz.net/jazz02/web/projects/Rational%20Quality%20Manager#action=com.ibm.team.workitem.viewWorkItem&id=132924

The best way is to contact client support in order to collect further log files and test result to determine if it is the same issue or not.

Your answer


Register or to post your answer.


Dashboards and work items are no longer publicly available, so some links may be invalid. We now provide similar information through other means. Learn more here.