Jazz Forum Welcome to the Jazz Community Forum Connect and collaborate with IBM Engineering experts and users

Data Collection Job for Work Items failure

Looking at JazzTeamServer\server\logs\ccm-etl.log, we found that Data Collection Job for Work Items sometimes (i.e., not all days) fails due to java.sql.SQLTransactionRollbackException. Any advice?
2017-10-24 00:35:12,499 [jazz: AsynchronousTaskRunner-0 @@ 00:23] DEBUG e.workitem.internal.WorkItemsRemoteSnapshotService  - ETL: ***Started Build WorkItemStateHistory at 24/10/17 0.35***
2017-10-24 00:35:48,036 [jazz: AsynchronousTaskRunner-0 @@ 00:23] ERROR e.workitem.internal.WorkItemsRemoteSnapshotService  - Contenitore heap con ID contenitore Container(-1, 1508506168057) chiuso.
java.sql.SQLTransactionRollbackException: Contenitore heap con ID contenitore Container(-1, 1508506168057) chiuso.
at org.apache.derby.client.am.SQLExceptionFactory40.getSQLException(Unknown Source)
at org.apache.derby.client.am.SqlException.getSQLException(Unknown Source)
at org.apache.derby.client.am.ResultSet.next(Unknown Source)
at com.ibm.team.repository.service.internal.db.jdbcwrappers.stat.ResultSetStatWrapper.next(ResultSetStatWrapper.java:436)
at com.ibm.team.repository.service.internal.db.jdbcwrappers.errlog.ResultSetErrLogWrapper.next(ResultSetErrLogWrapper.java:894)
at com.ibm.team.repository.service.internal.db.jdbcwrappers.leak.ResultSetLeakWrapper.next(ResultSetLeakWrapper.java:402)
at com.ibm.team.datawarehouse.service.workitem.internal.etlbuild.WorkItemStateHistory.execute(WorkItemStateHistory.java:117)
at com.ibm.team.datawarehouse.service.workitem.internal.WorkItemsRemoteSnapshotService.updateSnapshotWithCheckpoint(WorkItemsRemoteSnapshotService.java:486)
at com.ibm.team.datawarehouse.service.workitem.internal.WorkItemsRemoteSnapshotService.updateSnapshot(WorkItemsRemoteSnapshotService.java:246)
at com.ibm.team.datawarehouse.service.etl.AbstractRemoteSnapshotService$1.run(AbstractRemoteSnapshotService.java:203)
at com.ibm.team.datawarehouse.service.internal.RemoteDatabaseService$6.run(RemoteDatabaseService.java:548)
at com.ibm.team.repository.service.internal.rdb.ConnectionPoolService.withCurrentConnection(ConnectionPoolService.java:472)
at com.ibm.team.datawarehouse.service.internal.RemoteDatabaseService.write(RemoteDatabaseService.java:510)
at sun.reflect.GeneratedMethodAccessor1043.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:37)
at java.lang.reflect.Method.invoke(Method.java:611)
at org.eclipse.soda.sat.core.internal.record.ExportProxyServiceRecord.invoke(ExportProxyServiceRecord.java:361)
at org.eclipse.soda.sat.core.internal.record.ExportProxyServiceRecord.access$0(ExportProxyServiceRecord.java:347)
at org.eclipse.soda.sat.core.internal.record.ExportProxyServiceRecord$ExportedServiceInvocationHandler.invoke(ExportProxyServiceRecord.java:56)
at com.sun.proxy.$Proxy131.write(Unknown Source)
at com.ibm.team.datawarehouse.service.internal.RemoteDataWarehouseProvider.write(RemoteDataWarehouseProvider.java:29)
at sun.reflect.GeneratedMethodAccessor827.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:37)
at java.lang.reflect.Method.invoke(Method.java:611)
at org.eclipse.soda.sat.core.internal.record.ExportProxyServiceRecord.invoke(ExportProxyServiceRecord.java:361)
at org.eclipse.soda.sat.core.internal.record.ExportProxyServiceRecord.access$0(ExportProxyServiceRecord.java:347)
at org.eclipse.soda.sat.core.internal.record.ExportProxyServiceRecord$ExportedServiceInvocationHandler.invoke(ExportProxyServiceRecord.java:56)
at com.sun.proxy.$Proxy1720.write(Unknown Source)
at com.ibm.team.datawarehouse.service.etl.AbstractRemoteSnapshotService.updateData(AbstractRemoteSnapshotService.java:194)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:60)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:37)
at java.lang.reflect.Method.invoke(Method.java:611)
at org.eclipse.soda.sat.core.internal.record.ExportProxyServiceRecord.invoke(ExportProxyServiceRecord.java:361)
at org.eclipse.soda.sat.core.internal.record.ExportProxyServiceRecord.access$0(ExportProxyServiceRecord.java:347)
at org.eclipse.soda.sat.core.internal.record.ExportProxyServiceRecord$ExportedServiceInvocationHandler.invoke(ExportProxyServiceRecord.java:56)
at com.sun.proxy.$Proxy1219.updateData(Unknown Source)
at com.ibm.team.datawarehouse.service.internal.InternalDataWarehouseService$7.run(InternalDataWarehouseService.java:853)
at com.ibm.team.repository.service.internal.permission.ImpersonationService.runAs(ImpersonationService.java:75)
at sun.reflect.GeneratedMethodAccessor556.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:37)
at java.lang.reflect.Method.invoke(Method.java:611)
at org.eclipse.soda.sat.core.internal.record.ExportProxyServiceRecord.invoke(ExportProxyServiceRecord.java:361)
at org.eclipse.soda.sat.core.internal.record.ExportProxyServiceRecord.access$0(ExportProxyServiceRecord.java:347)
at org.eclipse.soda.sat.core.internal.record.ExportProxyServiceRecord$ExportedServiceInvocationHandler.invoke(ExportProxyServiceRecord.java:56)
at com.sun.proxy.$Proxy1052.runAs(Unknown Source)
at com.ibm.team.datawarehouse.service.internal.InternalDataWarehouseService.updateRemoteSnapshotDataFromTask(InternalDataWarehouseService.java:833)
at sun.reflect.GeneratedMethodAccessor1073.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:37)
at java.lang.reflect.Method.invoke(Method.java:611)
at org.eclipse.soda.sat.core.internal.record.ExportProxyServiceRecord.invoke(ExportProxyServiceRecord.java:361)
at org.eclipse.soda.sat.core.internal.record.ExportProxyServiceRecord.access$0(ExportProxyServiceRecord.java:347)
at org.eclipse.soda.sat.core.internal.record.ExportProxyServiceRecord$ExportedServiceInvocationHandler.invoke(ExportProxyServiceRecord.java:56)
at com.sun.proxy.$Proxy1185.updateRemoteSnapshotDataFromTask(Unknown Source)
at com.ibm.team.datawarehouse.service.internal.SnapshotRunnerTask.transactionSucceeded(SnapshotRunnerTask.java:58)
at sun.reflect.GeneratedMethodAccessor572.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:37)
at java.lang.reflect.Method.invoke(Method.java:611)
at org.eclipse.soda.sat.core.internal.record.ExportProxyServiceRecord.invoke(ExportProxyServiceRecord.java:361)
at org.eclipse.soda.sat.core.internal.record.ExportProxyServiceRecord.access$0(ExportProxyServiceRecord.java:347)
at org.eclipse.soda.sat.core.internal.record.ExportProxyServiceRecord$ExportedServiceInvocationHandler.invoke(ExportProxyServiceRecord.java:56)
at com.sun.proxy.$Proxy1203.transactionSucceeded(Unknown Source)
at com.ibm.team.repository.service.internal.AsynchronousTaskSchedulerService$4.transactionSucceeded(AsynchronousTaskSchedulerService.java:997)
at com.ibm.team.repository.service.internal.AsynchronousTaskSchedulerService$4.executeTask(AsynchronousTaskSchedulerService.java:1006)
at com.ibm.team.repository.service.internal.scheduler.AsynchronousTaskRunner.runTask(AsynchronousTaskRunner.java:185)
at com.ibm.team.repository.service.internal.scheduler.AsynchronousTaskRunner.run(AsynchronousTaskRunner.java:138)
at java.lang.Thread.run(Thread.java:761)
Caused by: org.apache.derby.client.am.SqlException: Contenitore heap con ID contenitore Container(-1, 1508506168057) chiuso.
at org.apache.derby.client.am.ResultSet.completeSqlca(Unknown Source)
at org.apache.derby.client.net.NetResultSetReply.parseFetchError(Unknown Source)
at org.apache.derby.client.net.NetResultSetReply.parseCNTQRYreply(Unknown Source)
at org.apache.derby.client.net.NetResultSetReply.readFetch(Unknown Source)
at org.apache.derby.client.net.ResultSetReply.readFetch(Unknown Source)
at org.apache.derby.client.net.NetResultSet.readFetch_(Unknown Source)
at org.apache.derby.client.am.ResultSet.flowFetch(Unknown Source)
at org.apache.derby.client.net.NetCursor.getMoreData_(Unknown Source)
at org.apache.derby.client.am.Cursor.stepNext(Unknown Source)
at org.apache.derby.client.am.Cursor.next(Unknown Source)
at org.apache.derby.client.am.ResultSet.nextX(Unknown Source)
... 65 more
2017-10-24 00:35:48,036 [jazz: AsynchronousTaskRunner-0 @@ 00:23] DEBUG e.workitem.internal.WorkItemsRemoteSnapshotService  - ETL: Records Selected: 198
2017-10-24 00:35:48,036 [jazz: AsynchronousTaskRunner-0 @@ 00:23] DEBUG e.workitem.internal.WorkItemsRemoteSnapshotService  - ETL: Records Inserted: 0
2017-10-24 00:35:48,036 [jazz: AsynchronousTaskRunner-0 @@ 00:23] DEBUG e.workitem.internal.WorkItemsRemoteSnapshotService  - ETL: Records Updated: 198
2017-10-24 00:35:48,036 [jazz: AsynchronousTaskRunner-0 @@ 00:23] DEBUG e.workitem.internal.WorkItemsRemoteSnapshotService  - ETL: Time Inserting: 0ms
2017-10-24 00:35:48,036 [jazz: AsynchronousTaskRunner-0 @@ 00:23] DEBUG e.workitem.internal.WorkItemsRemoteSnapshotService  - ETL: Time Updating: Less than 1ms
2017-10-24 00:35:48,036 [jazz: AsynchronousTaskRunner-0 @@ 00:23] DEBUG e.workitem.internal.WorkItemsRemoteSnapshotService  - ETL: Time Looking Up: Less than 1ms
2017-10-24 00:35:48,036 [jazz: AsynchronousTaskRunner-0 @@ 00:23] DEBUG e.workitem.internal.WorkItemsRemoteSnapshotService  - ETL: Time Fetching Data: 34 seconds 
2017-10-24 00:35:48,036 [jazz: AsynchronousTaskRunner-0 @@ 00:23] DEBUG e.workitem.internal.WorkItemsRemoteSnapshotService  - ETL: Time Running: 35 seconds 
2017-10-24 00:35:48,036 [jazz: AsynchronousTaskRunner-0 @@ 00:23] DEBUG e.workitem.internal.WorkItemsRemoteSnapshotService  - ETL: ***Finished Build WorkItemStateHistory at 24/10/17 0.35. The build was unsuccessful***
Thanks in advance.
Cheers.

0 votes

Comments

It looks like something happening in database side. Do you see any error in derby.log?

Also please note
- ccm-etl.log is for RRDI (JavaETL). Are you still using it?
- Using Derby for DWH is supported only for small scale deployment or testing purpose. It might be that the ETL job is exceeding the capacity of Derby database.


Be the first one to answer this question!

Register or log in to post your answer.

Dashboards and work items are no longer publicly available, so some links may be invalid. We now provide similar information through other means. Learn more here.

Search context
Follow this question

By Email: 

Once you sign in you will be able to subscribe for any updates here.

By RSS:

Answers
Answers and Comments
Question details
× 3

Question asked: Oct 25 '17, 8:48 a.m.

Question was seen: 1,878 times

Last updated: Oct 25 '17, 8:38 p.m.

Confirmation Cancel Confirm