Looking at JazzTeamServer\server\logs\ccm-etl.log, we found that Data Collection Job for Work Items sometimes (i.e., not all days) fails due to java.sql.SQLTransactionRollbackException. Any advice?
2017-10-24 00:35:12,499 [jazz: AsynchronousTaskRunner-0 @@ 00:23] DEBUG e.workitem.internal.WorkItemsRemoteSnapshotService - ETL: ***Started Build WorkItemStateHistory at 24/10/17 0.35***
2017-10-24 00:35:48,036 [jazz: AsynchronousTaskRunner-0 @@ 00:23] ERROR e.workitem.internal.WorkItemsRemoteSnapshotService - Contenitore heap con ID contenitore Container(-1, 1508506168057) chiuso.
java.sql.SQLTransactionRollbackException: Contenitore heap con ID contenitore Container(-1, 1508506168057) chiuso.
at org.apache.derby.client.am.SQLExceptionFactory40.getSQLException(Unknown Source)
at org.apache.derby.client.am.SqlException.getSQLException(Unknown Source)
at org.apache.derby.client.am.ResultSet.next(Unknown Source)
at com.ibm.team.repository.service.internal.db.jdbcwrappers.stat.ResultSetStatWrapper.next(ResultSetStatWrapper.java:436)
at com.ibm.team.repository.service.internal.db.jdbcwrappers.errlog.ResultSetErrLogWrapper.next(ResultSetErrLogWrapper.java:894)
at com.ibm.team.repository.service.internal.db.jdbcwrappers.leak.ResultSetLeakWrapper.next(ResultSetLeakWrapper.java:402)
at com.ibm.team.datawarehouse.service.workitem.internal.etlbuild.WorkItemStateHistory.execute(WorkItemStateHistory.java:117)
at com.ibm.team.datawarehouse.service.workitem.internal.WorkItemsRemoteSnapshotService.updateSnapshotWithCheckpoint(WorkItemsRemoteSnapshotService.java:486)
at com.ibm.team.datawarehouse.service.workitem.internal.WorkItemsRemoteSnapshotService.updateSnapshot(WorkItemsRemoteSnapshotService.java:246)
at com.ibm.team.datawarehouse.service.etl.AbstractRemoteSnapshotService$1.run(AbstractRemoteSnapshotService.java:203)
at com.ibm.team.datawarehouse.service.internal.RemoteDatabaseService$6.run(RemoteDatabaseService.java:548)
at com.ibm.team.repository.service.internal.rdb.ConnectionPoolService.withCurrentConnection(ConnectionPoolService.java:472)
at com.ibm.team.datawarehouse.service.internal.RemoteDatabaseService.write(RemoteDatabaseService.java:510)
at sun.reflect.GeneratedMethodAccessor1043.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:37)
at java.lang.reflect.Method.invoke(Method.java:611)
at org.eclipse.soda.sat.core.internal.record.ExportProxyServiceRecord.invoke(ExportProxyServiceRecord.java:361)
at org.eclipse.soda.sat.core.internal.record.ExportProxyServiceRecord.access$0(ExportProxyServiceRecord.java:347)
at org.eclipse.soda.sat.core.internal.record.ExportProxyServiceRecord$ExportedServiceInvocationHandler.invoke(ExportProxyServiceRecord.java:56)
at com.sun.proxy.$Proxy131.write(Unknown Source)
at com.ibm.team.datawarehouse.service.internal.RemoteDataWarehouseProvider.write(RemoteDataWarehouseProvider.java:29)
at sun.reflect.GeneratedMethodAccessor827.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:37)
at java.lang.reflect.Method.invoke(Method.java:611)
at org.eclipse.soda.sat.core.internal.record.ExportProxyServiceRecord.invoke(ExportProxyServiceRecord.java:361)
at org.eclipse.soda.sat.core.internal.record.ExportProxyServiceRecord.access$0(ExportProxyServiceRecord.java:347)
at org.eclipse.soda.sat.core.internal.record.ExportProxyServiceRecord$ExportedServiceInvocationHandler.invoke(ExportProxyServiceRecord.java:56)
at com.sun.proxy.$Proxy1720.write(Unknown Source)
at com.ibm.team.datawarehouse.service.etl.AbstractRemoteSnapshotService.updateData(AbstractRemoteSnapshotService.java:194)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:60)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:37)
at java.lang.reflect.Method.invoke(Method.java:611)
at org.eclipse.soda.sat.core.internal.record.ExportProxyServiceRecord.invoke(ExportProxyServiceRecord.java:361)
at org.eclipse.soda.sat.core.internal.record.ExportProxyServiceRecord.access$0(ExportProxyServiceRecord.java:347)
at org.eclipse.soda.sat.core.internal.record.ExportProxyServiceRecord$ExportedServiceInvocationHandler.invoke(ExportProxyServiceRecord.java:56)
at com.sun.proxy.$Proxy1219.updateData(Unknown Source)
at com.ibm.team.datawarehouse.service.internal.InternalDataWarehouseService$7.run(InternalDataWarehouseService.java:853)
at com.ibm.team.repository.service.internal.permission.ImpersonationService.runAs(ImpersonationService.java:75)
at sun.reflect.GeneratedMethodAccessor556.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:37)
at java.lang.reflect.Method.invoke(Method.java:611)
at org.eclipse.soda.sat.core.internal.record.ExportProxyServiceRecord.invoke(ExportProxyServiceRecord.java:361)
at org.eclipse.soda.sat.core.internal.record.ExportProxyServiceRecord.access$0(ExportProxyServiceRecord.java:347)
at org.eclipse.soda.sat.core.internal.record.ExportProxyServiceRecord$ExportedServiceInvocationHandler.invoke(ExportProxyServiceRecord.java:56)
at com.sun.proxy.$Proxy1052.runAs(Unknown Source)
at com.ibm.team.datawarehouse.service.internal.InternalDataWarehouseService.updateRemoteSnapshotDataFromTask(InternalDataWarehouseService.java:833)
at sun.reflect.GeneratedMethodAccessor1073.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:37)
at java.lang.reflect.Method.invoke(Method.java:611)
at org.eclipse.soda.sat.core.internal.record.ExportProxyServiceRecord.invoke(ExportProxyServiceRecord.java:361)
at org.eclipse.soda.sat.core.internal.record.ExportProxyServiceRecord.access$0(ExportProxyServiceRecord.java:347)
at org.eclipse.soda.sat.core.internal.record.ExportProxyServiceRecord$ExportedServiceInvocationHandler.invoke(ExportProxyServiceRecord.java:56)
at com.sun.proxy.$Proxy1185.updateRemoteSnapshotDataFromTask(Unknown Source)
at com.ibm.team.datawarehouse.service.internal.SnapshotRunnerTask.transactionSucceeded(SnapshotRunnerTask.java:58)
at sun.reflect.GeneratedMethodAccessor572.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:37)
at java.lang.reflect.Method.invoke(Method.java:611)
at org.eclipse.soda.sat.core.internal.record.ExportProxyServiceRecord.invoke(ExportProxyServiceRecord.java:361)
at org.eclipse.soda.sat.core.internal.record.ExportProxyServiceRecord.access$0(ExportProxyServiceRecord.java:347)
at org.eclipse.soda.sat.core.internal.record.ExportProxyServiceRecord$ExportedServiceInvocationHandler.invoke(ExportProxyServiceRecord.java:56)
at com.sun.proxy.$Proxy1203.transactionSucceeded(Unknown Source)
at com.ibm.team.repository.service.internal.AsynchronousTaskSchedulerService$4.transactionSucceeded(AsynchronousTaskSchedulerService.java:997)
at com.ibm.team.repository.service.internal.AsynchronousTaskSchedulerService$4.executeTask(AsynchronousTaskSchedulerService.java:1006)
at com.ibm.team.repository.service.internal.scheduler.AsynchronousTaskRunner.runTask(AsynchronousTaskRunner.java:185)
at com.ibm.team.repository.service.internal.scheduler.AsynchronousTaskRunner.run(AsynchronousTaskRunner.java:138)
at java.lang.Thread.run(Thread.java:761)
Caused by: org.apache.derby.client.am.SqlException: Contenitore heap con ID contenitore Container(-1, 1508506168057) chiuso.
at org.apache.derby.client.am.ResultSet.completeSqlca(Unknown Source)
at org.apache.derby.client.net.NetResultSetReply.parseFetchError(Unknown Source)
at org.apache.derby.client.net.NetResultSetReply.parseCNTQRYreply(Unknown Source)
at org.apache.derby.client.net.NetResultSetReply.readFetch(Unknown Source)
at org.apache.derby.client.net.ResultSetReply.readFetch(Unknown Source)
at org.apache.derby.client.net.NetResultSet.readFetch_(Unknown Source)
at org.apache.derby.client.am.ResultSet.flowFetch(Unknown Source)
at org.apache.derby.client.net.NetCursor.getMoreData_(Unknown Source)
at org.apache.derby.client.am.Cursor.stepNext(Unknown Source)
at org.apache.derby.client.am.Cursor.next(Unknown Source)
at org.apache.derby.client.am.ResultSet.nextX(Unknown Source)
... 65 more
2017-10-24 00:35:48,036 [jazz: AsynchronousTaskRunner-0 @@ 00:23] DEBUG e.workitem.internal.WorkItemsRemoteSnapshotService - ETL: Records Selected: 198
2017-10-24 00:35:48,036 [jazz: AsynchronousTaskRunner-0 @@ 00:23] DEBUG e.workitem.internal.WorkItemsRemoteSnapshotService - ETL: Records Inserted: 0
2017-10-24 00:35:48,036 [jazz: AsynchronousTaskRunner-0 @@ 00:23] DEBUG e.workitem.internal.WorkItemsRemoteSnapshotService - ETL: Records Updated: 198
2017-10-24 00:35:48,036 [jazz: AsynchronousTaskRunner-0 @@ 00:23] DEBUG e.workitem.internal.WorkItemsRemoteSnapshotService - ETL: Time Inserting: 0ms
2017-10-24 00:35:48,036 [jazz: AsynchronousTaskRunner-0 @@ 00:23] DEBUG e.workitem.internal.WorkItemsRemoteSnapshotService - ETL: Time Updating: Less than 1ms
2017-10-24 00:35:48,036 [jazz: AsynchronousTaskRunner-0 @@ 00:23] DEBUG e.workitem.internal.WorkItemsRemoteSnapshotService - ETL: Time Looking Up: Less than 1ms
2017-10-24 00:35:48,036 [jazz: AsynchronousTaskRunner-0 @@ 00:23] DEBUG e.workitem.internal.WorkItemsRemoteSnapshotService - ETL: Time Fetching Data: 34 seconds
2017-10-24 00:35:48,036 [jazz: AsynchronousTaskRunner-0 @@ 00:23] DEBUG e.workitem.internal.WorkItemsRemoteSnapshotService - ETL: Time Running: 35 seconds
2017-10-24 00:35:48,036 [jazz: AsynchronousTaskRunner-0 @@ 00:23] DEBUG e.workitem.internal.WorkItemsRemoteSnapshotService - ETL: ***Finished Build WorkItemStateHistory at 24/10/17 0.35. The build was unsuccessful***
Thanks in advance.
Cheers.
Comments
It looks like something happening in database side. Do you see any error in derby.log?
Also please note
- ccm-etl.log is for RRDI (JavaETL). Are you still using it?
- Using Derby for DWH is supported only for small scale deployment or testing purpose. It might be that the ETL job is exceeding the capacity of Derby database.