Failed SVN dump import with error msg "deferred operation failed"
Hi,
I am trying to migrate SVN source data to RTC by using the svn dump file. Our svn dump file is huge (19G) and contains a lot of revisions (close to 80k). Ran into the following error on importing one directory.
"An error occurred importing 'Revision 28233'...: deferred operation failed"
Here is the data of the revision 28233 -
Node-path: XD/releases/6.1.0And, here is the revision 28232 -
Node-kind: dir
Node-action: add
Node-copyfrom-rev: 28232
Node-copyfrom-path: XD/releases/current
Node-path: XD/releases/6.1.0Apparently someone removed the main path XD/releases/current then copied the path XD/releases/current back down to XD/releases/current. In the meantime, there is no path XD/releases/current in the svn repository today.
Node-action: delete
I tried to remove both 28232 and 28233 revisions in the dump file, but it caused problem when other revisions references the revision 28233.
Any one has an idea/suggestion how to handle this situation? Thanks a lot.
James
Accepted answer
If you look in your Error log view in the RTC Eclipse client, you should find a complete stacktrace for the error. That may reveal more details about what could be wrong.
Comments
Michael,
Thanks for your response. Here is the log that I found in the .log file. Please let me know where I should go from here. Thanks a lot.
!ENTRY com.ibm.team.scm.client.importz.svn 4 0 2012-09-22 02:11:54.197
!MESSAGE An error occurred importing 'Revision 28233: [xdbuild@us.ibm.com] (1/29/08 12:53 AM) bug 11189: Merging current containing 6.1.0.1 back down to 6.1.0 stream': Deferred operation failed
!STACK 0
com.ibm.team.repository.common.TeamRepositoryException: An error occurred importing 'Revision 28233: [xdbuild@us.ibm.com] (1/29/08 12:53 AM) bug 11189: Merging current containing 6.1.0.1 back down to 6.1.0 stream': Deferred operation failed
at com.ibm.team.scm.client.importz.internal.ChangeSetArchiveImporter.importChangeSetArchive(ChangeSetArchiveImporter.java:343)
at com.ibm.team.scm.client.importz.internal.ImportArchiveOperation.doImport(ImportArchiveOperation.java:132)
at com.ibm.team.scm.client.importz.internal.ImportArchiveOperation.run(ImportArchiveOperation.java:80)
at com.ibm.team.scm.client.importz.internal.ImportArchiveOperation.performImport(ImportArchiveOperation.java:227)
at com.ibm.team.scm.client.importz.internal.ui.ImportOperation.importIntoWorkspace(ImportOperation.java:186)
at com.ibm.team.scm.client.importz.svn.internal.ui.SVNDumpFileImportOperation.importIntoWorkspace(SVNDumpFileImportOperation.java:135)
at com.ibm.team.scm.client.importz.internal.ui.ImportOperation.repositoryRun(ImportOperation.java:116)
at com.ibm.team.repository.rcp.ui.operations.RepositoryOperation.run(RepositoryOperation.java:43)
at com.ibm.team.repository.rcp.ui.operations.JobRunner.run(JobRunner.java:240)
at com.ibm.team.repository.rcp.ui.operations.JobRunner$1.run(JobRunner.java:63)
at org.eclipse.core.internal.jobs.Worker.run(Worker.java:54)
Caused by: com.ibm.team.repository.common.InternalRepositoryException: Deferred operation failed
at com.ibm.team.repository.service.internal.RdbRepositoryDataMediator.preCommitNotify(RdbRepositoryDataMediator.java:1628)
at com.ibm.team.repository.service.internal.rdb.RepositoryDatabase$WriteExclusiveTransaction.completeTransaction(RepositoryDatabase.java:656)
at com.ibm.team.repository.service.internal.rdb.RepositoryDatabase$Transaction.finishTransaction(RepositoryDatabase.java:492)
at com.ibm.team.repository.service.internal.rdb.RepositoryDatabase$1.run(RepositoryDatabase.java:286)
at com.ibm.team.repository.service.internal.rdb.ConnectionPoolService.withCurrentConnection(ConnectionPoolService.java:379)
at sun.reflect.GeneratedMethodAccessor70.invoke(null)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:618)
at org.eclipse.soda.sat.core.internal.record.ExportProxyServiceRecord.invoke(ExportProxyServiceRecord.java:370)
at org.eclipse.soda.sat.core.internal.record.ExportProxyServiceRecord.access$0(ExportProxyServiceRecord.java:356)
at org.eclipse.soda.sat.core.internal.record.ExportProxyServiceRecord$ExportedServiceInvocationHandler.invoke(ExportProxyServiceRecord.java:56)
at $Proxy61.withCurrentConnection(null)
at com.ibm.team.repository.service.internal.rdb.RepositoryDatabase.runTransaction(RepositoryDatabase.java:281)
at com.ibm.team.repository.service.internal.rdb.RepositoryDatabase.runInTransaction(RepositoryDatabase.java:236)
at com.ibm.team.repository.service.internal.TransactionService.runInTransaction(TransactionService.java:119)
at sun.reflect.GeneratedMethodAccessor159.invoke(null)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:618)
at org.eclipse.soda.sat.core.internal.record.ExportProxyServiceRecord.invoke(ExportProxyServiceRecord.java:370)
at org.eclipse.soda.sat.core.internal.record.ExportProxyServiceRecord.access$0(ExportProxyServiceRecord.java:356)
at org.eclipse.soda.sat.core.internal.record.ExportProxyServiceRecord$ExportedServiceInvocationHandler.invoke(ExportProxyServiceRecord.java:56)
at $Proxy99.runInTransaction(null)
at com.ibm.team.scm.service.internal.AbstractScmService.runInTransaction(AbstractScmService.java:342)
at com.ibm.team.scm.service.internal.AbstractScmService.runInTransaction(AbstractScmService.java:564)
at com.ibm.team.scm.service.internal.interop.ScmImportService.doImport(ScmImportService.java:120)
at com.ibm.team.scm.service.internal.interop.ScmImportService.importChangeSet(ScmImportService.java:105)
at sun.reflect.GeneratedMethodAccessor473.invoke(null)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:618)
at org.eclipse.soda.sat.core.internal.record.ExportProxyServiceRecord.invoke(ExportProxyServiceRecord.java:370)
at org.eclipse.soda.sat.core.internal.record.ExportProxyServiceRecord.access$0(ExportProxyServiceRecord.java:356)
at org.eclipse.soda.sat.core.internal.record.ExportProxyServiceRecord$ExportedServiceInvocationHandler.invoke(ExportProxyServiceRecord.java:56)
at $Proxy971.importChangeSet(null)
at sun.reflect.GeneratedMethodAccessor473.invoke(null)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:618)
at com.ibm.team.repository.servlet.AbstractTeamServerServlet.handleMethod(AbstractTeamServerServlet.java:1285)
at com.ibm.team.repository.servlet.AbstractTeamServerServlet.executeMethod(AbstractTeamServerServlet.java:882)
at com.ibm.team.repository.servlet.AbstractTeamServerServlet.doPost(AbstractTeamServerServlet.java:672)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:647)
at com.ibm.team.repository.servlet.AbstractTeamServerServlet.handleRequest2(AbstractTeamServerServlet.java:1871)
at com.ibm.team.repository.servlet.AbstractTeamServerServlet.handleRequest(AbstractTeamServerServlet.java:1725)
at com.ibm.team.repository.servlet.AbstractTeamServerServlet.access$0(AbstractTeamServerServlet.java:1710)
at com.ibm.team.repository.servlet.AbstractTeamServerServlet$1.service(AbstractTeamServerServlet.java:198)
at com.ibm.team.repository.internal.service.auth.impl.JAuthHandler.handleRequest(JAuthHandler.java:95)
at sun.reflect.GeneratedMethodAccessor213.invoke(null)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:618)
at org.eclipse.soda.sat.core.internal.record.ExportProxyServiceRecord.invoke(ExportProxyServiceRecord.java:370)
at org.eclipse.soda.sat.core.internal.record.ExportProxyServiceRecord.access$0(ExportProxyServiceRecord.java:356)
at org.eclipse.soda.sat.core.internal.record.ExportProxyServiceRecord$ExportedServiceInvocationHandler.invoke(ExportProxyServiceRecord.java:56)
at $Proxy547.handleRequest(null)
at com.ibm.team.repository.servlet.AbstractTeamServerServlet.service(AbstractTeamServerServlet.java:1578)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:729)
at org.eclipse.equinox.http.registry.internal.ServletManager$ServletWrapper.service(ServletManager.java:180)
at org.eclipse.equinox.http.servlet.internal.ServletRegistration.handleRequest(ServletRegistration.java:90)
at org.eclipse.equinox.http.servlet.internal.ProxyServlet.processAlias(ProxyServlet.java:111)
at org.eclipse.equinox.http.servlet.internal.ProxyServlet.service(ProxyServlet.java:75)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:729)
at org.eclipse.equinox.servletbridge.BridgeServlet.service(BridgeServlet.java:120)
at com.ibm.team.repository.server.servletbridge.JazzServlet.service(JazzServlet.java:76)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:729)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:269)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:188)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:213)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:172)
at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:563)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:117)
at org.apache.catalina.authenticator.SingleSignOn.invoke(SingleSignOn.java:420)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:108)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:174)
at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:879)
at org.apache.coyote.http11.Http11BaseProtocol$Http11ConnectionHandler.processConnection(Http11BaseProtocol.java:665)
at org.apache.tomcat.util.net.PoolTcpEndpoint.processSocket(PoolTcpEndpoint.java:528)
at org.apache.tomcat.util.net.LeaderFollowerWorkerThread.runIt(LeaderFollowerWorkerThread.java:81)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:689)
at java.lang.Thread.run(Thread.java:811)
at com.ibm.team.repository.common.internal.marshal.util.MarshallerUtil.decodeExceptions(MarshallerUtil.java:326)
at com.ibm.team.repository.common.internal.marshal.util.MarshallerUtil.decodeExceptions(MarshallerUtil.java:296)
at com.ibm.team.repository.common.internal.marshal.util.MarshallerUtil.decodeFault(MarshallerUtil.java:261)
at com.ibm.team.repository.transport.client.RemoteTeamService.constructExceptionFromFault(RemoteTeamService.java:622)
at com.ibm.team.repository.transport.client.RemoteTeamService.executeMethod(RemoteTeamService.java:497)
at com.ibm.team.repository.transport.client.RemoteTeamService.invoke(RemoteTeamService.java:202)
at com.ibm.team.repository.transport.client.ServiceInvocationHandler.invoke(ServiceInvocationHandler.java:43)
at $Proxy32.importChangeSet(Unknown Source)
at sun.reflect.GeneratedMethodAccessor67.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:37)
at java.lang.reflect.Method.invoke(Method.java:611)
at com.ibm.team.repository.client.internal.ServiceInterfaceProxy.invokeServiceCall(ServiceInterfaceProxy.java:164)
at com.ibm.team.repository.client.internal.ServiceInterfaceProxy.invoke(ServiceInterfaceProxy.java:88)
at $Proxy32.importChangeSet(Unknown Source)
at sun.reflect.GeneratedMethodAccessor67.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:37)
at java.lang.reflect.Method.invoke(Method.java:611)
at com.ibm.team.scm.client.internal.ScmServiceInterfaceProxy$2.run(ScmServiceInterfaceProxy.java:168)
at com.ibm.team.repository.client.internal.TeamRepository$3.run(TeamRepository.java:1261)
at com.ibm.team.repository.common.transport.CancelableCaller.call(CancelableCaller.java:79)
at com.ibm.team.repository.client.internal.TeamRepository.callCancelableService(TeamRepository.java:1254)
at com.ibm.team.scm.client.internal.ScmClientLibraryContext.callCancelableService(ScmClientLibraryContext.java:70)
at com.ibm.team.scm.client.internal.ScmServiceInterfaceProxy.invokeCancelableService(ScmServiceInterfaceProxy.java:164)
at com.ibm.team.scm.client.internal.ScmServiceInterfaceProxy.invoke(ScmServiceInterfaceProxy.java:92)
at $Proxy32.importChangeSet(Unknown Source)
at com.ibm.team.scm.client.internal.WorkspaceConnection.importChangeSet(WorkspaceConnection.java:3324)
at com.ibm.team.scm.client.internal.WorkspaceConnection$2.importChangeSet(WorkspaceConnection.java:3245)
at com.ibm.team.scm.client.importz.internal.ChangeSetArchiveImporter.commitChangesFromMap(ChangeSetArchiveImporter.java:871)
at com.ibm.team.scm.client.importz.internal.ChangeSetArchiveImporter.commitChanges(ChangeSetArchiveImporter.java:585)
at com.ibm.team.scm.client.importz.internal.ChangeSetArchiveImporter.importChangeSetArchive(ChangeSetArchiveImporter.java:332)
... 10 more
Caused by: com.ibm.team.repository.common.TeamRepositoryException: deferred save failed
at com.ibm.team.repository.service.internal.RdbRepositoryDataMediator.saveItemInTxn(RdbRepositoryDataMediator.java:503)
at com.ibm.team.scm.service.internal.ScmServiceInternal.internalSaveVersionable(ScmServiceInternal.java:1715)
at com.ibm.team.scm.service.internal.ScmServiceInternal.internalSaveVersionables(ScmServiceInternal.java:1666)
at com.ibm.team.scm.service.internal.operations.commit.CommitOperation.saveVersionables(CommitOperation.java:368)
at com.ibm.team.scm.service.internal.operations.commit.CommitOperation.initializeSaves(CommitOperation.java:1252)
at com.ibm.team.scm.service.internal.operations.commit.CommitOperation.initialize(CommitOperation.java:429)
at com.ibm.team.scm.service.internal.operations.commit.CommitOperation.run(CommitOperation.java:231)
at com.ibm.team.scm.service.internal.interop.ScmImportService$1.run(ScmImportService.java:139)
at com.ibm.team.scm.service.internal.AbstractScmService$3.run(AbstractScmService.java:574)
at com.ibm.team.repository.service.internal.rdb.RepositoryDatabase$Transaction.run(RepositoryDatabase.java:458)
at com.ibm.team.repository.service.internal.rdb.RepositoryDatabase$1.run(RepositoryDatabase.java:285)
... 114 more
Caused by: com.ibm.team.repository.common.InternalRepositoryException: CRJAZ0329I SQL statement execution failedSQL: Insert Into {REPOSITORY.ITEM_STATES} ({ITEM_UUID}, {KEY_UUID}, {MODIFIED}, {ITEM_TYPE_DBID}, {VAL_ENCODING}, {ITEM_VALUE}) VALUES (?, ?, ?, ?, ?, ?)
SQL Exception #1
SQL Message: [jcc][t4][102][10040][3.57.82] Batch failure. The batch was submitted, but at least one exception occurred on an individual member of the batch.
Use getNextException() to retrieve the exceptions for specific batched elements. ERRORCODE=-4228, SQLSTATE=null
SQL State: null
Error Code: -4228
SQL Exception #2
SQL Message: Error for batch element #512: [jcc][t4][1026][11339][3.57.82] Bug check exception thrown due to an internal JCC error. Please contact support. Message text: {0} ERRORCODE=-4228, SQLSTATE=null
SQL State: null
Error Code: -4228
Class: com.ibm.team.repository.service.internal.dataaccess.DocumentMediatorService$InsertLOBRow
Item Handle: com.ibm.team.filesystem.common.internal.impl.FileItemImpl@6edd6edd (stateId: [UUID _qdZzEgRzEeKKg8zhhr8TTQ], itemId: [UUID _0B15kAR6EeKbKsgKpYakMA], origin: <unset>, immutable: true) (contextId: [UUID _Dp6kMdwTEd2jUupDpQV1Rw], modified: 2012-09-22 07:10:15.599, workingCopy: false) (name: mws_main_new_odr.html, parentId: [UUID _z7D8IAR6EeKbKsgKpYakMA]) (executable: false)
at com.ibm.team.repository.service.internal.dataaccess.BatchingRowReceiver.createIRE(BatchingRowReceiver.java:419)
at com.ibm.team.repository.service.internal.dataaccess.BatchingRowReceiver.createIRE(BatchingRowReceiver.java:428)
at com.ibm.team.repository.service.internal.dataaccess.AbstractRow.handleExecuteException(AbstractRow.java:324)
at com.ibm.team.repository.service.internal.dataaccess.BatchingRowReceiver.jdbcSupportedBatch(BatchingRowReceiver.java:331)
at com.ibm.team.repository.service.internal.dataaccess.BatchingRowReceiver.executeBatch(BatchingRowReceiver.java:268)
at com.ibm.team.repository.service.internal.dataaccess.BatchingRowReceiver.execute(BatchingRowReceiver.java:196)
at com.ibm.team.repository.service.internal.dataaccess.IRowReceiver$IRowReceiverLocator.executePendingChanges(IRowReceiver.java:143)
at com.ibm.team.repository.service.internal.dataaccess.IRowReceiver$IRowReceiverLocator.executePendingChanges(IRowReceiver.java:121)
at com.ibm.team.repository.service.internal.RdbRepositoryDataMediator.preCommitNotify(RdbRepositoryDataMediator.java:1601)
at com.ibm.team.repository.service.internal.rdb.RepositoryDatabase$WriteExclusiveTransaction.completeTransaction(RepositoryDatabase.java:656)
at com.ibm.team.repository.service.internal.rdb.RepositoryDatabase$Transaction.finishTransaction(RepositoryDatabase.java:492)
at com.ibm.team.repository.service.internal.rdb.RepositoryDatabase$1.run(RepositoryDatabase.java:286)
... 114 more
Caused by: java.sql.SQLException: [jcc][t4][102][10040][3.57.82] Batch failure. The batch was submitted, but at least one exception occurred on an individual member of the batch.
Use getNextException() to retrieve the exceptions for specific batched elements. ERRORCODE=-4228, SQLSTATE=null
at com.ibm.db2.jcc.am.bd.a(bd.java:404)
at com.ibm.db2.jcc.am.p.a(p.java:353)
at com.ibm.db2.jcc.am.lm.a(lm.java:3998)
at com.ibm.db2.jcc.am.lm.c(lm.java:3785)
at com.ibm.db2.jcc.am.lm.executeBatch(lm.java:2257)
at com.ibm.team.repository.service.internal.db.jdbcwrappers.stat.StatementStatWrapper.executeBatch(StatementStatWrapper.java:185)
at com.ibm.team.repository.service.internal.db.jdbcwrappers.errlog.StatementErrLogWrapper.executeBatch(StatementErrLogWrapper.java:180)
at com.ibm.team.repository.service.internal.db.jdbcwrappers.leak.StatementLeakWrapper.executeBatch(StatementLeakWrapper.java:74)
at com.ibm.team.repository.service.internal.dataaccess.BatchingRowReceiver.jdbcSupportedBatch(BatchingRowReceiver.java:322)
... 122 more
Caused by: java.sql.SQLException: Error for batch element #512: [jcc][t4][1026][11339][3.57.82] Bug check exception thrown due to an internal JCC error. Please contact support. Message text: {0} ERRORCODE=-4228, SQLSTATE=null
at com.ibm.db2.jcc.am.bd.a(bd.java:528)
at com.ibm.db2.jcc.am.bd.a(bd.java:545)
at com.ibm.db2.jcc.t4.db.a(db.java:448)
at com.ibm.db2.jcc.t4.db.a(db.java:68)
at com.ibm.db2.jcc.t4.t.a(t.java:57)
at com.ibm.db2.jcc.t4.tb.a(tb.java:223)
at com.ibm.db2.jcc.am.lm.a(lm.java:2698)
at com.ibm.db2.jcc.am.lm.b(lm.java:4356)
at com.ibm.db2.jcc.am.lm.a(lm.java:3935)
... 128 more
This looks more like a general failure involving DB2 than a specific failure in the importer. What version of DB2 are you using? Are you able to perform standard operations in RTC independently of the importer (e.g. can you check-in file changes, deliver, ect.)? If you attempt to resume the import, do you get the same error?
Hi Michael,
Thanks again. I am checking with the RTC admin about the DB2 version, and have not got an answer yet.
I can perform RTP operations, even to import other streams from the same dump. It seems to me this trunk that I am having problem with is one of the biggest section with a lot of changes on it.
I can reproduce the problem, but sometime occurs on another (earlier) revision. Here is the another revision it stopped.
Revision-number: 19725
Prop-content-length: 205
Content-length: 205
K 7
svn:log
V 91
bug 7825: fixing inconsistency in the build system with svn locations not matching projects
K 10
svn:author
V 18
xdbuild@us.ibm.com
K 8
svn:date
V 27
2007-04-23T20:46:56.869662Z
PROPS-END
Node-path: XD/releases/6.1.0
Node-kind: dir
Node-action: add
Node-copyfrom-rev: 19724
Node-copyfrom-path: XD/releases/6.1.0.0_ZOS
Node-path: XD/releases/6.1.0.0_ZOS
Node-action: delete
What should I do at this point? Any suggestion?
Thanks a lot.
James
I've never seen that type of DB2/SQL failure during an import. I suggest you log a defect report against RTC/Source Control and provide all the details you have provided in this forum post. Also, please include the stack trace for all the failures.