Welcome to the Jazz Community Forum
Restart the Syncronization Engine after log off
I was running a history code migration CC2RTC while I had to log off at a certain point (after a 5GB transfer). To my understanding this forced the synchronization engine to be stopped.
After re-login I checked the status in the tab ClearCaseSynchronize Stream. The process is still green, "In Progress" but it actually hangs as no updates are done since more than 7 hours.
The following error message I captured from Even Viewer after re-login:
2011-03-04-14.20.22.426000 Instance:DB2 Node:000
PID:2452(db2fmp.exe) TID:2896 Appid:none
Health Monitor HealthIndicator::update Probe:500
ADM10500E Health indicator "Monitor Heap Utilization" ("db2.mon_heap_util")
breached the "upper" alarm threshold of "95 %" with value "100 %" on "instance"
"DB2". Calculation: "((db2.mon_heap_cur_size/db2.mon_heap_max_size)*100);" =
"((327680 / 327680) * 100)" = "100 %". History (Timestamp, Value, Formula): "
(03/04/2011 14:15:21.455000, 20, ((65536 / 327680) * 100)), (03/04/2011
14:10:21.217000, 20, ((65536 / 327680) * 100)), (03/04/2011 14:05:21.573000, 20,
((65536 / 327680) * 100)), (03/04/2011 14:00:22.663000, 100, ((327680 / 327680)
* 100)), (03/04/2011 13:55:22.035000, 100, ((327680 / 327680) * 100)),
(03/04/2011 13:50:21.982000, 100, ((327680 / 327680) * 100)), (03/04/2011
13:45:21.450000, 100, ((327680 / 327680) * 100)), (03/04/2011 13:40:21.524000,
100, ((327680 / 327680) * 100)), (03/04/2011 13:35:22.021000, 100, ((327680 /
327680) * 100))"
I tried to kill the process from TaskManager/java.exe and to restart the synchronization (I've restarted the RTC server), got the following errors:
1. CRJAZ1371E The URL "https://localhost:9444/jazz/service/com.ibm.team.interop.common.service.IInteropService" cannot be reached. The server cannot be reached. The network could not connect to the server. The error is "Connection refused: connect". Contact your system administrator.
Connection refused: connect
2. ClearCase Connector Error Message: The following error occured while attempting to get sync engine status: Reason: Fetching ClearCase Connector Synchronization build engine "name_1" failed.
Shortly after this I got another error captured in the Event Viewer:
The description for Event ID ( 0 ) in Source ( sshd ) cannot be found. The local computer may not have the necessary registry information or message DLL files to display messages from a remote computer. You may be able to use the /AUXSOURCE= flag to retrieve this description; see Help and Support for details. The following information is part of the event: sshd: PID 4236: fatal: Read from socket failed: Connection reset by peer.
In several trials to restart the synchronization engine another build with the same name was created and marked in Red as completed. It lasted 24 second to get completed and here the log:
javax.wvcm.WvcmException: Property already set: INTEROP_STREAM_LOCKED
at com.ibm.team.connector.scm.client.JzRepoResource.putValue(JzRepoResource.java:836)
at com.ibm.team.connector.scm.client.JzRepoResource.storeCustomProperty(JzRepoResource.java:708)
at com.ibm.team.connector.scm.client.JzRepoResource.storeCustomProperty(JzRepoResource.java:651)
at com.ibm.team.connector.scm.client.JzRepoStream.setPropertyFromClient(JzRepoStream.java:257)
at com.ibm.rational.wvcm.ri.srvc.SrvcResource.doWriteProperties(SrvcResource.java:915)
at com.ibm.rational.wvcm.ri.srvc.SrvcProvider.writeUpdates(SrvcProvider.java:370)
at com.ibm.rational.wvcm.ri.srvc.SrvcResource.doUpdateProperties(SrvcResource.java:1500)
at com.ibm.rational.wvcm.ri.impl.WvcmServiceConverter.doUpdateProperties(WvcmServiceConverter.java:607)
at com.ibm.rational.wvcm.ri.impl.ResourceImpl.doReadProperties(ResourceImpl.java:196)
at com.ibm.rational.wvcm.interop.InteropStream.doReadProperty(InteropStream.java:395)
at com.ibm.rational.wvcm.interop.InteropStream.reserveInteropStream(InteropStream.java:627)
at com.ibm.rational.wvcm.interop.InteropStream.updateThisInitArgs(InteropStream.java:3669)
at com.ibm.team.connector.scm.cc.syncviabuild.BuildClientForCcSync.updateThisInitArgs(BuildClientForCcSync.java:1120)
at com.ibm.team.connector.scm.cc.syncviabuild.BuildClientForCcSync.updateThisInitArgs(BuildClientForCcSync.java:1042)
at com.ibm.team.connector.scm.cc.syncviabuild.BuildClientForCcSync.persistCurrentBuildResultId(BuildClientForCcSync.java:1359)
at com.ibm.team.connector.scm.operations.ConnectorOps.synchronizeStream(ConnectorOps.java:163)
at com.ibm.team.connector.scm.cli.AbstractCcConnectorSubCommand.synchronizeStream(AbstractCcConnectorSubCommand.java:184)
at com.ibm.team.connector.scm.cli.SyncSubcommand.synchronizeStream(SyncSubcommand.java:112)
at com.ibm.team.connector.scm.cli.SyncSubcommand.run(SyncSubcommand.java:74)
at com.ibm.team.filesystem.cli.core.internal.SubcommandLauncher.run(Unknown Source)
at com.ibm.team.filesystem.cli.core.internal.SubcommandLauncher.doStart(Unknown Source)
at com.ibm.team.filesystem.cli.core.internal.SubcommandLauncher.run(Unknown Source)
at com.ibm.team.filesystem.cli.core.internal.Application.start(Unknown Source)
at org.eclipse.equinox.internal.app.EclipseAppHandle.run(Unknown Source)
at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(Unknown Source)
at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(Unknown Source)
at org.eclipse.core.runtime.adaptor.EclipseStarter.run(Unknown Source)
at org.eclipse.core.runtime.adaptor.EclipseStarter.run(Unknown Source)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:79)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:618)
at org.eclipse.equinox.launcher.Main.invokeFramework(Unknown Source)
at org.eclipse.equinox.launcher.Main.basicRun(Unknown Source)
at org.eclipse.equinox.launcher.Main.run(Unknown Source)
An error which occured few days before the crash (captured on Server Logs\mvfs ) was: {9 pid/tid 614000015b0/892e5e9800000000} mvfs_common_create: error 24 EMFILE - flushing mappings state 0
I don't know how to restart the process from the point it crashed if this is possible and also don't know if the log off is the main cause of the problems I got.
Thank you
After re-login I checked the status in the tab ClearCaseSynchronize Stream. The process is still green, "In Progress" but it actually hangs as no updates are done since more than 7 hours.
The following error message I captured from Even Viewer after re-login:
2011-03-04-14.20.22.426000 Instance:DB2 Node:000
PID:2452(db2fmp.exe) TID:2896 Appid:none
Health Monitor HealthIndicator::update Probe:500
ADM10500E Health indicator "Monitor Heap Utilization" ("db2.mon_heap_util")
breached the "upper" alarm threshold of "95 %" with value "100 %" on "instance"
"DB2". Calculation: "((db2.mon_heap_cur_size/db2.mon_heap_max_size)*100);" =
"((327680 / 327680) * 100)" = "100 %". History (Timestamp, Value, Formula): "
(03/04/2011 14:15:21.455000, 20, ((65536 / 327680) * 100)), (03/04/2011
14:10:21.217000, 20, ((65536 / 327680) * 100)), (03/04/2011 14:05:21.573000, 20,
((65536 / 327680) * 100)), (03/04/2011 14:00:22.663000, 100, ((327680 / 327680)
* 100)), (03/04/2011 13:55:22.035000, 100, ((327680 / 327680) * 100)),
(03/04/2011 13:50:21.982000, 100, ((327680 / 327680) * 100)), (03/04/2011
13:45:21.450000, 100, ((327680 / 327680) * 100)), (03/04/2011 13:40:21.524000,
100, ((327680 / 327680) * 100)), (03/04/2011 13:35:22.021000, 100, ((327680 /
327680) * 100))"
I tried to kill the process from TaskManager/java.exe and to restart the synchronization (I've restarted the RTC server), got the following errors:
1. CRJAZ1371E The URL "https://localhost:9444/jazz/service/com.ibm.team.interop.common.service.IInteropService" cannot be reached. The server cannot be reached. The network could not connect to the server. The error is "Connection refused: connect". Contact your system administrator.
Connection refused: connect
2. ClearCase Connector Error Message: The following error occured while attempting to get sync engine status: Reason: Fetching ClearCase Connector Synchronization build engine "name_1" failed.
Shortly after this I got another error captured in the Event Viewer:
The description for Event ID ( 0 ) in Source ( sshd ) cannot be found. The local computer may not have the necessary registry information or message DLL files to display messages from a remote computer. You may be able to use the /AUXSOURCE= flag to retrieve this description; see Help and Support for details. The following information is part of the event: sshd: PID 4236: fatal: Read from socket failed: Connection reset by peer.
In several trials to restart the synchronization engine another build with the same name was created and marked in Red as completed. It lasted 24 second to get completed and here the log:
javax.wvcm.WvcmException: Property already set: INTEROP_STREAM_LOCKED
at com.ibm.team.connector.scm.client.JzRepoResource.putValue(JzRepoResource.java:836)
at com.ibm.team.connector.scm.client.JzRepoResource.storeCustomProperty(JzRepoResource.java:708)
at com.ibm.team.connector.scm.client.JzRepoResource.storeCustomProperty(JzRepoResource.java:651)
at com.ibm.team.connector.scm.client.JzRepoStream.setPropertyFromClient(JzRepoStream.java:257)
at com.ibm.rational.wvcm.ri.srvc.SrvcResource.doWriteProperties(SrvcResource.java:915)
at com.ibm.rational.wvcm.ri.srvc.SrvcProvider.writeUpdates(SrvcProvider.java:370)
at com.ibm.rational.wvcm.ri.srvc.SrvcResource.doUpdateProperties(SrvcResource.java:1500)
at com.ibm.rational.wvcm.ri.impl.WvcmServiceConverter.doUpdateProperties(WvcmServiceConverter.java:607)
at com.ibm.rational.wvcm.ri.impl.ResourceImpl.doReadProperties(ResourceImpl.java:196)
at com.ibm.rational.wvcm.interop.InteropStream.doReadProperty(InteropStream.java:395)
at com.ibm.rational.wvcm.interop.InteropStream.reserveInteropStream(InteropStream.java:627)
at com.ibm.rational.wvcm.interop.InteropStream.updateThisInitArgs(InteropStream.java:3669)
at com.ibm.team.connector.scm.cc.syncviabuild.BuildClientForCcSync.updateThisInitArgs(BuildClientForCcSync.java:1120)
at com.ibm.team.connector.scm.cc.syncviabuild.BuildClientForCcSync.updateThisInitArgs(BuildClientForCcSync.java:1042)
at com.ibm.team.connector.scm.cc.syncviabuild.BuildClientForCcSync.persistCurrentBuildResultId(BuildClientForCcSync.java:1359)
at com.ibm.team.connector.scm.operations.ConnectorOps.synchronizeStream(ConnectorOps.java:163)
at com.ibm.team.connector.scm.cli.AbstractCcConnectorSubCommand.synchronizeStream(AbstractCcConnectorSubCommand.java:184)
at com.ibm.team.connector.scm.cli.SyncSubcommand.synchronizeStream(SyncSubcommand.java:112)
at com.ibm.team.connector.scm.cli.SyncSubcommand.run(SyncSubcommand.java:74)
at com.ibm.team.filesystem.cli.core.internal.SubcommandLauncher.run(Unknown Source)
at com.ibm.team.filesystem.cli.core.internal.SubcommandLauncher.doStart(Unknown Source)
at com.ibm.team.filesystem.cli.core.internal.SubcommandLauncher.run(Unknown Source)
at com.ibm.team.filesystem.cli.core.internal.Application.start(Unknown Source)
at org.eclipse.equinox.internal.app.EclipseAppHandle.run(Unknown Source)
at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(Unknown Source)
at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(Unknown Source)
at org.eclipse.core.runtime.adaptor.EclipseStarter.run(Unknown Source)
at org.eclipse.core.runtime.adaptor.EclipseStarter.run(Unknown Source)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:79)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:618)
at org.eclipse.equinox.launcher.Main.invokeFramework(Unknown Source)
at org.eclipse.equinox.launcher.Main.basicRun(Unknown Source)
at org.eclipse.equinox.launcher.Main.run(Unknown Source)
An error which occured few days before the crash (captured on Server Logs\mvfs ) was: {9 pid/tid 614000015b0/892e5e9800000000} mvfs_common_create: error 24 EMFILE - flushing mappings state 0
I don't know how to restart the process from the point it crashed if this is possible and also don't know if the log off is the main cause of the problems I got.
Thank you
One answer
In general, you will need to fix any ClearCase errors you are seeing on
the sync host, because correct ClearCase operation is required for the
synchronizer to succeed (it just invokes cleartool commands).
The synchronizer locks a given stream while it is synchronizing, and if
there was some kind of hard crash of the hardware, or a forced kill of
the synchronization process, then the synchronized stream will often be
left in that locked state. In this case, there is an "unlock"
operation available in the ClearCase Properties page of the Synchronized
Stream Properties dialog box (this is documented in the on-line
documentation of the ClearCase Synchronizer).
Cheers,
Geoff
On 3/4/2011 4:38 PM, zvalsan wrote:
the sync host, because correct ClearCase operation is required for the
synchronizer to succeed (it just invokes cleartool commands).
The synchronizer locks a given stream while it is synchronizing, and if
there was some kind of hard crash of the hardware, or a forced kill of
the synchronization process, then the synchronized stream will often be
left in that locked state. In this case, there is an "unlock"
operation available in the ClearCase Properties page of the Synchronized
Stream Properties dialog box (this is documented in the on-line
documentation of the ClearCase Synchronizer).
Cheers,
Geoff
On 3/4/2011 4:38 PM, zvalsan wrote:
I was running a history code migration CC2RTC while I had to log off
at a certain point (after a 5GB transfer). To my understanding this
forced the synchronization engine to be stopped.
After re-login I checked the status in the tab ClearCaseSynchronize
Stream. The process is still green, "In Progress" but it
actually hangs as no updates are done since more than 7 hours.
The following error message I captured from Even Viewer after
re-login:
2011-03-04-14.20.22.426000 Instance:DB2 Node:000
PID:2452(db2fmp.exe) TID:2896 Appid:none
Health Monitor HealthIndicator::update Probe:500
ADM10500E Health indicator "Monitor Heap Utilization"
("db2.mon_heap_util")
breached the "upper" alarm threshold of "95 %"
with value "100 %" on "instance"
"DB2". Calculation:
"((db2.mon_heap_cur_size/db2.mon_heap_max_size)*100);" =
"((327680 / 327680) * 100)" = "100 %". History
(Timestamp, Value, Formula): "
(03/04/2011 14:15:21.455000, 20, ((65536 / 327680) * 100)),
(03/04/2011
14:10:21.217000, 20, ((65536 / 327680) * 100)), (03/04/2011
14:05:21.573000, 20,
((65536 / 327680) * 100)), (03/04/2011 14:00:22.663000, 100, ((327680
/ 327680)
* 100)), (03/04/2011 13:55:22.035000, 100, ((327680 / 327680) * 100)),
(03/04/2011 13:50:21.982000, 100, ((327680 / 327680) * 100)),
(03/04/2011
13:45:21.450000, 100, ((327680 / 327680) * 100)), (03/04/2011
13:40:21.524000,
100, ((327680 / 327680) * 100)), (03/04/2011 13:35:22.021000, 100,
((327680 /
327680) * 100))"
I tried to kill the process from TaskManager/java.exe and to restart
the synchronization (I've restarted the RTC server), got the
following errors:
1. CRJAZ1371E The URL
"https://localhost:9444/jazz/service/com.ibm.team.interop.common.service.IInteropService"
cannot be reached. The server cannot be reached. The network could not
connect to the server. The error is "Connection refused:
connect". Contact your system administrator.
Connection refused: connect
2. ClearCase Connector Error Message: The following error occured
while attempting to get sync engine status: Reason: Fetching
ClearCase Connector Synchronization build engine "name_1"
failed.
Shortly after this I got another error captured in the Event Viewer:
The description for Event ID ( 0 ) in Source ( sshd ) cannot be found.
The local computer may not have the necessary registry information or
message DLL files to display messages from a remote computer. You may
be able to use the /AUXSOURCE= flag to retrieve this description; see
Help and Support for details. The following information is part of
the event: sshd: PID 4236: fatal: Read from socket failed: Connection
reset by peer.
In several trials to restart the synchronization engine another build
with the same name was created and marked in Red as completed. It
lasted 24 second to get completed and here the log:
javax.wvcm.WvcmException: Property already set: INTEROP_STREAM_LOCKED
at
com.ibm.team.connector.scm.client.JzRepoResource.putValue(JzRepoResource.java:836)
at
com.ibm.team.connector.scm.client.JzRepoResource.storeCustomProperty(JzRepoResource.java:708)
at
com.ibm.team.connector.scm.client.JzRepoResource.storeCustomProperty(JzRepoResource.java:651)
at
com.ibm.team.connector.scm.client.JzRepoStream.setPropertyFromClient(JzRepoStream.java:257)
at
com.ibm.rational.wvcm.ri.srvc.SrvcResource.doWriteProperties(SrvcResource.java:915)
at
com.ibm.rational.wvcm.ri.srvc.SrvcProvider.writeUpdates(SrvcProvider.java:370)
at
com.ibm.rational.wvcm.ri.srvc.SrvcResource.doUpdateProperties(SrvcResource.java:1500)
at
com.ibm.rational.wvcm.ri.impl.WvcmServiceConverter.doUpdateProperties(WvcmServiceConverter.java:607)
at
com.ibm.rational.wvcm.ri.impl.ResourceImpl.doReadProperties(ResourceImpl.java:196)
at
com.ibm.rational.wvcm.interop.InteropStream.doReadProperty(InteropStream.java:395)
at
com.ibm.rational.wvcm.interop.InteropStream.reserveInteropStream(InteropStream.java:627)
at
com.ibm.rational.wvcm.interop.InteropStream.updateThisInitArgs(InteropStream.java:3669)
at
com.ibm.team.connector.scm.cc.syncviabuild.BuildClientForCcSync.updateThisInitArgs(BuildClientForCcSync.java:1120)
at
com.ibm.team.connector.scm.cc.syncviabuild.BuildClientForCcSync.updateThisInitArgs(BuildClientForCcSync.java:1042)
at
com.ibm.team.connector.scm.cc.syncviabuild.BuildClientForCcSync.persistCurrentBuildResultId(BuildClientForCcSync.java:1359)
at
com.ibm.team.connector.scm.operations.ConnectorOps.synchronizeStream(ConnectorOps.java:163)
at
com.ibm.team.connector.scm.cli.AbstractCcConnectorSubCommand.synchronizeStream(AbstractCcConnectorSubCommand.java:184)
at
com.ibm.team.connector.scm.cli.SyncSubcommand.synchronizeStream(SyncSubcommand.java:112)
at
com.ibm.team.connector.scm.cli.SyncSubcommand.run(SyncSubcommand.java:74)
at
com.ibm.team.filesystem.cli.core.internal.SubcommandLauncher.run(Unknown
Source)
at
com.ibm.team.filesystem.cli.core.internal.SubcommandLauncher.doStart(Unknown
Source)
at
com.ibm.team.filesystem.cli.core.internal.SubcommandLauncher.run(Unknown
Source)
at
com.ibm.team.filesystem.cli.core.internal.Application.start(Unknown
Source)
at org.eclipse.equinox.internal.app.EclipseAppHandle.run(Unknown
Source)
at
org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(Unknown
Source)
at
org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(Unknown
Source)
at org.eclipse.core.runtime.adaptor.EclipseStarter.run(Unknown
Source)
at org.eclipse.core.runtime.adaptor.EclipseStarter.run(Unknown
Source)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:79)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:618)
at org.eclipse.equinox.launcher.Main.invokeFramework(Unknown Source)
at org.eclipse.equinox.launcher.Main.basicRun(Unknown Source)
at org.eclipse.equinox.launcher.Main.run(Unknown Source)
An error which occured few days before the crash (captured on Server
Logs\mvfs ) was: {9 pid/tid 614000015b0/892e5e9800000000}
mvfs_common_create: error 24 EMFILE - flushing mappings state 0
I don't know how to restart the process from the point it crashed if
this is possible and also don't know if the log off is the main cause
of the problems I got.
Thank you