Jazz CLM 6.0.6.1: RM: repotools-rm.sh: `CRJAZ2438E An error occurred while invoking the service https://host.domain.com:9443/rm/service/com.ibm.team.repository.service.internal.setup.IRegistrationHandlerService. The operation did not complete` resolution?
Hi,
I am running into an issue when attempting to run the repotools-rm setup for RM for CLM 6.0.6.1 via IM CLI on a single-server dev/test deployment topology on Linux. I receive the following (sanitized) error towards the end of the `repotools-rm.sh` setup:
`CRJAZ2438E An error occurred while invoking the service https://host.domain.com:9443/rm/service/com.ibm.team.repository.service.internal.setup.IRegistrationHandlerService The operation did not complete
Examining `/opt/IBM/JazzTeamServer/server/repotools-rm_setup.log` shows the following (again sanitized) exception:
2020-03-27 13:35:48,260 Repo Tools 2020-03-27 13:35:48,260 java.version=1.8.0_191 2020-03-27 13:35:48,260 java.runtime.version=8.0.5.25 - pxa6480sr5fp25-20181030_01(SR5 FP25) 2020-03-27 13:35:48,267 Provisioning using "./conf/rm/provision_profiles". [... 813 lines of various components listed as INSTALLED and RESOLVED [1] ...] 2020-03-27 13:39:36,828 CRJAZ2438E An error occurred while invoking the service https://host.domain.com:9443/rm/service/com.ibm.team.repository.service.internal.setup.IRegistrationHandlerService. com.ibm.team.repository.common.TeamRepositoryException: CRJAZ2594E An error occurred while executing request "https://host.domain.com:9443/rm/service/com.ibm.team.repository.service.internal.setup.IRegistrationHandlerService" at com.ibm.team.repository.service.internal.setup.processor.ScriptableSetupWizardProcessor.executeHttpRequest(ScriptableSetupWizardProcessor.java:1098) at com.ibm.team.repository.service.internal.setup.processor.ScriptableSetupWizardProcessor.executeHttpRequest(ScriptableSetupWizardProcessor.java:1104) at com.ibm.team.repository.service.internal.setup.processor.ScriptableSetupWizardProcessor.executeHttpRequest(ScriptableSetupWizardProcessor.java:1110) at com.ibm.team.repository.service.internal.setup.processor.ScriptableSetupWizardProcessor$AbstractServiceHandler.executeRequest(ScriptableSetupWizardProcessor.java:1318) at com.ibm.team.repository.service.internal.setup.processor.ScriptableSetupWizardProcessor$AbstractServiceHandler.execute(ScriptableSetupWizardProcessor.java:1303) at com.ibm.team.repository.service.internal.setup.processor.ScriptableSetupWizardProcessor$AbstractServiceHandler.doCall(ScriptableSetupWizardProcessor.java:1293) at com.ibm.team.repository.service.internal.setup.processor.ScriptableSetupWizardProcessor.invokeSetupService(ScriptableSetupWizardProcessor.java:968) at com.ibm.team.repository.service.internal.setup.processor.ScriptableSetupWizardProcessor.processServices(ScriptableSetupWizardProcessor.java:661) at com.ibm.team.repository.service.internal.setup.processor.ScriptableSetupWizardProcessor.executeSetupStep(ScriptableSetupWizardProcessor.java:646) at com.ibm.team.repository.service.internal.setup.processor.ScriptableSetupWizardProcessor.executeSteps(ScriptableSetupWizardProcessor.java:394) at com.ibm.team.repository.service.internal.setup.processor.ScriptableSetupWizardProcessor.process(ScriptableSetupWizardProcessor.java:373) at com.ibm.team.repository.service.internal.setup.processor.ScriptableSetupWizardProcessor.runSetup(ScriptableSetupWizardProcessor.java:232) at com.ibm.team.repotools.commands.remote.internal.SetupCommand.execute(SetupCommand.java:119) at com.ibm.team.repotools.command.AbstractCommand.execute(AbstractCommand.java:68) at com.ibm.team.repotools.rcp.internal.RepositoryToolsApplication.run(RepositoryToolsApplication.java:838) at com.ibm.team.repotools.rcp.internal.RepositoryToolsApplication.start(RepositoryToolsApplication.java:928) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:134) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:104) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:380) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:235) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:90) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55) at java.lang.reflect.Method.invoke(Method.java:508) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:648) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:603) at org.eclipse.equinox.launcher.Main.run(Main.java:1465) at org.eclipse.equinox.launcher.Main.main(Main.java:1438) Caused by: com.ibm.team.repository.common.transport.TeamServiceException: CRJAZ2942E A request from this server to another server could not be completed. The other server returned a 500 HTTP error with this error text: Internal Server Error. at com.ibm.team.repository.transport.client.RemoteTeamServer.throwHttpClientError(RemoteTeamServer.java:2226) at com.ibm.team.repository.transport.client.RemoteTeamServer.executeMethod(RemoteTeamServer.java:1404) at com.ibm.team.repository.transport.client.RemoteTeamServer.executeMethod(RemoteTeamServer.java:1221) at com.ibm.team.repository.transport.client.RestClientConnectionBase.executeMethod(RestClientConnectionBase.java:383) at com.ibm.team.repository.transport.client.RestClientConnectionBase.doMethod(RestClientConnectionBase.java:212) at com.ibm.team.repository.transport.client.RestClientConnectionBase.doPost(RestClientConnectionBase.java:166) at com.ibm.team.repository.transport.client.TeamRawRestServiceClient$RawRestClientConnection.doPost(TeamRawRestServiceClient.java:112) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:90) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55) at java.lang.reflect.Method.invoke(Method.java:508) at com.ibm.team.repository.client.internal.ServiceInterfaceProxy.invokeServiceCall(ServiceInterfaceProxy.java:254) at com.ibm.team.repository.client.internal.ServiceInterfaceProxy.invoke(ServiceInterfaceProxy.java:110) at com.ibm.team.repository.client.internal.RawRestServiceClientProxy$RestClientConnectionProxy.invoke(RawRestServiceClientProxy.java:121) at com.sun.proxy.$Proxy12.doPost(Unknown Source) at com.ibm.team.repotools.commands.remote.internal.SetupCommand$HttpClient.send(SetupCommand.java:529) at com.ibm.team.repotools.commands.remote.internal.SetupCommand$HttpClient.send(SetupCommand.java:507) at com.ibm.team.repository.service.internal.setup.processor.ScriptableSetupWizardProcessor.executeHttpRequest(ScriptableSetupWizardProcessor.java:1096) ... 28 more
[1] If helpful, the rest of the `repotools-rm.sh` debug log preceding the above error showing "INSTALLED" or "RESOLVED" components can be attached.
`/opt/IBM/JazzTeamServer/server/logs/rm.log` log shows the following possibly relevant info + (sanitized) exception:
2020-03-27 13:34:28,857 [ Launch callback handler] INFO nternal.app.servlet.util.ServletDispatchingHandler - CRJZS0315I Servlet Dispatching Enabled 2020-03-27 13:34:28,858 [ Launch callback handler] INFO nternal.app.servlet.util.ServletDispatchingHandler - CRJZS0318I Servlet Loopback Disabled 2020-03-27 13:34:40,199 [ Launch callback handler] INFO ing.server.core.repository.RepositoryAccessManager - Rational DOORS Next Generation is starting. Jazz Foundation - Core Libraries, Version 6.0.6.1 (RJF-SERVER-I20190326-1717) Rational DOORS Next Generation, Version 6.0.6.1 (RDNG6.0.6.1-I20190326_1835) 2020-03-27 13:34:40,199 [ Launch callback handler] INFO ing.server.core.repository.RepositoryAccessManager - CRRRS9938I Repository state is: INITIALIZING 2020-03-27 13:34:40,199 [ Launch callback handler] INFO ing.server.core.repository.RepositoryAccessManager - Server is running in JFS mode. 2020-03-27 13:36:11,114 [ Default Executor-thread-274] INFO nternal.OverridablePropertyFileServerConfiguration - To submit questions about issues, go to the Jazz.net forum at https://jazz.net/forum. To find more information about a message, see the online product documentation. 2020-03-27 13:36:11,115 [ Default Executor-thread-274] INFO nternal.OverridablePropertyFileServerConfiguration - CRJAZ1363I Loading the configuration from "file:/opt/IBM/JazzTeamServer/server/conf/rm/teamserver.properties". 2020-03-27 13:36:13,651 [ Default Executor-thread-274] INFO pository.service.internal.ServerDescriptionService - CRJAZ1778I This server is configured as an application. 2020-03-27 13:36:14,084 [ Default Executor-thread-274] INFO .repository.service.internal.rdb.ConnectionFactory - CRJAZ1365I The server is attempting to connect to the following database: "conf/rm/derby/repositoryDB" 2020-03-27 13:36:15,312 [ Default Executor-thread-274] INFO .repository.service.internal.rdb.ConnectionFactory - CRJAZ1364I The connection to the following database was successful: Db Product Name: Apache Derby Db Product Version: 10.10.2.0 - (1582446) Db URL: jdbc:derby:/opt/IBM/JazzTeamServer/server/conf/rm/derby/repositoryDB;create=true Jdbc Driver Name: Apache Derby Embedded JDBC Driver Jdbc Driver Version: 10.10.2.0 - (1582446) SchemaPrefix: 2020-03-27 13:36:21,124 [ Default Executor-thread-274] INFO rvice.mapping.internal.ServerRenameProgressService - CRJAZ2558I Setting the local server rename state to false and the openServerDescriptionServiceTemporarily state to false. 2020-03-27 13:36:21,221 [ Default Executor-thread-274] WARN pository.service.internal.ServerDescriptionService - CRJAZ1781W The Public URI Root has not been set. Use the server setup wizard to enter the public URI. This property is required to enforce consistent URL management in the application. The public URI represents the URL that all clients must use to access the application. 2020-03-27 13:36:21,333 [ Default Executor-thread-274] INFO com.ibm.rdm.fronting.server - CRRRS9302I IConfig loading. 2020-03-27 13:36:21,482 [ Default Executor-thread-274] INFO mapping.internal.GlobalServerRenameProgressService - CRJAZ2523I Setting the global server rename state to false and the validation state to false. 2020-03-27 13:36:24,275 [ Default Executor-thread-274] WARN com.ibm.team.repository.servlet.TeamServerServlet - CRJAZ1181W Security notice during initialization: Allowing ADMIN user access. It is recommended that you disable the ADMIN user and create a real user with administrative rights. 2020-03-27 13:36:24,276 [ Default Executor-thread-274] WARN com.ibm.team.repository.servlet.TeamServerServlet - CRJAZ2076I Product Details: Jazz Foundation - Core Libraries, Version 6.0.6.1 (RJF-SERVER-I20190326-1717) Rational DOORS Next Generation, Version 6.0.6.1 (RDNG6.0.6.1-I20190326_1835) [... several WARN-ings about "CRJAZ2333W" (auth being requested before server has been configured, assuming admin) and "CRJAZ1185W" (`cannot retrieve user "ADMIN" because repo is inaccessible, logging in as "ADMIN"`) ...] 2020-03-27 13:39:33,821 [Default Executor-thread-322 @@ 13:39 (unauthenticated) (com.ibm.team.repository.transport.client.restclientconnectionbase spnego-enabled@xxx.xxx.xxx.xxx="") /rm/service/com.ibm.team.repository.service.internal.IServerConfigurationRestService/configurationUpdates] WARN pository.service.internal.ServerDescriptionService - CRJAZ1781W The Public URI Root has not been set. Use the server setup wizard to enter the public URI. This property is required to enforce consistent URL management in the application. The public URI represents the URL that all clients must use to access the application. 2020-03-27 13:39:33,847 [Default Executor-thread-322 @@ 13:39 (unauthenticated) (com.ibm.team.repository.transport.client.restclientconnectionbase spnego-enabled@xxx.xxx.xxx.xxx="") /rm/service/com.ibm.team.repository.service.internal.IServerConfigurationRestService/configurationUpdates] INFO com.ibm.rdm.fronting.server - CRRRS9302I IConfig loading. [... a few more WARN-ings about "CRJAZ2333W" and "CRJAZ1185W" ...] 2020-03-27 13:39:36,813 [Default Executor-thread-584 @@ 13:39 (unauthenticated) (com.ibm.team.repository.transport.client.restclientconnectionbase spnego-enabled@xxx.xxx.xxx.xxx="") /rm/service/com.ibm.team.repository.service.internal.setup.IRegistrationHandlerService] ERROR .service.internal.setup.RegistrationHandlerService - Error handling registration request null com.ibm.team.repository.common.TeamRepositoryException: The Jazz Team Server URL configuration property must be set before invoking this service at com.ibm.team.repository.service.internal.setup.RegistrationHandlerService.finalizeAdminUser(RegistrationHandlerService.java:625) at com.ibm.team.repository.service.internal.setup.RegistrationHandlerService.perform_POST(RegistrationHandlerService.java:177) at com.ibm.team.repository.service.TeamRawService.service(TeamRawService.java:92) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:90) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55) at java.lang.reflect.Method.invoke(Method.java:508) at org.eclipse.soda.sat.core.internal.record.ExportProxyServiceRecord.invoke(ExportProxyServiceRecord.java:361) at org.eclipse.soda.sat.core.internal.record.ExportProxyServiceRecord.access$0(ExportProxyServiceRecord.java:347) at org.eclipse.soda.sat.core.internal.record.ExportProxyServiceRecord$ExportedServiceInvocationHandler.invoke(ExportProxyServiceRecord.java:56) at com.sun.proxy.$Proxy275.service(Unknown Source) at com.ibm.team.repository.servlet.AbstractTeamServerServlet.doRestService(AbstractTeamServerServlet.java:1122) at com.ibm.team.repository.servlet.AbstractTeamServerServlet.handleRequest2(AbstractTeamServerServlet.java:2827) at com.ibm.team.repository.servlet.AbstractTeamServerServlet.handleRequest(AbstractTeamServerServlet.java:2599) at com.ibm.team.repository.servlet.AbstractTeamServerServlet.access$0(AbstractTeamServerServlet.java:2584) at com.ibm.team.repository.servlet.AbstractTeamServerServlet$1.service(AbstractTeamServerServlet.java:268) at com.ibm.team.repository.service.internal.compatibility.auth.DelegatedAuthHandlerService$3$1.run(DelegatedAuthHandlerService.java:344) at com.ibm.team.repository.service.internal.TeamServiceContext.runAsAdmin(TeamServiceContext.java:268) at com.ibm.team.repository.service.internal.compatibility.auth.DelegatedAuthHandlerService$3.run(DelegatedAuthHandlerService.java:338) at com.ibm.team.repository.servlet.AbstractTeamServerServlet.handleAuthentication(AbstractTeamServerServlet.java:2271) at com.ibm.team.repository.servlet.AbstractTeamServerServlet.service(AbstractTeamServerServlet.java:1914) at javax.servlet.http.HttpServlet.service(HttpServlet.java:668) at org.eclipse.equinox.http.registry.internal.ServletManager$ServletWrapper.service(ServletManager.java:180) at org.eclipse.equinox.http.servlet.internal.ServletRegistration.service(ServletRegistration.java:61) at org.eclipse.equinox.http.servlet.internal.ProxyServlet.processAlias(ProxyServlet.java:128) at org.eclipse.equinox.http.servlet.internal.ProxyServlet.service(ProxyServlet.java:76) at javax.servlet.http.HttpServlet.service(HttpServlet.java:668) at org.eclipse.equinox.servletbridge.BridgeServlet.service(BridgeServlet.java:152) at com.ibm.team.repository.server.servletbridge.JazzServlet.service(JazzServlet.java:199) at javax.servlet.http.HttpServlet.service(HttpServlet.java:668) at com.ibm.ws.webcontainer.servlet.ServletWrapper.service(ServletWrapper.java:1255) at com.ibm.ws.webcontainer.servlet.ServletWrapper.handleRequest(ServletWrapper.java:743) at com.ibm.ws.webcontainer.servlet.ServletWrapper.handleRequest(ServletWrapper.java:440) at com.ibm.ws.webcontainer.filter.WebAppFilterChain.invokeTarget(WebAppFilterChain.java:182) at com.ibm.ws.webcontainer.filter.WebAppFilterChain.doFilter(WebAppFilterChain.java:93) at com.ibm.team.repository.server.servletbridge.BridgeFilter.processDelegate(BridgeFilter.java:176) at com.ibm.team.repository.server.servletbridge.BridgeFilter.doFilter(BridgeFilter.java:210) at com.ibm.ws.webcontainer.filter.FilterInstanceWrapper.doFilter(FilterInstanceWrapper.java:201) at com.ibm.ws.webcontainer.filter.WebAppFilterChain.doFilter(WebAppFilterChain.java:90) at com.ibm.ws.webcontainer.filter.WebAppFilterManager.doFilter(WebAppFilterManager.java:996) at com.ibm.ws.webcontainer.filter.WebAppFilterManager.invokeFilters(WebAppFilterManager.java:1134) at com.ibm.ws.webcontainer.filter.WebAppFilterManager.invokeFilters(WebAppFilterManager.java:1005) at com.ibm.ws.webcontainer.servlet.CacheServletWrapper.handleRequest(CacheServletWrapper.java:75) at com.ibm.ws.webcontainer.WebContainer.handleRequest(WebContainer.java:927) at com.ibm.ws.webcontainer.osgi.DynamicVirtualHost$2.run(DynamicVirtualHost.java:279) at com.ibm.ws.http.dispatcher.internal.channel.HttpDispatcherLink$TaskWrapper.run(HttpDispatcherLink.java:1011) at com.ibm.ws.http.dispatcher.internal.channel.HttpDispatcherLink.wrapHandlerAndExecute(HttpDispatcherLink.java:414) at com.ibm.ws.http.dispatcher.internal.channel.HttpDispatcherLink.ready(HttpDispatcherLink.java:373) at com.ibm.ws.http.channel.internal.inbound.HttpInboundLink.handleDiscrimination(HttpInboundLink.java:532) at com.ibm.ws.http.channel.internal.inbound.HttpInboundLink.handleNewRequest(HttpInboundLink.java:466) at com.ibm.ws.http.channel.internal.inbound.HttpInboundLink.processRequest(HttpInboundLink.java:331) at com.ibm.ws.http.channel.internal.inbound.HttpICLReadCallback.complete(HttpICLReadCallback.java:70) at com.ibm.ws.channel.ssl.internal.SSLReadServiceContext$SSLReadCompletedCallback.complete(SSLReadServiceContext.java:1803) at com.ibm.ws.tcpchannel.internal.WorkQueueManager.requestComplete(WorkQueueManager.java:501) at com.ibm.ws.tcpchannel.internal.WorkQueueManager.attemptIO(WorkQueueManager.java:571) at com.ibm.ws.tcpchannel.internal.WorkQueueManager.workerRun(WorkQueueManager.java:926) at com.ibm.ws.tcpchannel.internal.WorkQueueManager$Worker.run(WorkQueueManager.java:1015) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1160) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) at java.lang.Thread.run(Thread.java:812) </com.ibm.team.repository.transport.client.restclientconnectionbase></unauthenticated></com.ibm.team.repository.transport.client.restclientconnectionbase></unauthenticated></com.ibm.team.repository.transport.client.restclientconnectionbase></unauthenticated>
Post-installation (sanitized) command (run from `/opt/IBM/JazzTeamServer/server`) was:
$ sudo -u dng ./repotools-rm.sh -setup repositoryURL=https://host.domain.com:9443/rm adminUserID=ADMIN adminPassword=ADMIN
Note1, we have created a separate `dng` user & group that owns the entire `/opt/IBM` dir
Note2, firewalld is configured with a service definition allowing 9443 + other ports. As a test I was able to hit the above URL in a browser but got the above error message too I believe.
I have searched this forum (& Google) and cannot not find any reference to this error.
Questions:
- What is the cause of this? and how can it be resolved? Also...
- Is JTS required for all this to work for an installation that only consists of RM + Jazz Authorization server? or is it optional? (the installation guide at https://www.ibm.com/support/knowledgecenter/SSYMRC_6.0.6/com.ibm.jazz.install.doc/topics/interactive_guides.html seemed to allow one to leave it unselected when generating the documentation so I'm assuming it's only needed when installing multiple CLM components)
*Environment Summary*:
- *Topology*: single server dev/test deployment
- *OS + Software Versions*: Linux CentOS [1] v7.5.1804 + IBM Rational Jazz.net CLM 6.0.6.1 (RM only + Apache Derby + Jazz Authorization Server) via Installation Manager (IM)
[1] I realize CentOS isn't officially listed as a supported OS but it is binary-compatible rebuild of RH, with the only difference being logos and RH ™s being removed. Seeing how we have another working CentOS installation with CLM 6.0.2 on it, I don't think this is the issue.
Please let me know if any additional details or log files needed
Thanks and any help appreciated!
--
B
One answer
Hi
No JTS is not optional in the sense that you must have *one* JTS in a deployment, so omitting it is most likely the cause of this problem - you should uninstall everything, delete the folder you attempted to install into, and start again.
The reason JTS is "optional" in Installation Manager is so it's possible to install just a single app like an rm2, and of course this is needed for enterprise deployments when the apps are each on their own Liberty/server.. See for example the enterprise topology here https://jazz.net/wiki/bin/view/Deployment/StandardTopologiesOverview
I've tried creating some install instructions for just RM and I don't see any reference to repotools-rm, only to repotools-jts, so I guess you were going a bit off-piste: when it says repotools-jts it means repotools-jts. The instructions also say "Prior to running the setup command, you must have installed the Jazz Team Server and any CLM applications, created your databases, and deployed and started the applications on your application server." which is telling you that you must have previously installed JTS.
BTW If you might create a support case for this server at any time in the future, you should be on a supported OS.
HTH
Ian
Comments
Hi Ian,
Thanks for the response. I will try your suggestion but still am a bit puzzled why the Interactive Installation Guide would allow one to generate instructions w/o JTS if it is required for all deployment topologies? https://www.ibm.com/support/knowledgecenter/SSYMRC_6.0.6/com.ibm.jazz.install.doc/topics/interactive_guides.html (would post screenshot showing how JTS is shown as optional but don't have enough "reputation")
Thanks,
--
B
"A" JTS is required for all deployments, but you can install Liberty+another app on a different server and register the 'another' app to that one JTS. See for example the enterprise topology here https://jazz.net/wiki/bin/view/Deployment/StandardTopologiesOverview hence the installation guide handles the situation where you are installing an app without JTS, but the install always requires a previously installed JTS in the later steps of setup, to run /jts/setup
I've updated the wording/detail in my answer to reflect the above comments.
Comments
B M
Apr 22 '20, 8:37 a.m.So anyone have any thoughts/suggestions on this?