RQM - Error - CRJAZ1670E - While running RPT Scripts
Hi. When we try running RPT scripts on RQM, the following error appearing when we reach a load of 110 - 115 users.
We are not able to proceed with the test beyond this user load. Even though we have licenses for about 250 users.
Is there some configuration that needs to be changed to fix this ?
2014-07-21 18:22:37,827 [WebContainer : 30 @@ 18:17 <USERID> /jts/service/com.ibm.team.repository.service.internal.license.ILicenseExpirationRestService/licenseExpirationInfo] WARN very.internal.DiscoveredLicenseKeyExtensionService - CRJAZ1713W The license keys contributed by Applications could not be discovered. Some licenses contributed by the installed Applications might not be available. The nested exception should contain some more details about why the discovery failed.
java.io.IOException: An error occurred while making a discovery request to "https://rqm:9443/jts/discovery?type=http%3A%2F%2Fjazz.net%2Fxmlns%2Fprod%2Fjazz%2Fjfs%2F3.0%2FlicenseKeyProvider". The nested exception should contain more details.
at com.ibm.team.jfs.app.discovery.internal.DiscoveryHelper.executeServiceQuery(DiscoveryHelper.java:148)
at com.ibm.team.jfs.app.discovery.internal.DiscoveryHelper.getServices(DiscoveryHelper.java:81)
at com.ibm.team.jfs.license.discovery.internal.DiscoveredLicenseKeyExtensionService.getLicenseURIs(DiscoveredLicenseKeyExtensionService.java:256)
at com.ibm.team.jfs.license.discovery.internal.DiscoveredLicenseKeyExtensionService.getState(DiscoveredLicenseKeyExtensionService.java:633)
at com.ibm.team.jfs.license.discovery.internal.DiscoveredLicenseKeyExtensionService.getState(DiscoveredLicenseKeyExtensionService.java:628)
at sun.reflect.GeneratedMethodAccessor387.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:37)
at java.lang.reflect.Method.invoke(Method.java:611)
at org.eclipse.soda.sat.core.internal.record.ExportProxyServiceRecord.invoke(ExportProxyServiceRecord.java:361)
at org.eclipse.soda.sat.core.internal.record.ExportProxyServiceRecord.access$0(ExportProxyServiceRecord.java:347)
at org.eclipse.soda.sat.core.internal.record.ExportProxyServiceRecord$ExportedServiceInvocationHandler.invoke(ExportProxyServiceRecord.java:56)
at com.sun.proxy.$Proxy615.getState(Unknown Source)
at com.ibm.team.repository.service.internal.license.LicenseKeyContributorWithId.getState(LicenseKeyContributorWithId.java:28)
at com.ibm.team.repository.service.internal.license.LicenseService$3.runWithKeyContributors(LicenseService.java:436)
at com.ibm.team.repository.service.internal.license.LicenseService$3.runWithKeyContributors(LicenseService.java:1)
at com.ibm.team.repository.service.internal.license.LicenseCheckerService.withLicenseKeyContributors(LicenseCheckerService.java:170)
at sun.reflect.GeneratedMethodAccessor180.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:37)
at java.lang.reflect.Method.invoke(Method.java:611)
at org.eclipse.soda.sat.core.internal.record.ExportProxyServiceRecord.invoke(ExportProxyServiceRecord.java:361)
at org.eclipse.soda.sat.core.internal.record.ExportProxyServiceRecord.access$0(ExportProxyServiceRecord.java:347)
at org.eclipse.soda.sat.core.internal.record.ExportProxyServiceRecord$ExportedServiceInvocationHandler.invoke(ExportProxyServiceRecord.java:56)
at com.sun.proxy.$Proxy304.withLicenseKeyContributors(Unknown Source)
at com.ibm.team.repository.service.internal.license.LicenseService.loadLicenseState(LicenseService.java:416)
at com.ibm.team.repository.service.internal.license.LicenseService.updatePolicy(LicenseService.java:700)
at com.ibm.team.repository.service.internal.license.LicenseService.getLicenseTypes(LicenseService.java:1493)
at sun.reflect.GeneratedMethodAccessor525.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:37)
at java.lang.reflect.Method.invoke(Method.java:611)
at org.eclipse.soda.sat.core.internal.record.ExportProxyServiceRecord.invoke(ExportProxyServiceRecord.java:361)
at org.eclipse.soda.sat.core.internal.record.ExportProxyServiceRecord.access$0(ExportProxyServiceRecord.java:347)
at org.eclipse.soda.sat.core.internal.record.ExportProxyServiceRecord$ExportedServiceInvocationHandler.invoke(ExportProxyServiceRecord.java:56)
at com.sun.proxy.$Proxy617.getLicenseTypes(Unknown Source)
at com.ibm.team.repository.service.internal.license.jts.JtsLicenseService.getLicenseTypes(JtsLicenseService.java:131)
at sun.reflect.GeneratedMethodAccessor524.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:37)
at java.lang.reflect.Method.invoke(Method.java:611)
at org.eclipse.soda.sat.core.internal.record.ExportProxyServiceRecord.invoke(ExportProxyServiceRecord.java:361)
at org.eclipse.soda.sat.core.internal.record.ExportProxyServiceRecord.access$0(ExportProxyServiceRecord.java:347)
at org.eclipse.soda.sat.core.internal.record.ExportProxyServiceRecord$ExportedServiceInvocationHandler.invoke(ExportProxyServiceRecord.java:56)
at com.sun.proxy.$Proxy620.getLicenseTypes(Unknown Source)
at com.ibm.team.repository.service.internal.license.LicenseExpirationRestService.getLicenseExpirationInfo(LicenseExpirationRestService.java:50)
at com.ibm.team.repository.service.internal.license.LicenseExpirationRestService.perform_GET(LicenseExpirationRestService.java:40)
at com.ibm.team.repository.service.TeamRawService.service(TeamRawService.java:84)
at sun.reflect.GeneratedMethodAccessor273.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:37)
at java.lang.reflect.Method.invoke(Method.java:611)
at org.eclipse.soda.sat.core.internal.record.ExportProxyServiceRecord.invoke(ExportProxyServiceRecord.java:361)
at org.eclipse.soda.sat.core.internal.record.ExportProxyServiceRecord.access$0(ExportProxyServiceRecord.java:347)
at org.eclipse.soda.sat.core.internal.record.ExportProxyServiceRecord$ExportedServiceInvocationHandler.invoke(ExportProxyServiceRecord.java:56)
at com.sun.proxy.$Proxy664.service(Unknown Source)
at com.ibm.team.repository.servlet.AbstractTeamServerServlet.doRestService(AbstractTeamServerServlet.java:934)
at com.ibm.team.repository.servlet.AbstractTeamServerServlet.handleRequest2(AbstractTeamServerServlet.java:2351)
at com.ibm.team.repository.servlet.AbstractTeamServerServlet.handleRequest(AbstractTeamServerServlet.java:2155)
at com.ibm.team.repository.servlet.AbstractTeamServerServlet.service(AbstractTeamServerServlet.java:1983)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:668)
at org.eclipse.equinox.http.registry.internal.ServletManager$ServletWrapper.service(ServletManager.java:180)
at org.eclipse.equinox.http.servlet.internal.ServletRegistration.service(ServletRegistration.java:61)
at org.eclipse.equinox.http.servlet.internal.ProxyServlet.processAlias(ProxyServlet.java:126)
at org.eclipse.equinox.http.servlet.internal.ProxyServlet.service(ProxyServlet.java:76)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:668)
at org.eclipse.equinox.servletbridge.BridgeServlet.service(BridgeServlet.java:120)
at com.ibm.team.repository.server.servletbridge.JazzServlet.service(JazzServlet.java:68)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:668)
at com.ibm.ws.webcontainer.servlet.ServletWrapper.service(ServletWrapper.java:1227)
at com.ibm.ws.webcontainer.servlet.ServletWrapper.handleRequest(ServletWrapper.java:776)
at com.ibm.ws.webcontainer.servlet.ServletWrapper.handleRequest(ServletWrapper.java:458)
at com.ibm.ws.webcontainer.servlet.ServletWrapperImpl.handleRequest(ServletWrapperImpl.java:178)
at com.ibm.ws.webcontainer.filter.WebAppFilterChain.invokeTarget(WebAppFilterChain.java:136)
at com.ibm.ws.webcontainer.filter.WebAppFilterChain.doFilter(WebAppFilterChain.java:97)
at com.ibm.team.repository.server.servletbridge.BridgeFilter.processDelegate(BridgeFilter.java:139)
at com.ibm.team.repository.server.servletbridge.BridgeFilter.doFilter(BridgeFilter.java:172)
at com.ibm.ws.webcontainer.filter.FilterInstanceWrapper.doFilter(FilterInstanceWrapper.java:195)
at com.ibm.ws.webcontainer.filter.WebAppFilterChain.doFilter(WebAppFilterChain.java:91)
at com.ibm.ws.webcontainer.filter.WebAppFilterManager.doFilter(WebAppFilterManager.java:928)
at com.ibm.ws.webcontainer.filter.WebAppFilterManager.invokeFilters(WebAppFilterManager.java:1025)
at com.ibm.ws.webcontainer.servlet.CacheServletWrapper.handleRequest(CacheServletWrapper.java:87)
at com.ibm.ws.webcontainer.WebContainer.handleRequest(WebContainer.java:909)
at com.ibm.ws.webcontainer.WSWebContainer.handleRequest(WSWebContainer.java:1662)
at com.ibm.ws.webcontainer.channel.WCChannelLink.ready(WCChannelLink.java:200)
at com.ibm.ws.http.channel.inbound.impl.HttpInboundLink.handleDiscrimination(HttpInboundLink.java:459)
at com.ibm.ws.http.channel.inbound.impl.HttpInboundLink.handleNewRequest(HttpInboundLink.java:526)
at com.ibm.ws.http.channel.inbound.impl.HttpInboundLink.processRequest(HttpInboundLink.java:312)
at com.ibm.ws.http.channel.inbound.impl.HttpICLReadCallback.complete(HttpICLReadCallback.java:88)
at com.ibm.ws.ssl.channel.impl.SSLReadServiceContext$SSLReadCompletedCallback.complete(SSLReadServiceContext.java:1784)
at com.ibm.ws.tcp.channel.impl.AioReadCompletionListener.futureCompleted(AioReadCompletionListener.java:175)
at com.ibm.io.async.AbstractAsyncFuture.invokeCallback(AbstractAsyncFuture.java:217)
at com.ibm.io.async.AsyncChannelFuture.fireCompletionActions(AsyncChannelFuture.java:161)
at com.ibm.io.async.AsyncFuture.completed(AsyncFuture.java:138)
at com.ibm.io.async.ResultHandler.complete(ResultHandler.java:204)
at com.ibm.io.async.ResultHandler.runEventProcessingLoop(ResultHandler.java:775)
at com.ibm.io.async.ResultHandler$2.run(ResultHandler.java:905)
at com.ibm.ws.util.ThreadPool$Worker.run(ThreadPool.java:1862)
Caused by: javax.net.ssl.SSLPeerUnverifiedException: peer not authenticated
at com.ibm.jsse2.SSLSessionImpl.getPeerCertificates(SSLSessionImpl.java:41)
at org.apache.http.conn.ssl.AbstractVerifier.verify(AbstractVerifier.java:128)
at org.apache.http.conn.ssl.SSLSocketFactory.connectSocket(SSLSocketFactory.java:397)
at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:148)
at org.apache.http.impl.conn.AbstractPoolEntry.open(AbstractPoolEntry.java:149)
at org.apache.http.impl.conn.AbstractPooledConnAdapter.open(AbstractPooledConnAdapter.java:121)
at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:573)
at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:425)
at com.ibm.team.jfs.app.http.client.internal.ExtensibleRequestDirector.execute(ExtensibleRequestDirector.java:149)
at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:820)
at com.ibm.team.jfs.app.http.client.JazzHttpClient.execute(JazzHttpClient.java:256)
at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:919)
at com.ibm.team.jfs.app.discovery.internal.DiscoveryHelper.executeServiceQuery(DiscoveryHelper.java:140)
... 92 more
2014-07-21 18:24:44,177 [WebContainer : 30 @@ 18:17 <USERID> /jts/service/com.ibm.team.repository.service.internal.license.ILicenseExpirationRestService/licenseExpirationInfo] INFO com.ibm.team.jfs.app.http.client.JazzHttpClient - I/O exception (org.apache.http.NoHttpResponseException) caught when processing request: The target server failed to respond
2014-07-21 18:24:44,177 [WebContainer : 30 @@ 18:17 <USERID> /jts/service/com.ibm.team.repository.service.internal.license.ILicenseExpirationRestService/licenseExpirationInfo] INFO com.ibm.team.jfs.app.http.client.JazzHttpClient - Retrying request
One answer
Caused by: javax.net.ssl.SSLPeerUnverifiedException: peer not authenticatedYou would normally get it right at the start or should never get it. If the issue only happens when the load ramps up, it's an indication that some resource has run out - either network connections or computation power.
Other data, such as application server log files, may be needed to determine the cause.