repository connection failed to ram from RAD with SocketTimeOutException
Hello,
The connection to RAM repository from RAD is failed with a strange error. The error in the tooltip on failed repository connection says ";nested exception i: java.net.SocketTimeoutException: Read Timedout"
We are using the RAM version: 7.5.1.1
RAD - 8.0.4.1
The following logging is seen in the .log file ".metadata/" folder in my workspace...
!SESSION 2014-10-02 08:33:23.790 -----------------------------------------------
eclipse.buildId=unknown
java.fullversion=JRE 1.6.0 IBM J9 2.4 Windows 7 x86-32 jvmwi3260sr10fp1-20120202_101568 (JIT enabled, AOT enabled)
J9VM - 20120202_101568
JIT - r9_20111107_21307ifx1
GC - 20120202_AA
BootLoader constants: OS=win32, ARCH=x86, WS=win32, NL=nl_BE
Framework arguments: -product com.ibm.rational.rad.product.v80.ide
Command-line arguments: -os win32 -ws win32 -arch x86 -product com.ibm.rational.rad.product.v80.ide
!ENTRY org.apache.axis.utils.JavaUtils 2 900 2014-10-02 08:35:32.287
!MESSAGE Unable to find required classes (javax.activation.DataHandler and javax.mail.internet.MimeMultipart). Attachment support is disabled.
!ENTRY com.ibm.ram.rich.core 2 0 2014-10-02 08:37:01.535
!MESSAGE ; nested exception is:
java.net.SocketTimeoutException: Read timed out
!ENTRY com.ibm.ram.rich.core 2 2 2014-10-02 08:37:01.535
!MESSAGE Unable to refresh repository connection 'vkamja9@ram.colruyt.int'
!STACK 0
AxisFault
faultCode: {http://schemas.xmlsoap.org/soap/envelope/}Server.userException
faultSubcode:
faultString: java.net.SocketTimeoutException: Read timed out
faultActor:
faultNode:
faultDetail:
{http://xml.apache.org/axis/}stackTrace:java.net.SocketTimeoutException: Read timed out
at java.io.BufferedInputStream.fill(Unknown Source)
at java.io.BufferedInputStream.read(Unknown Source)
at org.apache.axis.transport.http.HTTPSender.readHeadersFromSocket(Unknown Source)
at org.apache.axis.transport.http.HTTPSender.invoke(Unknown Source)
at com.ibm.ram.internal.client.RAMHTTPSender.invoke(Unknown Source)
at org.apache.axis.strategies.InvocationStrategy.visit(Unknown Source)
at org.apache.axis.SimpleChain.doVisiting(Unknown Source)
at org.apache.axis.SimpleChain.invoke(Unknown Source)
at org.apache.axis.client.AxisClient.invoke(Unknown Source)
at org.apache.axis.client.Call.invokeEngine(Unknown Source)
at org.apache.axis.client.Call.invoke(Unknown Source)
at org.apache.axis.client.Call.invoke(Unknown Source)
at org.apache.axis.client.Call.invoke(Unknown Source)
at org.apache.axis.client.Call.invoke(Unknown Source)
at com.ibm.ram.repository.web.ws.core.v72.RAM1SoapBindingStub.getMyInformation(Unknown Source)
at com.ibm.ram.internal.access.ws.RAMv72.getMyInformation(Unknown Source)
at com.ibm.ram.internal.rich.core.model.RefreshRepositoryConnectionJob.updateMyInformation(Unknown Source)
at com.ibm.ram.internal.rich.core.model.RefreshRepositoryConnectionJob.refreshRepository(Unknown Source)
at com.ibm.ram.internal.rich.core.model.RefreshRepositoryConnectionJob.run(Unknown Source)
at org.eclipse.core.internal.jobs.Worker.run(Unknown Source)
{http://xml.apache.org/axis/}hostname:WS213963
java.net.SocketTimeoutException: Read timed out
at org.apache.axis.AxisFault.makeFault(Unknown Source)
at org.apache.axis.transport.http.HTTPSender.invoke(Unknown Source)
at com.ibm.ram.internal.client.RAMHTTPSender.invoke(Unknown Source)
at org.apache.axis.strategies.InvocationStrategy.visit(Unknown Source)
at org.apache.axis.SimpleChain.doVisiting(Unknown Source)
at org.apache.axis.SimpleChain.invoke(Unknown Source)
at org.apache.axis.client.AxisClient.invoke(Unknown Source)
at org.apache.axis.client.Call.invokeEngine(Unknown Source)
at org.apache.axis.client.Call.invoke(Unknown Source)
at org.apache.axis.client.Call.invoke(Unknown Source)
at org.apache.axis.client.Call.invoke(Unknown Source)
at org.apache.axis.client.Call.invoke(Unknown Source)
at com.ibm.ram.repository.web.ws.core.v72.RAM1SoapBindingStub.getMyInformation(Unknown Source)
at com.ibm.ram.internal.access.ws.RAMv72.getMyInformation(Unknown Source)
at com.ibm.ram.internal.rich.core.model.RefreshRepositoryConnectionJob.updateMyInformation(Unknown Source)
at com.ibm.ram.internal.rich.core.model.RefreshRepositoryConnectionJob.refreshRepository(Unknown Source)
at com.ibm.ram.internal.rich.core.model.RefreshRepositoryConnectionJob.run(Unknown Source)
at org.eclipse.core.internal.jobs.Worker.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.io.BufferedInputStream.fill(Unknown Source)
at java.io.BufferedInputStream.read(Unknown Source)
at org.apache.axis.transport.http.HTTPSender.readHeadersFromSocket(Unknown Source)
... 17 more
This is happnening from any workspace for this user.... If I login with a different user in the same workspace, it worked fine..
Currently this is happening for about 5 users.. can somebody please help....
One answer
Hi, thanks for looking this.
I do not see any trace for the above error in ramDebug log file. But I see some other errors for indexing...
I see the folloing in ramDebug.logs for today -
[10/02/14 08:53:35 CEST] CRRAM0001E 695010335 ERROR ws com.ibm.ram.repository.mail.NotificationManager - Error while processing immediate notifications for metric id: 3245899
com.ibm.ram.repository.core.IRepositoryAccess$RepositoryException: DSRA9110E: ResultSet is closed.
at com.ibm.ram.repository.core.sdo.BaseRAMSchemaAccess$ResultIteratorImpl.hasNext(BaseRAMSchemaAccess.java:2509)
at com.ibm.ram.repository.mail.NotificationManager.processNotificationsForEvents(NotificationManager.java:397)
at com.ibm.ram.repository.web.ws.quartz.jobs.ImmediateNotificationSenderJob.executeJob(ImmediateNotificationSenderJob.java:55)
at com.ibm.ram.repository.web.ws.quartz.jobs.AbstractRAMJob.execute(AbstractRAMJob.java:89)
at org.quartz.core.JobRunShell.run(JobRunShell.java:203)
at com.ibm.ram.repository.web.ws.was.quartz.RAMThreadPool$RAMWork.run(RAMThreadPool.java:166)
at com.ibm.ws.asynchbeans.J2EEContext$RunProxy.run(J2EEContext.java:268)
at java.security.AccessController.doPrivileged(AccessController.java:202)
at com.ibm.ws.asynchbeans.J2EEContext.run(J2EEContext.java:768)
at com.ibm.ws.asynchbeans.WorkWithExecutionContextImpl.go(WorkWithExecutionContextImpl.java:222)
at com.ibm.ws.asynchbeans.ABWorkItemImpl.run(ABWorkItemImpl.java:159)
at com.ibm.ws.util.ThreadPool$Worker.run(ThreadPool.java:1604)
Caused by:
com.ibm.websphere.ce.cm.ObjectClosedException: DSRA9110E: ResultSet is closed.
at com.ibm.ws.rsadapter.jdbc.WSJdbcWrapper.createClosedException(WSJdbcWrapper.java:110)
at com.ibm.ws.rsadapter.jdbc.WSJdbcResultSet.runtimeXIfNotClosed(WSJdbcResultSet.java:3359)
at com.ibm.ws.rsadapter.jdbc.WSJdbcResultSet.next(WSJdbcResultSet.java:3130)
at com.ibm.ram.repository.core.sdo.BaseRAMSchemaAccess$ResultIteratorImpl.hasNext(BaseRAMSchemaAccess.java:2504)
... 11 more
[10/02/14 08:53:48 CEST] CRRAM0001E 695022695 ERROR ws com.ibm.ram.repository.fsearch.artifacts.BulkArtifactIndexer - SAXParseException indexing content of asset 54071E3E-61B4-B684-7633-880347EE1168 [2.22.0.b8148]
[10/02/14 08:53:48 CEST] CRRAM0002W 695022696 WARN com.ibm.ram.repository.fsearch.artifacts.ExtractSearchML - IO error building artifact index while processing Stellent docs, asset id: 38524 artifact://fvscommv20mw.ear
[10/02/14 09:06:10 CEST] CRRAM0001E 695765311 ERROR web pagecode.error.Error - E0485B40-D493-ED7E-D680-0B9B3DE20F73 - URL: /ram/admin/group/index.jsp - java.lang.NullPointerException
at pagecode.PageCodeBase.<init>(PageCodeBase.java:185)
at com.ibm._jsp._index._jspService(_index.java:99)
at com.ibm.ws.jsp.runtime.HttpJspBase.service(HttpJspBase.java:99)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:831)
at com.ibm.ws.webcontainer.servlet.ServletWrapper.service(ServletWrapper.java:1657)
at com.ibm.ws.webcontainer.servlet.ServletWrapper.service(ServletWrapper.java:1597)
at com.ibm.ws.webcontainer.filter.WebAppFilterChain.doFilter(WebAppFilterChain.java:104)
at com.ibm.ws.webcontainer.filter.WebAppFilterChain._doFilter(WebAppFilterChain.java:77)
at com.ibm.ws.webcontainer.filter.WebAppFilterManager.doFilter(WebAppFilterManager.java:908)
at com.ibm.ws.webcontainer.servlet.ServletWrapper.handleRequest(ServletWrapper.java:934)
at com.ibm.ws.webcontainer.servlet.ServletWrapper.handleRequest(ServletWrapper.java:502)
at com.ibm.ws.webcontainer.servlet.ServletWrapperImpl.handleRequest(ServletWrapperImpl.java:179)
at com.ibm.wsspi.webcontainer.servlet.GenericServletWrapper.handleRequest(GenericServletWrapper.java:121)
at com.ibm.ws.jsp.webcontainerext.AbstractJSPExtensionServletWrapper.handleRequest(AbstractJSPExtensionServletWrapper.java:259)
at com.ibm.ws.webcontainer.webapp.WebAppRequestDispatcher.forward(WebAppRequestDispatcher.java:354)
at com.ibm.ws.webcontainer.servlet.FilterProxyServlet.dispatch(FilterProxyServlet.java:88)
at com.ibm.ws.webcontainer.servlet.FilterProxyServlet.service(FilterProxyServlet.java:62)
at com.ibm.ws.webcontainer.servlet.ServletWrapper.service(ServletWrapper.java:1657)
at com.ibm.ws.webcontainer.servlet.ServletWrapper.service(ServletWrapper.java:1597)
at com.ibm.ws.webcontainer.filter.WebAppFilterChain.doFilter(WebAppFilterChain.java:131)
at com.ibm.ram.repository.web.security.SecureAccessFilter.doFilter(SecureAccessFilter.java:60)
at com.ibm.ws.webcontainer.filter.FilterInstanceWrapper.doFilter(FilterInstanceWrapper.java:188)
at com.ibm.ws.webcontainer.filter.WebAppFilterChain.doFilter(WebAppFilterChain.java:116)
at com.ibm.ws.webcontainer.filter.WebAppFilterChain._doFilter(WebAppFilterChain.java:77)
at com.ibm.ws.webcontainer.filter.WebAppFilterManager.doFilter(WebAppFilterManager.java:908)
at com.ibm.ws.webcontainer.filter.WebAppFilterManager.invokeFilters(WebAppFilterManager.java:997)
at com.ibm.ws.webcontainer.extension.DefaultExtensionProcessor.invokeFilters(DefaultExtensionProcessor.java:1062)
at com.ibm.ws.webcontainer.extension.DefaultExtensionProcessor.handleRequest(DefaultExtensionProcessor.java:759)
at com.ibm.ws.webcontainer.webapp.WebApp.handleRequest(WebApp.java:3935)
at com.ibm.ws.webcontainer.webapp.WebGroup.handleRequest(WebGroup.java:276)
at com.ibm.ws.webcontainer.WebContainer.handleRequest(WebContainer.java:931)
at com.ibm.ws.webcontainer.WSWebContainer.handleRequest(WSWebContainer.java:1592)
at com.ibm.ws.webcontainer.channel.WCChannelLink.ready(WCChannelLink.java:186)
at com.ibm.ws.http.channel.inbound.impl.HttpInboundLink.handleDiscrimination(HttpInboundLink.java:452)
at com.ibm.ws.http.channel.inbound.impl.HttpInboundLink.handleNewRequest(HttpInboundLink.java:511)
at com.ibm.ws.http.channel.inbound.impl.HttpInboundLink.processRequest(HttpInboundLink.java:305)
at com.ibm.ws.http.channel.inbound.impl.HttpICLReadCallback.complete(HttpICLReadCallback.java:83)
at com.ibm.ws.tcp.channel.impl.AioReadCompletionListener.futureCompleted(AioReadCompletionListener.java:165)
at com.ibm.io.async.AbstractAsyncFuture.invokeCallback(AbstractAsyncFuture.java:217)
at com.ibm.io.async.AsyncChannelFuture.fireCompletionActions(AsyncChannelFuture.java:161)
at com.ibm.io.async.AsyncFuture.completed(AsyncFuture.java:138)
at com.ibm.io.async.ResultHandler.complete(ResultHandler.java:204)
at com.ibm.io.async.ResultHandler.runEventProcessingLoop(ResultHandler.java:775)
at com.ibm.io.async.ResultHandler$2.run(ResultHandler.java:905)
at com.ibm.ws.util.ThreadPool$Worker.run(ThreadPool.java:1604)
[10/02/14 09:06:17 CEST] CRRAM0001E 695772632 ERROR web pagecode.error.Error - CDE4177D-B8F8-5F43-C22C-F8329060479F - URL: /ram/admin/group/index.jsp - java.lang.NullPointerException
at pagecode.PageCodeBase.<init>(PageCodeBase.java:185)
at com.ibm._jsp._index._jspService(_index.java:99)
at com.ibm.ws.jsp.runtime.HttpJspBase.service(HttpJspBase.java:99)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:831)
at com.ibm.ws.webcontainer.servlet.ServletWrapper.service(ServletWrapper.java:1657)
at com.ibm.ws.webcontainer.servlet.ServletWrapper.service(ServletWrapper.java:1597)
at com.ibm.ws.webcontainer.filter.WebAppFilterChain.doFilter(WebAppFilterChain.java:104)
at com.ibm.ws.webcontainer.filter.WebAppFilterChain._doFilter(WebAppFilterChain.java:77)
at com.ibm.ws.webcontainer.filter.WebAppFilterManager.doFilter(WebAppFilterManager.java:908)
at com.ibm.ws.webcontainer.servlet.ServletWrapper.handleRequest(ServletWrapper.java:934)
at com.ibm.ws.webcontainer.servlet.ServletWrapper.handleRequest(ServletWrapper.java:502)
at com.ibm.ws.webcontainer.servlet.ServletWrapperImpl.handleRequest(ServletWrapperImpl.java:179)
at com.ibm.wsspi.webcontainer.servlet.GenericServletWrapper.handleRequest(GenericServletWrapper.java:121)
at com.ibm.ws.jsp.webcontainerext.AbstractJSPExtensionServletWrapper.handleRequest(AbstractJSPExtensionServletWrapper.java:259)
at com.ibm.ws.webcontainer.webapp.WebAppRequestDispatcher.forward(WebAppRequestDispatcher.java:354)
at com.ibm.ws.webcontainer.servlet.FilterProxyServlet.dispatch(FilterProxyServlet.java:88)
at com.ibm.ws.webcontainer.servlet.FilterProxyServlet.service(FilterProxyServlet.java:62)
at com.ibm.ws.webcontainer.servlet.ServletWrapper.service(ServletWrapper.java:1657)
at com.ibm.ws.webcontainer.servlet.ServletWrapper.service(ServletWrapper.java:1597)
at com.ibm.ws.webcontainer.filter.WebAppFilterChain.doFilter(WebAppFilterChain.java:131)
at com.ibm.ram.repository.web.security.SecureAccessFilter.doFilter(SecureAccessFilter.java:60)
at com.ibm.ws.webcontainer.filter.FilterInstanceWrapper.doFilter(FilterInstanceWrapper.java:188)
at com.ibm.ws.webcontainer.filter.WebAppFilterChain.doFilter(WebAppFilterChain.java:116)
at com.ibm.ws.webcontainer.filter.WebAppFilterChain._doFilter(WebAppFilterChain.java:77)
at com.ibm.ws.webcontainer.filter.WebAppFilterManager.doFilter(WebAppFilterManager.java:908)
at com.ibm.ws.webcontainer.filter.WebAppFilterManager.invokeFilters(WebAppFilterManager.java:997)
at com.ibm.ws.webcontainer.extension.DefaultExtensionProcessor.invokeFilters(DefaultExtensionProcessor.java:1062)
at com.ibm.ws.webcontainer.extension.DefaultExtensionProcessor.handleRequest(DefaultExtensionProcessor.java:759)
at com.ibm.ws.webcontainer.webapp.WebApp.handleRequest(WebApp.java:3935)
at com.ibm.ws.webcontainer.webapp.WebGroup.handleRequest(WebGroup.java:276)
at com.ibm.ws.webcontainer.WebContainer.handleRequest(WebContainer.java:931)
at com.ibm.ws.webcontainer.WSWebContainer.handleRequest(WSWebContainer.java:1592)
at com.ibm.ws.webcontainer.channel.WCChannelLink.ready(WCChannelLink.java:186)
at com.ibm.ws.http.channel.inbound.impl.HttpInboundLink.handleDiscrimination(HttpInboundLink.java:452)
at com.ibm.ws.http.channel.inbound.impl.HttpInboundLink.handleNewRequest(HttpInboundLink.java:511)
at com.ibm.ws.http.channel.inbound.impl.HttpInboundLink.processRequest(HttpInboundLink.java:305)
at com.ibm.ws.http.channel.inbound.impl.HttpICLReadCallback.complete(HttpICLReadCallback.java:83)
at com.ibm.ws.tcp.channel.impl.AioReadCompletionListener.futureCompleted(AioReadCompletionListener.java:165)
at com.ibm.io.async.AbstractAsyncFuture.invokeCallback(AbstractAsyncFuture.java:217)
at com.ibm.io.async.AsyncChannelFuture.fireCompletionActions(AsyncChannelFuture.java:161)
at com.ibm.io.async.AsyncFuture.completed(AsyncFuture.java:138)
at com.ibm.io.async.ResultHandler.complete(ResultHandler.java:204)
at com.ibm.io.async.ResultHandler.runEventProcessingLoop(ResultHandler.java:775)
at com.ibm.io.async.ResultHandler$2.run(ResultHandler.java:905)
at com.ibm.ws.util.ThreadPool$Worker.run(ThreadPool.java:1604)
Comments
Hi Venu,
If the problem is seen with specific users but not with others, please check what are the differences between the users (settings, license type assigned, location, ....) that may help to understand what is going on.
Regards,
François
Hi,
I think this maybe unrelated, that read time out comes from a web service named getMyInformation.
If there is any debug error around this getMyInformation service call in ram debug logs or WAS log?
There was a defect, which is closed in later fix pack, in this SOAP service call when one user have too many assets(like several thousands) in his or her review list. https://jazz.net/jazz02/resource/itemName/com.ibm.team.workitem.WorkItem/103478
I am not sure if RAM repository in your env has this fix applied, you may find some clue in the extention page(reference to snapshot). I would like to suggest that you contact customer support and provide all support logs
François, I do not see any differences in this regards.. These are existing users who were using the system without any problem before.
Lin, I already created the PMR and following it up with support, but couldn;t find any thing as of now.
I checked the logs and I see the logging gven by you in SystemOut.log, but not sure this is at the same time. I see the above issues is fixed in testfix-18b and we do not have that. Do you see any workaround for this ?
The PMR number is 21673,300,624
Comments
Lin Lu
JAZZ DEVELOPER Oct 02 '14, 3:10 a.m.Hi,
Looks like SOAP time out for response from server.... Would you provide associated debug logs from server side?