How (else) to troubleshoot "My RTC server is really really slow"?

Christopher L

(11●1●2) edited

Sep 03 '12, 5:39 p.m.

4.0.1 M2, a brand new install, is insanely slow. It takes minutes for the web pages to load.

I found the forum posts about it needing 2/2 procs. That didn't help.

How else can I troubleshoot this?

It's running within Windows 2008 R2, on VMWare Workstation 8.
Hosted by the Tomcat that was built in to the installer. Not WAS.
The VMWare guest has 6 gigs of ram and 2/2 processors.
The VMWare host (my workstation) has 6-dual core @3.47ghz (12 procs), and 12 gigs of ram. It is running only this one guest. This isn't a resource availability or scheduling problem. java.exe only uses 1 gig of ram.
I initially installed everything locally using the express method. With the least possible configuration, it was very slow right out of the box. I thought perhaps Derby was the culprit.
I re-ran the setup using Custom, and pointed it at a SQL server. This produced no change in the very slow page access times: Still slow. (JDBC)
I eliminated all possible network interference. There's no firewall running on the server. It's slow if I access it over https://localhost:9443/jts or https://fqdn:9443/jts from the local console.
Even http://localhost:9443/jts/customSetup takes 60 seconds to load.
I have found only one potential clue in the form of an error. The server page shows no errors. The diagnostics show all good. But the page titled "Active Services" shows "Item Handle must not be null" with this in the details: "$Proxy145.getActiveServiceInfo(Unknown Source)"
/admin, /ccm, /qm, and /rm are all installed. I just took the easiest possible defaults during the installer.
Upon addressing the url, the server responds immediately with the SSL Certificate. I haven't trusted the cert yet so the browser throws a warning and prompts me to press continue. It's only after pressing continue, where the pages actually render, that the slow speed occurs.
I have run other guest operating systems on this VM, hosting similar tomcat servers with applications that use database backends, and haven't seen this before. It "seems" to be specific to TeamConcert.

Can anyone offer an idea on what else I should look at? From the operating system side, everything looks great. CPU/Mem/Disk/Net all look good from within the guest, as well as at the host layer. Something with TeamConcert is very slow and I don't know how else to go about discovering the issue.

Any ideas?

0 votes

Comments

Dong Young Kim

JAZZ DEVELOPER Sep 15 '12, 11:51 a.m.

How about turning off firewall just for test?

7 answers

10,154 views

0 votes

7 answers

Permanent link

sam detweiler

(12.5k●6●195●201) Sep 03 '12, 8:42 p.m.

Mine turned out to be a bad name server config. V4 does a LOT more connections via name than before.

fixing my name server config resolved all the problems

0 votes

Comments

Christopher L

Sep 04 '12, 10:21 a.m.

Thanks for the response. Name resolution seems to be working fine in this instance. Hard coding things in the hosts file even, shows no improvement.

Permanent link

Rajat Singh

(598●3●35●45) Sep 04 '12, 12:45 a.m.

Are you on the supported browsers?
The list of supported browsers for v4.0:
Firefox 10 ESR
Firefox 3.6
Internet Explorer 9
Internet Explorer 8
Macromedia Flash Player 8
Safari 5

0 votes

Comments

Christopher L

Sep 04 '12, 10:22 a.m.

Thanks for the response. I'm using IE9 both from a Windows 7 client, and on the server. It's the same slow page loads from either system. I just tried Chrome and found that it also experiences the exact same speed delay.

Permanent link

Christopher L

(11●1●2) Sep 04 '12, 3:36 p.m.

Using Fiddler, the hangs are obvious. The client waits on a get for the login screen. Once through that, there's a redirect that sends a get for the /jts/admin page. The client just sits there waiting. No retries, no errors. Just a get, and a wait.

Using Wireshark, when the tomcat server starts I see no traffic from the server, out to the network. (aside from the usual domain stuff). As soon as my web client hits the login page, however, the RTC starts talking to the SQL server. What seems odd is that if I just let it sit at the login page, the sql communication runs back and forth for quite a while. With the client doing nothing, the RTC is quite busy.

And then something unexpected. After I wait for the SQL traffic to stop, I login, and no additional sql traffic occurs. I expected to see that after the login page the RTC would be rendering the web page, relying heavily on the SQL DB. Non of that occurred; not even one packet.

So after all SQL traffic dies down, when I login and experience a long delay in the page render, no db queries are occurring. I am assuming at this point that the RTC already has all of the data that it needs to render the page, and that the delay is entirely within tomcat, taking forever to render the page.

The question, therefore, is how do I see what is occurring within Tomcat?

0 votes

Permanent link

Christopher L

(11●1●2) Sep 04 '12, 5:51 p.m.

For posterity...

The way to see what is occurring within Tomcat is to use jconsole, or visualvm, or AppDynamics Lite.

To connect with VisualVM:

Create a JMX monitor port by modifying the server.startup.bat to add the following java opts to the end:

set JAVA_OPTS=%JAVA_OPTS% -Dcom.sun.management.jmxremote.port=8086
set JAVA_OPTS=%JAVA_OPTS% -Dcom.sun.management.jmxremote.ssl=false
set JAVA_OPTS=%JAVA_OPTS% -Dcom.sun.management.jmxremote.authenticate=false
Start the server
Launch visualvm, right click on "Local", add JMX Connection, localhost:8086
Then look at the threads.

To connect with AppDynamics Lite:

Copy the agent over to the server
Modify the startup.bat and add this to the very beginning of the java_opts
set JAVA_OPTS=%JAVA_OPTS% -javaagent:"C:\AppServerAgentLite-3.3.3.2GA\javaagent.jar"
set JAVA_OPTS=%JAVA_OPTS% -Dappdynamics.viewer.host=192.168.x.x (ip address of your "viewer")
set JAVA_OPTS=%JAVA_OPTS% -Dappdynamics.viewer.port=8990
Launch the viewer on a client system (or localhost if you want).
Then launch the tomcat server using the modified server.bat
Initially AppsDynamics will be empty. Do stuff in RTC and you will being to see the viewer populate.

AppsDynamics Lite has been very helpful in diagnosing the speed problem within Tomcat. (within the JVM) It is showing me that .net.jazz.ajax.model.OSGiWebBundle:bundleResource is eventually timing out. Here is the point of failure:

Name: net.jazz.ajax.model.OSGiWebBundle:bundleResource

Type: POJO

Class: net.jazz.ajax.model.OSGiWebBundle

Method: bundleResource

Line Number: 76

Now I have to figure out what THAT means.

0 votes

Permanent link

Christopher L

(11●1●2) Sep 06 '12, 1:11 p.m.

Below is a thread dump. There are several "locked" things? If anyone has any thoughts... This is over my head.

Also,one part of the dump in particular might be interesting. It "seems" to say that it's using IPv6? "at java.net.Inet6AddressImpl.lookupAllHostAddr(Native Method)". And bundleResource hangs right after URLStreamHandler.getHostAddress. If it's trying to getHostAddress over ipv6; that would be a problem.

Here's the thread dump:

2012-09-06 08:38:06
Full thread dump IBM J9 VM (2.4 JRE 1.6.0 IBM J9 2.4 Windows Server 2008 R2 amd64-64 jvmwa6460sr10fp1-20120202_101568 (JIT enabled, AOT enabled)
J9VM - 20120202_101568
JIT - r9_20111107_21307ifx1
GC - 20120202_AA_CMPRSS):

"main" - Thread t@1
java.lang.Thread.State: RUNNABLE
at java.net.PlainSocketImpl.socketAccept(Native Method)
at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:438)
- locked <23aa23aa> (a java.net.SocksSocketImpl)
at java.net.ServerSocket.implAccept(ServerSocket.java:462)
at java.net.ServerSocket.accept(ServerSocket.java:430)
at org.apache.catalina.core.StandardServer.await(StandardServer.java:447)
at org.apache.catalina.startup.Catalina.await(Catalina.java:728)
at org.apache.catalina.startup.Catalina.start(Catalina.java:674)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:48)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:600)
at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:322)
at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:450)

Locked ownable synchronizers:
- None

"JIT Compilation Thread" - Thread t@13
java.lang.Thread.State: RUNNABLE

Locked ownable synchronizers:
- None

"Signal Dispatcher" - Thread t@2
java.lang.Thread.State: RUNNABLE
at com.ibm.misc.SignalDispatcher.waitForSignal(Native Method)
at com.ibm.misc.SignalDispatcher.run(SignalDispatcher.java:54)

Locked ownable synchronizers:
- None

"MemoryPoolMXBean notification dispatcher" - Thread t@7
java.lang.Thread.State: RUNNABLE
at com.ibm.lang.management.MemoryNotificationThread.processNotificationLoop(Native Method)
at com.ibm.lang.management.MemoryNotificationThread.run(MemoryNotificationThread.java:56)

Locked ownable synchronizers:
- None

"RMI Scheduler(0)" - Thread t@9
java.lang.Thread.State: TIMED_WAITING
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <65b465b4> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:211)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"RMI TCP Accept-0" - Thread t@10
java.lang.Thread.State: RUNNABLE
at java.net.PlainSocketImpl.socketAccept(Native Method)
at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:438)
- locked <6a666a66> (a java.net.SocksSocketImpl)
at java.net.ServerSocket.implAccept(ServerSocket.java:462)
at java.net.ServerSocket.accept(ServerSocket.java:430)
at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:369)
at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:341)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"RMI TCP Accept-8086" - Thread t@11
java.lang.Thread.State: RUNNABLE
at java.net.PlainSocketImpl.socketAccept(Native Method)
at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:438)
- locked <39a039a0> (a java.net.SocksSocketImpl)
at java.net.ServerSocket.implAccept(ServerSocket.java:462)
at java.net.ServerSocket.accept(ServerSocket.java:430)
at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:369)
at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:341)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"RMI TCP Accept-0" - Thread t@12
java.lang.Thread.State: RUNNABLE
at java.net.PlainSocketImpl.socketAccept(Native Method)
at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:438)
- locked <4b764b76> (a java.net.SocksSocketImpl)
at java.net.ServerSocket.implAccept(ServerSocket.java:462)
at java.net.ServerSocket.accept(ServerSocket.java:430)
at sun.management.jmxremote.LocalRMIServerSocketFactory$1.accept(LocalRMIServerSocketFactory.java:34)
at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:369)
at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:341)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"Concurrent Mark Helper" - Thread t@14
java.lang.Thread.State: RUNNABLE

Locked ownable synchronizers:
- None

"Gc Slave Thread" - Thread t@15
java.lang.Thread.State: RUNNABLE

Locked ownable synchronizers:
- None

"Gc Slave Thread" - Thread t@16
java.lang.Thread.State: RUNNABLE

Locked ownable synchronizers:
- None

"Gc Slave Thread" - Thread t@17
java.lang.Thread.State: RUNNABLE

Locked ownable synchronizers:
- None

"Thread-6" - Thread t@18
java.lang.Thread.State: TIMED_WAITING
at java.lang.Thread.sleep(Native Method)
at java.lang.Thread.sleep(Thread.java:851)
at com.singularity.util.org.apache.log4j.helpers.FileWatchdog.run(FileWatchdog.java:104)

Locked ownable synchronizers:
- None

"AD Thread-Config Poller" - Thread t@23
java.lang.Thread.State: TIMED_WAITING
at java.lang.Thread.sleep(Native Method)
at java.lang.Thread.sleep(Thread.java:851)
at com.singularity.util.org.apache.log4j.helpers.FileWatchdog.run(FileWatchdog.java:104)

Locked ownable synchronizers:
- None

"AD Thread-Metric Reporter0" - Thread t@24
java.lang.Thread.State: TIMED_WAITING
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <55225522> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:211)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
at com.singularity.ee.util.pd.c(pd.java:523)
at com.singularity.ee.util.pd.take(pd.java:515)
at com.singularity.ee.util.rd.a(rd.java:487)
at com.singularity.ee.util.pb.run(pb.java:691)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"AD Thread Pool-Global0" - Thread t@25
java.lang.Thread.State: TIMED_WAITING
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <461f461f> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:211)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
at com.singularity.ee.util.pd.c(pd.java:523)
at com.singularity.ee.util.pd.take(pd.java:515)
at com.singularity.ee.util.rd.a(rd.java:487)
at com.singularity.ee.util.pb.run(pb.java:691)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"AD Thread Pool-Global1" - Thread t@26
java.lang.Thread.State: TIMED_WAITING
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <461f461f> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:211)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
at com.singularity.ee.util.pd.c(pd.java:523)
at com.singularity.ee.util.pd.take(pd.java:515)
at com.singularity.ee.util.rd.a(rd.java:487)
at com.singularity.ee.util.pb.run(pb.java:691)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"MultiThreadedHttpConnectionManager cleanup" - Thread t@27
java.lang.Thread.State: WAITING
at java.lang.Object.wait(Native Method)
- waiting on <385b385b> (a java.lang.ref.ReferenceQueue)
at java.lang.Object.wait(Object.java:196)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:107)
- locked <385b385b> (a java.lang.ref.ReferenceQueue)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:79)
at org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$ReferenceQueueThread.run(MultiThreadedHttpConnectionManager.java:1122)

Locked ownable synchronizers:
- None

"Attach API wait loop" - Thread t@30
java.lang.Thread.State: RUNNABLE
at com.ibm.tools.attach.javaSE.IPC.waitSemaphore(Native Method)
at com.ibm.tools.attach.javaSE.CommonDirectory.waitSemaphore(CommonDirectory.java:193)
at com.ibm.tools.attach.javaSE.AttachHandler$WaitLoop.waitForNotification(AttachHandler.java:331)
at com.ibm.tools.attach.javaSE.AttachHandler$WaitLoop.run(AttachHandler.java:409)

Locked ownable synchronizers:
- None

"GC Daemon" - Thread t@31
java.lang.Thread.State: TIMED_WAITING
at java.lang.Object.wait(Native Method)
- waiting on <1e451e45> (a sun.misc.GC$LatencyLock)
at java.lang.Object.wait(Object.java:196)
at sun.misc.GC$Daemon.run(GC.java:100)
- locked <1e451e45> (a sun.misc.GC$LatencyLock)

Locked ownable synchronizers:
- None

"Finalizer thread" - Thread t@32
java.lang.Thread.State: RUNNABLE

Locked ownable synchronizers:
- None

"State Data Manager" - Thread t@35
java.lang.Thread.State: TIMED_WAITING
at java.lang.Thread.sleep(Native Method)
at java.lang.Thread.sleep(Thread.java:851)
at org.eclipse.osgi.internal.baseadaptor.StateManager.run(StateManager.java:319)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"Start Level Event Dispatcher" - Thread t@36
java.lang.Thread.State: WAITING
at java.lang.Object.wait(Native Method)
- waiting on <1330133> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
at java.lang.Object.wait(Object.java:167)
at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.getNextEvent(EventManager.java:397)
- locked <1330133> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.run(EventManager.java:333)

Locked ownable synchronizers:
- None

"Framework Event Dispatcher" - Thread t@37
java.lang.Thread.State: WAITING
at java.lang.Object.wait(Native Method)
- waiting on <3a703a70> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
at java.lang.Object.wait(Object.java:167)
at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.getNextEvent(EventManager.java:397)
- locked <3a703a70> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.run(EventManager.java:333)

Locked ownable synchronizers:
- None

"[Timer] - Main Queue Handler" - Thread t@38
java.lang.Thread.State: TIMED_WAITING
at java.lang.Object.wait(Native Method)
- waiting on <34dc34dc> (a java.lang.Object)
at java.lang.Object.wait(Object.java:196)
at org.eclipse.equinox.internal.util.impl.tpt.timer.TimerImpl.run(TimerImpl.java:141)
- locked <34dc34dc> (a java.lang.Object)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"Worker-JM" - Thread t@39
java.lang.Thread.State: WAITING
at java.lang.Object.wait(Native Method)
- waiting on <56535653> (a java.util.ArrayList)
at java.lang.Object.wait(Object.java:196)
at org.eclipse.core.internal.jobs.InternalWorker.run(InternalWorker.java:58)
- locked <56535653> (a java.util.ArrayList)

Locked ownable synchronizers:
- None

"CommonCache Scrubber" - Thread t@40
java.lang.Thread.State: TIMED_WAITING
at java.lang.Object.wait(Native Method)
- waiting on <5640564> (a java.util.Timer$TimerImpl)
at java.lang.Object.wait(Object.java:196)
at java.util.Timer$TimerImpl.run(Timer.java:246)
- locked <5640564> (a java.util.Timer$TimerImpl)

Locked ownable synchronizers:
- None

"[ThreadPool Manager] - Idle Thread" - Thread t@41
java.lang.Thread.State: WAITING
at java.lang.Object.wait(Native Method)
- waiting on <140d140d> (a org.eclipse.equinox.internal.util.impl.tpt.threadpool.Executor)
at java.lang.Object.wait(Object.java:167)
at org.eclipse.equinox.internal.util.impl.tpt.threadpool.Executor.run(Executor.java:106)
- locked <140d140d> (a org.eclipse.equinox.internal.util.impl.tpt.threadpool.Executor)

Locked ownable synchronizers:
- None

"pool-8-thread-1" - Thread t@45
java.lang.Thread.State: TIMED_WAITING
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <2a402a40> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:211)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"Start Level Event Dispatcher" - Thread t@46
java.lang.Thread.State: WAITING
at java.lang.Object.wait(Native Method)
- waiting on <51a651a6> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
at java.lang.Object.wait(Object.java:167)
at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.getNextEvent(EventManager.java:397)
- locked <51a651a6> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.run(EventManager.java:333)

Locked ownable synchronizers:
- None

"Framework Event Dispatcher" - Thread t@47
java.lang.Thread.State: WAITING
at java.lang.Object.wait(Native Method)
- waiting on <28182818> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
at java.lang.Object.wait(Object.java:167)
at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.getNextEvent(EventManager.java:397)
- locked <28182818> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.run(EventManager.java:333)

Locked ownable synchronizers:
- None

"Worker-JM" - Thread t@48
java.lang.Thread.State: WAITING
at java.lang.Object.wait(Native Method)
- waiting on <5d395d39> (a java.util.ArrayList)
at java.lang.Object.wait(Object.java:196)
at org.eclipse.core.internal.jobs.InternalWorker.run(InternalWorker.java:58)
- locked <5d395d39> (a java.util.ArrayList)

Locked ownable synchronizers:
- None

"CommonCache Scrubber" - Thread t@52
java.lang.Thread.State: TIMED_WAITING
at java.lang.Object.wait(Native Method)
- waiting on <6eae6eae> (a java.util.Timer$TimerImpl)
at java.lang.Object.wait(Object.java:196)
at java.util.Timer$TimerImpl.run(Timer.java:246)
- locked <6eae6eae> (a java.util.Timer$TimerImpl)

Locked ownable synchronizers:
- None

"[Timer] - Main Queue Handler" - Thread t@53
java.lang.Thread.State: TIMED_WAITING
at java.lang.Object.wait(Native Method)
- waiting on <3ca33ca3> (a java.lang.Object)
at java.lang.Object.wait(Object.java:196)
at org.eclipse.equinox.internal.util.impl.tpt.timer.TimerImpl.run(TimerImpl.java:141)
- locked <3ca33ca3> (a java.lang.Object)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"[ThreadPool Manager] - Idle Thread" - Thread t@54
java.lang.Thread.State: WAITING
at java.lang.Object.wait(Native Method)
- waiting on <5fba5fba> (a org.eclipse.equinox.internal.util.impl.tpt.threadpool.Executor)
at java.lang.Object.wait(Object.java:167)
at org.eclipse.equinox.internal.util.impl.tpt.threadpool.Executor.run(Executor.java:106)
- locked <5fba5fba> (a org.eclipse.equinox.internal.util.impl.tpt.threadpool.Executor)

Locked ownable synchronizers:
- None

"Bundle File Closer" - Thread t@55
java.lang.Thread.State: WAITING
at java.lang.Object.wait(Native Method)
- waiting on <5b205b2> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
at java.lang.Object.wait(Object.java:167)
at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.getNextEvent(EventManager.java:397)
- locked <5b205b2> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.run(EventManager.java:333)

Locked ownable synchronizers:
- None

"pool-14-thread-1" - Thread t@56
java.lang.Thread.State: TIMED_WAITING
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <574b574b> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:211)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"Worker-0" - Thread t@57
java.lang.Thread.State: TIMED_WAITING
at java.lang.Object.wait(Native Method)
- waiting on <336d336d> (a org.eclipse.core.internal.jobs.WorkerPool)
at java.lang.Object.wait(Object.java:196)
at org.eclipse.core.internal.jobs.WorkerPool.sleep(WorkerPool.java:185)
- locked <336d336d> (a org.eclipse.core.internal.jobs.WorkerPool)
at org.eclipse.core.internal.jobs.WorkerPool.startJob(WorkerPool.java:217)
at org.eclipse.core.internal.jobs.Worker.run(Worker.java:50)

Locked ownable synchronizers:
- None

"Framework Active Thread" - Thread t@58
java.lang.Thread.State: TIMED_WAITING
at java.lang.Object.wait(Native Method)
- waiting on <da20da2> (a org.eclipse.osgi.framework.internal.core.Framework)
at java.lang.Object.wait(Object.java:196)
at org.eclipse.osgi.framework.internal.core.Framework.run(Framework.java:1816)
- locked <da20da2> (a org.eclipse.osgi.framework.internal.core.Framework)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"State Data Manager" - Thread t@59
java.lang.Thread.State: TIMED_WAITING
at java.lang.Thread.sleep(Native Method)
at java.lang.Thread.sleep(Thread.java:851)
at org.eclipse.osgi.internal.baseadaptor.StateManager.run(StateManager.java:297)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"Start Level Event Dispatcher" - Thread t@60
java.lang.Thread.State: WAITING
at java.lang.Object.wait(Native Method)
- waiting on <56de56de> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
at java.lang.Object.wait(Object.java:167)
at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.getNextEvent(EventManager.java:400)
- locked <56de56de> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.run(EventManager.java:336)

Locked ownable synchronizers:
- None

"Framework Event Dispatcher" - Thread t@61
java.lang.Thread.State: WAITING
at java.lang.Object.wait(Native Method)
- waiting on <1750175> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
at java.lang.Object.wait(Object.java:167)
at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.getNextEvent(EventManager.java:400)
- locked <1750175> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.run(EventManager.java:336)

Locked ownable synchronizers:
- None

"[Timer] - Main Queue Handler" - Thread t@63
java.lang.Thread.State: TIMED_WAITING
at java.lang.Object.wait(Native Method)
- waiting on <4260426> (a java.lang.Object)
at java.lang.Object.wait(Object.java:196)
at org.eclipse.equinox.internal.util.impl.tpt.timer.TimerImpl.run(TimerImpl.java:141)
- locked <4260426> (a java.lang.Object)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"Bundle File Closer" - Thread t@64
java.lang.Thread.State: WAITING
at java.lang.Object.wait(Native Method)
- waiting on <232f232f> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
at java.lang.Object.wait(Object.java:167)
at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.getNextEvent(EventManager.java:400)
- locked <232f232f> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.run(EventManager.java:336)

Locked ownable synchronizers:
- None

"Worker-JM" - Thread t@65
java.lang.Thread.State: WAITING
at java.lang.Object.wait(Native Method)
- waiting on <63926392> (a java.util.ArrayList)
at java.lang.Object.wait(Object.java:196)
at org.eclipse.core.internal.jobs.InternalWorker.run(InternalWorker.java:58)
- locked <63926392> (a java.util.ArrayList)

Locked ownable synchronizers:
- None

"Thread-19" - Thread t@69
java.lang.Thread.State: TIMED_WAITING
at java.lang.Thread.sleep(Native Method)
at java.lang.Thread.sleep(Thread.java:851)
at com.ibm.ccl.ut.filter.CacheManager.sleep(CacheManager.java:39)
at com.ibm.ccl.ut.filter.CacheManager.run(CacheManager.java:48)

Locked ownable synchronizers:
- None

"Worker-0" - Thread t@72
java.lang.Thread.State: TIMED_WAITING
at java.lang.Object.wait(Native Method)
- waiting on <279b279b> (a org.eclipse.core.internal.jobs.WorkerPool)
at java.lang.Object.wait(Object.java:196)
at org.eclipse.core.internal.jobs.WorkerPool.sleep(WorkerPool.java:188)
- locked <279b279b> (a org.eclipse.core.internal.jobs.WorkerPool)
at org.eclipse.core.internal.jobs.WorkerPool.startJob(WorkerPool.java:220)
at org.eclipse.core.internal.jobs.Worker.run(Worker.java:50)

Locked ownable synchronizers:
- None

"Provisioning Event Dispatcher" - Thread t@73
java.lang.Thread.State: WAITING
at java.lang.Object.wait(Native Method)
- waiting on <755e755e> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
at java.lang.Object.wait(Object.java:167)
at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.getNextEvent(EventManager.java:400)
- locked <755e755e> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.run(EventManager.java:336)

Locked ownable synchronizers:
- None

"State Data Manager" - Thread t@74
java.lang.Thread.State: TIMED_WAITING
at java.lang.Thread.sleep(Native Method)
at java.lang.Thread.sleep(Thread.java:851)
at org.eclipse.osgi.internal.baseadaptor.StateManager.run(StateManager.java:319)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"Start Level Event Dispatcher" - Thread t@75
java.lang.Thread.State: WAITING
at java.lang.Object.wait(Native Method)
- waiting on <59f459f4> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
at java.lang.Object.wait(Object.java:167)
at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.getNextEvent(EventManager.java:397)
- locked <59f459f4> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.run(EventManager.java:333)

Locked ownable synchronizers:
- None

"Framework Event Dispatcher" - Thread t@76
java.lang.Thread.State: WAITING
at java.lang.Object.wait(Native Method)
- waiting on <2f602f6> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
at java.lang.Object.wait(Object.java:167)
at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.getNextEvent(EventManager.java:397)
- locked <2f602f6> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.run(EventManager.java:333)

Locked ownable synchronizers:
- None

"Bundle File Closer" - Thread t@77
java.lang.Thread.State: WAITING
at java.lang.Object.wait(Native Method)
- waiting on <324e324e> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
at java.lang.Object.wait(Object.java:167)
at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.getNextEvent(EventManager.java:397)
- locked <324e324e> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.run(EventManager.java:333)

Locked ownable synchronizers:
- None

"Worker-JM" - Thread t@80
java.lang.Thread.State: WAITING
at java.lang.Object.wait(Native Method)
- waiting on <261e261e> (a java.util.ArrayList)
at java.lang.Object.wait(Object.java:196)
at org.eclipse.core.internal.jobs.InternalWorker.run(InternalWorker.java:58)
- locked <261e261e> (a java.util.ArrayList)

Locked ownable synchronizers:
- None

"Start Level Event Dispatcher" - Thread t@81
java.lang.Thread.State: WAITING
at java.lang.Object.wait(Native Method)
- waiting on <5f755f75> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
at java.lang.Object.wait(Object.java:167)
at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.getNextEvent(EventManager.java:397)
- locked <5f755f75> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.run(EventManager.java:333)

Locked ownable synchronizers:
- None

"Framework Event Dispatcher" - Thread t@82
java.lang.Thread.State: WAITING
at java.lang.Object.wait(Native Method)
- waiting on <7b3b7b3b> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
at java.lang.Object.wait(Object.java:167)
at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.getNextEvent(EventManager.java:397)
- locked <7b3b7b3b> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.run(EventManager.java:333)

Locked ownable synchronizers:
- None

"Worker-JM" - Thread t@83
java.lang.Thread.State: WAITING
at java.lang.Object.wait(Native Method)
- waiting on <7b117b11> (a java.util.ArrayList)
at java.lang.Object.wait(Object.java:196)
at org.eclipse.core.internal.jobs.InternalWorker.run(InternalWorker.java:58)
- locked <7b117b11> (a java.util.ArrayList)

Locked ownable synchronizers:
- None

"CommonCache Scrubber" - Thread t@87
java.lang.Thread.State: TIMED_WAITING
at java.lang.Object.wait(Native Method)
- waiting on <2cad2cad> (a java.util.Timer$TimerImpl)
at java.lang.Object.wait(Object.java:196)
at java.util.Timer$TimerImpl.run(Timer.java:246)
- locked <2cad2cad> (a java.util.Timer$TimerImpl)

Locked ownable synchronizers:
- None

"[Timer] - Main Queue Handler" - Thread t@88
java.lang.Thread.State: TIMED_WAITING
at java.lang.Object.wait(Native Method)
- waiting on <708d708d> (a java.lang.Object)
at java.lang.Object.wait(Object.java:196)
at org.eclipse.equinox.internal.util.impl.tpt.timer.TimerImpl.run(TimerImpl.java:141)
- locked <708d708d> (a java.lang.Object)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"[ThreadPool Manager] - Idle Thread" - Thread t@89
java.lang.Thread.State: WAITING
at java.lang.Object.wait(Native Method)
- waiting on <178e178e> (a org.eclipse.equinox.internal.util.impl.tpt.threadpool.Executor)
at java.lang.Object.wait(Object.java:167)
at org.eclipse.equinox.internal.util.impl.tpt.threadpool.Executor.run(Executor.java:106)
- locked <178e178e> (a org.eclipse.equinox.internal.util.impl.tpt.threadpool.Executor)

Locked ownable synchronizers:
- None

"Bundle File Closer" - Thread t@90
java.lang.Thread.State: WAITING
at java.lang.Object.wait(Native Method)
- waiting on <65d565d5> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
at java.lang.Object.wait(Object.java:167)
at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.getNextEvent(EventManager.java:397)
- locked <65d565d5> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.run(EventManager.java:333)

Locked ownable synchronizers:
- None

"pool-28-thread-1" - Thread t@91
java.lang.Thread.State: TIMED_WAITING
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <71017101> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:211)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"Worker-0" - Thread t@92
java.lang.Thread.State: TIMED_WAITING
at java.lang.Object.wait(Native Method)
- waiting on <52085208> (a org.eclipse.core.internal.jobs.WorkerPool)
at java.lang.Object.wait(Object.java:196)
at org.eclipse.core.internal.jobs.WorkerPool.sleep(WorkerPool.java:185)
- locked <52085208> (a org.eclipse.core.internal.jobs.WorkerPool)
at org.eclipse.core.internal.jobs.WorkerPool.startJob(WorkerPool.java:217)
at org.eclipse.core.internal.jobs.Worker.run(Worker.java:50)

Locked ownable synchronizers:
- None

"Start Level Event Dispatcher" - Thread t@93
java.lang.Thread.State: WAITING
at java.lang.Object.wait(Native Method)
- waiting on <9d509d5> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
at java.lang.Object.wait(Object.java:167)
at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.getNextEvent(EventManager.java:397)
- locked <9d509d5> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.run(EventManager.java:333)

Locked ownable synchronizers:
- None

"Framework Event Dispatcher" - Thread t@94
java.lang.Thread.State: WAITING
at java.lang.Object.wait(Native Method)
- waiting on <614c614c> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
at java.lang.Object.wait(Object.java:167)
at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.getNextEvent(EventManager.java:397)
- locked <614c614c> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.run(EventManager.java:333)

Locked ownable synchronizers:
- None

"Worker-JM" - Thread t@95
java.lang.Thread.State: WAITING
at java.lang.Object.wait(Native Method)
- waiting on <1a031a03> (a java.util.ArrayList)
at java.lang.Object.wait(Object.java:196)
at org.eclipse.core.internal.jobs.InternalWorker.run(InternalWorker.java:58)
- locked <1a031a03> (a java.util.ArrayList)

Locked ownable synchronizers:
- None

"Worker-0" - Thread t@99
java.lang.Thread.State: TIMED_WAITING
at java.lang.Object.wait(Native Method)
- waiting on <6fde6fde> (a org.eclipse.core.internal.jobs.WorkerPool)
at java.lang.Object.wait(Object.java:196)
at org.eclipse.core.internal.jobs.WorkerPool.sleep(WorkerPool.java:185)
- locked <6fde6fde> (a org.eclipse.core.internal.jobs.WorkerPool)
at org.eclipse.core.internal.jobs.WorkerPool.startJob(WorkerPool.java:217)
at org.eclipse.core.internal.jobs.Worker.run(Worker.java:50)

Locked ownable synchronizers:
- None

"Java indexing" - Thread t@100
java.lang.Thread.State: WAITING
at java.lang.Object.wait(Native Method)
- waiting on <7eef7eef> (a org.eclipse.jdt.internal.core.search.indexing.IndexManager)
at java.lang.Object.wait(Object.java:167)
at org.eclipse.jdt.internal.core.search.processing.JobManager.run(JobManager.java:381)
- locked <7eef7eef> (a org.eclipse.jdt.internal.core.search.indexing.IndexManager)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"Worker-1" - Thread t@101
java.lang.Thread.State: TIMED_WAITING
at java.lang.Object.wait(Native Method)
- waiting on <6fde6fde> (a org.eclipse.core.internal.jobs.WorkerPool)
at java.lang.Object.wait(Object.java:196)
at org.eclipse.core.internal.jobs.WorkerPool.sleep(WorkerPool.java:185)
- locked <6fde6fde> (a org.eclipse.core.internal.jobs.WorkerPool)
at org.eclipse.core.internal.jobs.WorkerPool.startJob(WorkerPool.java:217)
at org.eclipse.core.internal.jobs.Worker.run(Worker.java:50)

Locked ownable synchronizers:
- None

"CommonCache Scrubber" - Thread t@102
java.lang.Thread.State: TIMED_WAITING
at java.lang.Object.wait(Native Method)
- waiting on <749d749d> (a java.util.Timer$TimerImpl)
at java.lang.Object.wait(Object.java:196)
at java.util.Timer$TimerImpl.run(Timer.java:246)
- locked <749d749d> (a java.util.Timer$TimerImpl)

Locked ownable synchronizers:
- None

"[Timer] - Main Queue Handler" - Thread t@103
java.lang.Thread.State: TIMED_WAITING
at java.lang.Object.wait(Native Method)
- waiting on <47904790> (a java.lang.Object)
at java.lang.Object.wait(Object.java:196)
at org.eclipse.equinox.internal.util.impl.tpt.timer.TimerImpl.run(TimerImpl.java:141)
- locked <47904790> (a java.lang.Object)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"[ThreadPool Manager] - Idle Thread" - Thread t@104
java.lang.Thread.State: WAITING
at java.lang.Object.wait(Native Method)
- waiting on <6e7f6e7f> (a org.eclipse.equinox.internal.util.impl.tpt.threadpool.Executor)
at java.lang.Object.wait(Object.java:167)
at org.eclipse.equinox.internal.util.impl.tpt.threadpool.Executor.run(Executor.java:106)
- locked <6e7f6e7f> (a org.eclipse.equinox.internal.util.impl.tpt.threadpool.Executor)

Locked ownable synchronizers:
- None

"Bundle File Closer" - Thread t@105
java.lang.Thread.State: WAITING
at java.lang.Object.wait(Native Method)
- waiting on <72eb72eb> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
at java.lang.Object.wait(Object.java:167)
at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.getNextEvent(EventManager.java:397)
- locked <72eb72eb> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.run(EventManager.java:333)

Locked ownable synchronizers:
- None

"pool-34-thread-1" - Thread t@106
java.lang.Thread.State: TIMED_WAITING
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <7efd7efd> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:211)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"Start Level Event Dispatcher" - Thread t@107
java.lang.Thread.State: WAITING
at java.lang.Object.wait(Native Method)
- waiting on <ee60ee6> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
at java.lang.Object.wait(Object.java:167)
at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.getNextEvent(EventManager.java:397)
- locked <ee60ee6> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.run(EventManager.java:333)

Locked ownable synchronizers:
- None

"Framework Event Dispatcher" - Thread t@108
java.lang.Thread.State: WAITING
at java.lang.Object.wait(Native Method)
- waiting on <61bb61bb> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
at java.lang.Object.wait(Object.java:167)
at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.getNextEvent(EventManager.java:397)
- locked <61bb61bb> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.run(EventManager.java:333)

Locked ownable synchronizers:
- None

"Worker-JM" - Thread t@109
java.lang.Thread.State: WAITING
at java.lang.Object.wait(Native Method)
- waiting on <59a459a4> (a java.util.ArrayList)
at java.lang.Object.wait(Object.java:196)
at org.eclipse.core.internal.jobs.InternalWorker.run(InternalWorker.java:58)
- locked <59a459a4> (a java.util.ArrayList)

Locked ownable synchronizers:
- None

"CommonCache Scrubber" - Thread t@113
java.lang.Thread.State: TIMED_WAITING
at java.lang.Object.wait(Native Method)
- waiting on <58515851> (a java.util.Timer$TimerImpl)
at java.lang.Object.wait(Object.java:196)
at java.util.Timer$TimerImpl.run(Timer.java:246)
- locked <58515851> (a java.util.Timer$TimerImpl)

Locked ownable synchronizers:
- None

"pool-43-thread-1" - Thread t@114
java.lang.Thread.State: TIMED_WAITING
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <228a228a> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:211)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"[Timer] - Main Queue Handler" - Thread t@115
java.lang.Thread.State: TIMED_WAITING
at java.lang.Object.wait(Native Method)
- waiting on <f8e0f8e> (a java.lang.Object)
at java.lang.Object.wait(Object.java:196)
at org.eclipse.equinox.internal.util.impl.tpt.timer.TimerImpl.run(TimerImpl.java:141)
- locked <f8e0f8e> (a java.lang.Object)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"[ThreadPool Manager] - Idle Thread" - Thread t@116
java.lang.Thread.State: WAITING
at java.lang.Object.wait(Native Method)
- waiting on <34cd34cd> (a org.eclipse.equinox.internal.util.impl.tpt.threadpool.Executor)
at java.lang.Object.wait(Object.java:167)
at org.eclipse.equinox.internal.util.impl.tpt.threadpool.Executor.run(Executor.java:106)
- locked <34cd34cd> (a org.eclipse.equinox.internal.util.impl.tpt.threadpool.Executor)

Locked ownable synchronizers:
- None

"RRC-Project Add Signal Watcher" - Thread t@117
java.lang.Thread.State: WAITING
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <4df54df5> (a java.util.concurrent.CountDownLatch$Sync)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:171)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:811)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:969)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1281)
at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:207)
at com.ibm.team.jfs.app.distributed.InMemorySignal.waitFor(InMemorySignal.java:41)
at com.ibm.rdm.fronting.server.services.types.internal.WellKnownTypesCache$1.run(WellKnownTypesCache.java:129)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"RRC-Project Removed Signal Watcher" - Thread t@118
java.lang.Thread.State: WAITING
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <4eba4eba> (a java.util.concurrent.CountDownLatch$Sync)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:171)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:811)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:969)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1281)
at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:207)
at com.ibm.team.jfs.app.distributed.InMemorySignal.waitFor(InMemorySignal.java:41)
at com.ibm.rdm.fronting.server.services.types.internal.WellKnownTypesCache$2.run(WellKnownTypesCache.java:200)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"pool-45-thread-1" - Thread t@119
java.lang.Thread.State: TIMED_WAITING
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <44674467> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:211)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"RRC-Fronting Property Signal Watcher" - Thread t@120
java.lang.Thread.State: WAITING
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <10701070> (a java.util.concurrent.CountDownLatch$Sync)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:171)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:811)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:969)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1281)
at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:207)
at com.ibm.team.jfs.app.distributed.InMemorySignal.waitFor(InMemorySignal.java:41)
at com.ibm.rdm.fronting.server.util.ConfigImpl$1.run(ConfigImpl.java:507)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"EventAdmin Async Event Dispatcher Thread" - Thread t@121
java.lang.Thread.State: WAITING
at java.lang.Object.wait(Native Method)
- waiting on <7b137b13> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
at java.lang.Object.wait(Object.java:167)
at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.getNextEvent(EventManager.java:397)
- locked <7b137b13> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.run(EventManager.java:333)

Locked ownable synchronizers:
- None

"Shared FriendsConfig Update Listener" - Thread t@122
java.lang.Thread.State: WAITING
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <28042804> (a java.util.concurrent.CountDownLatch$Sync)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:171)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:811)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:969)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1281)
at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:207)
at com.ibm.team.jfs.app.distributed.InMemorySignal.waitFor(InMemorySignal.java:41)
at com.ibm.team.jfs.app.friendsconfig.internal.InMemoryFriendsConfigStorage$1.run(InMemoryFriendsConfigStorage.java:247)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"pool-40-thread-1" - Thread t@123
java.lang.Thread.State: TIMED_WAITING
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <22d622d6> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:211)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"Bundle File Closer" - Thread t@125
java.lang.Thread.State: WAITING
at java.lang.Object.wait(Native Method)
- waiting on <488c488c> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
at java.lang.Object.wait(Object.java:167)
at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.getNextEvent(EventManager.java:397)
- locked <488c488c> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.run(EventManager.java:333)

Locked ownable synchronizers:
- None

"Worker-1" - Thread t@126
java.lang.Thread.State: TIMED_WAITING
at java.lang.Object.wait(Native Method)
- waiting on <279b279b> (a org.eclipse.core.internal.jobs.WorkerPool)
at java.lang.Object.wait(Object.java:196)
at org.eclipse.core.internal.jobs.WorkerPool.sleep(WorkerPool.java:188)
- locked <279b279b> (a org.eclipse.core.internal.jobs.WorkerPool)
at org.eclipse.core.internal.jobs.WorkerPool.startJob(WorkerPool.java:220)
at org.eclipse.core.internal.jobs.Worker.run(Worker.java:50)

Locked ownable synchronizers:
- None

"ContainerBackgroundProcessor[StandardEngine[Catalina]]" - Thread t@127
java.lang.Thread.State: TIMED_WAITING
at java.lang.Thread.sleep(Native Method)
at java.lang.Thread.sleep(Thread.java:851)
at org.apache.catalina.core.ContainerBase$ContainerBackgroundProcessor.run(ContainerBase.java:1517)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"http-bio-9080-Acceptor-0" - Thread t@128
java.lang.Thread.State: RUNNABLE
at java.net.PlainSocketImpl.socketAccept(Native Method)
at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:438)
- locked <69376937> (a java.net.SocksSocketImpl)
at java.net.ServerSocket.implAccept(ServerSocket.java:462)
at java.net.ServerSocket.accept(ServerSocket.java:430)
at org.apache.tomcat.util.net.DefaultServerSocketFactory.acceptSocket(DefaultServerSocketFactory.java:60)
at org.apache.tomcat.util.net.JIoEndpoint$Acceptor.run(JIoEndpoint.java:216)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"http-bio-9080-AsyncTimeout" - Thread t@129
java.lang.Thread.State: TIMED_WAITING
at java.lang.Thread.sleep(Native Method)
at java.lang.Thread.sleep(Thread.java:851)
at org.apache.tomcat.util.net.JIoEndpoint$AsyncTimeout.run(JIoEndpoint.java:148)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"http-bio-9443-Acceptor-0" - Thread t@130
java.lang.Thread.State: RUNNABLE
at java.net.PlainSocketImpl.socketAccept(Native Method)
at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:438)
- locked <661b661b> (a java.net.SocksSocketImpl)
at java.net.ServerSocket.implAccept(ServerSocket.java:462)
at com.ibm.jsse2.cd.accept(cd.java:35)
at org.apache.tomcat.util.net.jsse.JSSESocketFactory.acceptSocket(JSSESocketFactory.java:182)
at org.apache.tomcat.util.net.JIoEndpoint$Acceptor.run(JIoEndpoint.java:216)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"http-bio-9443-AsyncTimeout" - Thread t@131
java.lang.Thread.State: TIMED_WAITING
at java.lang.Thread.sleep(Native Method)
at java.lang.Thread.sleep(Thread.java:851)
at org.apache.tomcat.util.net.JIoEndpoint$AsyncTimeout.run(JIoEndpoint.java:148)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"ajp-bio-9009-Acceptor-0" - Thread t@132
java.lang.Thread.State: RUNNABLE
at java.net.PlainSocketImpl.socketAccept(Native Method)
at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:438)
- locked <10f110f1> (a java.net.SocksSocketImpl)
at java.net.ServerSocket.implAccept(ServerSocket.java:462)
at java.net.ServerSocket.accept(ServerSocket.java:430)
at org.apache.tomcat.util.net.DefaultServerSocketFactory.acceptSocket(DefaultServerSocketFactory.java:60)
at org.apache.tomcat.util.net.JIoEndpoint$Acceptor.run(JIoEndpoint.java:216)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"ajp-bio-9009-AsyncTimeout" - Thread t@133
java.lang.Thread.State: TIMED_WAITING
at java.lang.Thread.sleep(Native Method)
at java.lang.Thread.sleep(Thread.java:851)
at org.apache.tomcat.util.net.JIoEndpoint$AsyncTimeout.run(JIoEndpoint.java:148)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"[ThreadPool Manager] - Idle Thread" - Thread t@135
java.lang.Thread.State: WAITING
at java.lang.Object.wait(Native Method)
- waiting on <372d372d> (a org.eclipse.equinox.internal.util.impl.tpt.threadpool.Executor)
at java.lang.Object.wait(Object.java:167)
at org.eclipse.equinox.internal.util.impl.tpt.threadpool.Executor.run(Executor.java:106)
- locked <372d372d> (a org.eclipse.equinox.internal.util.impl.tpt.threadpool.Executor)

Locked ownable synchronizers:
- None

"pool-7-thread-1" - Thread t@136
java.lang.Thread.State: WAITING
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <6fa16fa1> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:171)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
at java.util.concurrent.DelayQueue.take(DelayQueue.java:160)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"pool-13-thread-1" - Thread t@137
java.lang.Thread.State: WAITING
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <1cab1cab> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:171)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
at java.util.concurrent.DelayQueue.take(DelayQueue.java:160)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"pool-27-thread-1" - Thread t@138
java.lang.Thread.State: WAITING
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <36ae36ae> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:171)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
at java.util.concurrent.DelayQueue.take(DelayQueue.java:160)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"pool-33-thread-1" - Thread t@139
java.lang.Thread.State: WAITING
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <44074407> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:171)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
at java.util.concurrent.DelayQueue.take(DelayQueue.java:160)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"pool-44-thread-1" - Thread t@140
java.lang.Thread.State: WAITING
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <29222922> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:171)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
at java.util.concurrent.DelayQueue.take(DelayQueue.java:160)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"http-bio-9443-exec-1" - Thread t@141
java.lang.Thread.State: TIMED_WAITING
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <70117011> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:211)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:424)
at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:86)
at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:32)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:945)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"http-bio-9443-exec-2" - Thread t@142
java.lang.Thread.State: RUNNABLE
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:129)
at com.ibm.jsse2.b.a(b.java:95)
at com.ibm.jsse2.b.a(b.java:65)
at com.ibm.jsse2.SSLSocketImpl.a(SSLSocketImpl.java:242)
- locked <6a0b6a0b> (a java.lang.Object)
at com.ibm.jsse2.SSLSocketImpl.a(SSLSocketImpl.java:773)
at com.ibm.jsse2.f.read(f.java:26)
- locked <6a336a33> (a com.ibm.jsse2.f)
at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:516)
at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:501)
at org.apache.coyote.http11.Http11Processor.setRequestLineReadTimeout(Http11Processor.java:172)
at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:912)
at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:579)
at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:309)
- locked <6cdd6cdd> (a org.apache.tomcat.util.net.SocketWrapper)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- locked <42164216> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

"http-bio-9443-exec-3" - Thread t@143
java.lang.Thread.State: TIMED_WAITING
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <70117011> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:211)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:424)
at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:86)
at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:32)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:945)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"http-bio-9443-exec-4" - Thread t@144
java.lang.Thread.State: TIMED_WAITING
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <70117011> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:211)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:424)
at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:86)
at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:32)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:945)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"http-bio-9443-exec-5" - Thread t@145
java.lang.Thread.State: RUNNABLE
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:129)
at com.ibm.jsse2.b.a(b.java:95)
at com.ibm.jsse2.b.a(b.java:65)
at com.ibm.jsse2.SSLSocketImpl.a(SSLSocketImpl.java:242)
- locked <273b273b> (a java.lang.Object)
at com.ibm.jsse2.SSLSocketImpl.a(SSLSocketImpl.java:773)
at com.ibm.jsse2.f.read(f.java:26)
- locked <27632763> (a com.ibm.jsse2.f)
at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:516)
at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:501)
at org.apache.coyote.http11.Http11Processor.setRequestLineReadTimeout(Http11Processor.java:172)
at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:912)
at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:579)
at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:309)
- locked <7a4f7a4f> (a org.apache.tomcat.util.net.SocketWrapper)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- locked <6570657> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

"http-bio-9443-exec-6" - Thread t@146
java.lang.Thread.State: TIMED_WAITING
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <70117011> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:211)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:424)
at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:86)
at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:32)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:945)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"http-bio-9443-exec-7" - Thread t@147
java.lang.Thread.State: RUNNABLE
at java.net.Inet6AddressImpl.lookupAllHostAddr(Native Method)
at java.net.InetAddress$2.lookupAllHostAddr(InetAddress.java:937)
at java.net.InetAddress.getAddressFromNameService(InetAddress.java:1308)
at java.net.InetAddress.getAllByName0(InetAddress.java:1256)
at java.net.InetAddress.getAllByName(InetAddress.java:1185)
at java.net.InetAddress.getAllByName(InetAddress.java:1107)
at java.net.InetAddress.getByName(InetAddress.java:1057)
at java.net.URLStreamHandler.getHostAddress(URLStreamHandler.java:426)
- locked <64ee64ee> (a net.jazz.ajax.model.BundleResourceStreamHandler)
at java.net.URLStreamHandler.hashCode(URLStreamHandler.java:343)
at java.net.URL.hashCode(URL.java:858)
- locked <64c664c6> (a java.net.URL)
at java.util.HashMap.putImpl(HashMap.java:622)
at java.util.HashMap.put(HashMap.java:607)
at net.jazz.ajax.model.SpriteLayout$Algorithm.loadImages(SpriteLayout.java:106)
at net.jazz.ajax.model.SpriteLayout$Algorithm.solve(SpriteLayout.java:88)
at net.jazz.ajax.model.SpriteLayout.<init>(SpriteLayout.java:48)
at net.jazz.ajax.model.Sprite.getLayout(Sprite.java:83)
at net.jazz.ajax.model.Sprite.getState(Sprite.java:113)
at net.jazz.ajax.servlets.ResourceGraph.trackState(ResourceGraph.java:286)
at net.jazz.ajax.servlets.ResourceGraph.<init>(ResourceGraph.java:70)
at net.jazz.ajax.servlets.ResourceGraphOperation.getResult(ResourceGraphOperation.java:61)
at net.jazz.ajax.internal.util.Cache.execute(Cache.java:78)
at net.jazz.ajax.internal.util.CacheableOperation.execute(CacheableOperation.java:32)
at net.jazz.ajax.model.AjaxPage.write(AjaxPage.java:100)
at net.jazz.ajax.servlets.AjaxPageServlet.doGet(AjaxPageServlet.java:31)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:621)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:722)
at net.jazz.ajax.servlets.LoggingHttpServlet.service(LoggingHttpServlet.java:35)
at org.eclipse.equinox.http.servlet.internal.ServletRegistration.service(ServletRegistration.java:61)
at org.eclipse.equinox.http.servlet.internal.ProxyServlet.processAlias(ProxyServlet.java:126)
at org.eclipse.equinox.http.servlet.internal.ProxyServlet.service(ProxyServlet.java:60)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:722)
at org.eclipse.equinox.servletbridge.BridgeServlet.service(BridgeServlet.java:120)
at com.ibm.team.repository.server.servletbridge.JazzServlet.service(JazzServlet.java:68)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:722)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:305)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
at com.ibm.team.repository.server.servletbridge.BridgeFilter.processDelegate(BridgeFilter.java:133)
at com.ibm.team.repository.server.servletbridge.BridgeFilter.initialize(BridgeFilter.java:264)
at com.ibm.team.repository.server.servletbridge.BridgeFilter.doFilter(BridgeFilter.java:149)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:224)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:169)
at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:581)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:168)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:98)
at org.apache.catalina.authenticator.SingleSignOn.invoke(SingleSignOn.java:336)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:118)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:407)
at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:987)
at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:579)
at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:307)
- locked <32f432f4> (a org.apache.tomcat.util.net.SocketWrapper)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- locked <33053305> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

"http-bio-9443-exec-8" - Thread t@148
java.lang.Thread.State: RUNNABLE
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:129)
at com.ibm.jsse2.b.a(b.java:95)
at com.ibm.jsse2.b.a(b.java:65)
at com.ibm.jsse2.SSLSocketImpl.a(SSLSocketImpl.java:242)
- locked <7a957a95> (a java.lang.Object)
at com.ibm.jsse2.SSLSocketImpl.a(SSLSocketImpl.java:773)
at com.ibm.jsse2.f.read(f.java:26)
- locked <7abd7abd> (a com.ibm.jsse2.f)
at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:516)
at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:501)
at org.apache.coyote.http11.Http11Processor.setRequestLineReadTimeout(Http11Processor.java:172)
at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:912)
at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:579)
at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:309)
- locked <53f753f7> (a org.apache.tomcat.util.net.SocketWrapper)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- locked <44fc44fc> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

"jts: AsynchronousTaskRunner-0" - Thread t@151
java.lang.Thread.State: WAITING
at java.lang.Object.wait(Native Method)
- waiting on <5b305b3> (a java.util.LinkedList)
at java.lang.Object.wait(Object.java:167)
at com.ibm.team.repository.service.internal.scheduler.AsynchronousTaskManager.getNextTask(AsynchronousTaskManager.java:286)
- locked <5b305b3> (a java.util.LinkedList)
at com.ibm.team.repository.service.internal.scheduler.AsynchronousTaskRunner.run(AsynchronousTaskRunner.java:96)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"jts: AsynchronousTaskRunner-1" - Thread t@152
java.lang.Thread.State: WAITING
at java.lang.Object.wait(Native Method)
- waiting on <5b305b3> (a java.util.LinkedList)
at java.lang.Object.wait(Object.java:167)
at com.ibm.team.repository.service.internal.scheduler.AsynchronousTaskManager.getNextTask(AsynchronousTaskManager.java:286)
- locked <5b305b3> (a java.util.LinkedList)
at com.ibm.team.repository.service.internal.scheduler.AsynchronousTaskRunner.run(AsynchronousTaskRunner.java:96)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"jts: AsynchronousTaskRunner-2" - Thread t@153
java.lang.Thread.State: WAITING
at java.lang.Object.wait(Native Method)
- waiting on <5b305b3> (a java.util.LinkedList)
at java.lang.Object.wait(Object.java:167)
at com.ibm.team.repository.service.internal.scheduler.AsynchronousTaskManager.getNextTask(AsynchronousTaskManager.java:286)
- locked <5b305b3> (a java.util.LinkedList)
at com.ibm.team.repository.service.internal.scheduler.AsynchronousTaskRunner.run(AsynchronousTaskRunner.java:96)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"jts: AsynchronousTaskRunner-3" - Thread t@154
java.lang.Thread.State: WAITING
at java.lang.Object.wait(Native Method)
- waiting on <5b305b3> (a java.util.LinkedList)
at java.lang.Object.wait(Object.java:167)
at com.ibm.team.repository.service.internal.scheduler.AsynchronousTaskManager.getNextTask(AsynchronousTaskManager.java:286)
- locked <5b305b3> (a java.util.LinkedList)
at com.ibm.team.repository.service.internal.scheduler.AsynchronousTaskRunner.run(AsynchronousTaskRunner.java:96)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"jts: AsynchronousTaskRunner-4" - Thread t@155
java.lang.Thread.State: WAITING
at java.lang.Object.wait(Native Method)
- waiting on <5b305b3> (a java.util.LinkedList)
at java.lang.Object.wait(Object.java:167)
at com.ibm.team.repository.service.internal.scheduler.AsynchronousTaskManager.getNextTask(AsynchronousTaskManager.java:286)
- locked <5b305b3> (a java.util.LinkedList)
at com.ibm.team.repository.service.internal.scheduler.AsynchronousTaskRunner.run(AsynchronousTaskRunner.java:96)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"jts: Asynchronous local task scheduler" - Thread t@156
java.lang.Thread.State: TIMED_WAITING
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <3e0a3e0a> (a java.util.concurrent.CountDownLatch$Sync)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:211)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1011)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1303)
at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:253)
at com.ibm.team.repository.service.internal.AsynchronousTaskSchedulerService.runQueueingLoopOnce(AsynchronousTaskSchedulerService.java:457)
at com.ibm.team.repository.service.internal.AsynchronousTaskSchedulerService.runQueueingLoop(AsynchronousTaskSchedulerService.java:284)
at com.ibm.team.repository.service.internal.AsynchronousTaskSchedulerService.access$2(AsynchronousTaskSchedulerService.java:279)
at com.ibm.team.repository.service.internal.AsynchronousTaskSchedulerService$1.run(AsynchronousTaskSchedulerService.java:213)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"jts: Asynchronous global task scheduler" - Thread t@157
java.lang.Thread.State: TIMED_WAITING
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <710f710f> (a java.util.concurrent.CountDownLatch$Sync)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:211)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1011)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1303)
at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:253)
at com.ibm.team.repository.service.internal.AsynchronousTaskSchedulerService.runQueueingLoopOnce(AsynchronousTaskSchedulerService.java:457)
at com.ibm.team.repository.service.internal.AsynchronousTaskSchedulerService.runQueueingLoop(AsynchronousTaskSchedulerService.java:284)
at com.ibm.team.repository.service.internal.AsynchronousTaskSchedulerService.access$2(AsynchronousTaskSchedulerService.java:279)
at com.ibm.team.repository.service.internal.AsynchronousTaskSchedulerService$2.run(AsynchronousTaskSchedulerService.java:220)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"jena.query.monitor" - Thread t@159
java.lang.Thread.State: TIMED_WAITING
at java.lang.Thread.sleep(Native Method)
at java.lang.Thread.sleep(Thread.java:851)
at com.ibm.team.jfs.rdf.internal.jena.provider.JenaQueryMonitor.run(JenaQueryMonitor.java:279)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"http-bio-9443-exec-9" - Thread t@160
java.lang.Thread.State: TIMED_WAITING
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <70117011> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:211)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:424)
at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:86)
at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:32)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:945)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"Rational Common Licensing License Operation Handler" - Thread t@161
java.lang.Thread.State: TIMED_WAITING
at java.lang.Thread.sleep(Native Method)
at java.lang.Thread.sleep(Thread.java:851)
at com.ibm.rational.common.token.licensing.LicenseActionHandler.run(LicenseActionHandler.java:95)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"Failure handler" - Thread t@162
java.lang.Thread.State: TIMED_WAITING
at java.lang.Thread.sleep(Native Method)
at java.lang.Thread.sleep(Thread.java:851)
at com.ibm.rational.common.token.licensing.FailureHandler.run(FailureHandler.java:110)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"Rational Common Licensing Check In Handler 1" - Thread t@163
java.lang.Thread.State: TIMED_WAITING
at java.lang.Thread.sleep(Native Method)
at java.lang.Thread.sleep(Thread.java:851)
at com.ibm.rational.common.token.licensing.RLSTokenService$RLSTokenLicenseControlCheckInHandler.run(RLSTokenService.java:510)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"http-bio-9443-exec-10" - Thread t@164
java.lang.Thread.State: RUNNABLE
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:129)
at com.ibm.jsse2.b.a(b.java:95)
at com.ibm.jsse2.b.a(b.java:65)
at com.ibm.jsse2.SSLSocketImpl.a(SSLSocketImpl.java:242)
- locked <1d3f1d3f> (a java.lang.Object)
at com.ibm.jsse2.SSLSocketImpl.a(SSLSocketImpl.java:773)
at com.ibm.jsse2.f.read(f.java:26)
- locked <1d671d67> (a com.ibm.jsse2.f)
at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:516)
at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:501)
at org.apache.coyote.http11.Http11Processor.setRequestLineReadTimeout(Http11Processor.java:172)
at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:912)
at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:579)
at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:309)
- locked <1ba41ba4> (a org.apache.tomcat.util.net.SocketWrapper)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- locked <394b394b> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

"http-bio-9443-exec-11" - Thread t@166
java.lang.Thread.State: RUNNABLE
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:129)
at com.ibm.jsse2.b.a(b.java:95)
at com.ibm.jsse2.b.a(b.java:65)
at com.ibm.jsse2.SSLSocketImpl.a(SSLSocketImpl.java:242)
- locked <74f974f9> (a java.lang.Object)
at com.ibm.jsse2.SSLSocketImpl.a(SSLSocketImpl.java:773)
at com.ibm.jsse2.f.read(f.java:26)
- locked <75217521> (a com.ibm.jsse2.f)
at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:516)
at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:501)
at org.apache.coyote.http11.Http11Processor.setRequestLineReadTimeout(Http11Processor.java:172)
at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:912)
at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:579)
at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:309)
- locked <76507650> (a org.apache.tomcat.util.net.SocketWrapper)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- locked <58a658a6> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

"http-bio-9443-exec-12" - Thread t@167
java.lang.Thread.State: RUNNABLE
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:129)
at com.ibm.jsse2.b.a(b.java:95)
at com.ibm.jsse2.b.a(b.java:65)
at com.ibm.jsse2.SSLSocketImpl.a(SSLSocketImpl.java:242)
- locked <6d236d23> (a java.lang.Object)
at com.ibm.jsse2.SSLSocketImpl.a(SSLSocketImpl.java:773)
at com.ibm.jsse2.f.read(f.java:26)
- locked <6d4b6d4b> (a com.ibm.jsse2.f)
at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:516)
at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:501)
at org.apache.coyote.http11.Http11Processor.setRequestLineReadTimeout(Http11Processor.java:172)
at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:912)
at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:579)
at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:309)
- locked <648b648b> (a org.apache.tomcat.util.net.SocketWrapper)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- locked <599e599e> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

"http-bio-9443-exec-13" - Thread t@168
java.lang.Thread.State: RUNNABLE
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:129)
at com.ibm.jsse2.b.a(b.java:95)
at com.ibm.jsse2.b.a(b.java:65)
at com.ibm.jsse2.SSLSocketImpl.a(SSLSocketImpl.java:242)
- locked <1bea1bea> (a java.lang.Object)
at com.ibm.jsse2.SSLSocketImpl.a(SSLSocketImpl.java:773)
at com.ibm.jsse2.f.read(f.java:26)
- locked <1c121c12> (a com.ibm.jsse2.f)
at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:516)
at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:501)
at org.apache.coyote.http11.Http11Processor.setRequestLineReadTimeout(Http11Processor.java:172)
at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:912)
at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:579)
at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:309)
- locked <26f526f5> (a org.apache.tomcat.util.net.SocketWrapper)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- locked <63696369> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

"qm: AsynchronousTaskRunner-0" - Thread t@171
java.lang.Thread.State: WAITING
at java.lang.Object.wait(Native Method)
- waiting on <4dc04dc> (a java.util.LinkedList)
at java.lang.Object.wait(Object.java:167)
at com.ibm.team.repository.service.internal.scheduler.AsynchronousTaskManager.getNextTask(AsynchronousTaskManager.java:286)
- locked <4dc04dc> (a java.util.LinkedList)
at com.ibm.team.repository.service.internal.scheduler.AsynchronousTaskRunner.run(AsynchronousTaskRunner.java:96)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"qm: AsynchronousTaskRunner-1" - Thread t@172
java.lang.Thread.State: WAITING
at java.lang.Object.wait(Native Method)
- waiting on <4dc04dc> (a java.util.LinkedList)
at java.lang.Object.wait(Object.java:167)
at com.ibm.team.repository.service.internal.scheduler.AsynchronousTaskManager.getNextTask(AsynchronousTaskManager.java:286)
- locked <4dc04dc> (a java.util.LinkedList)
at com.ibm.team.repository.service.internal.scheduler.AsynchronousTaskRunner.run(AsynchronousTaskRunner.java:96)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"qm: AsynchronousTaskRunner-2" - Thread t@173
java.lang.Thread.State: WAITING
at java.lang.Object.wait(Native Method)
- waiting on <4dc04dc> (a java.util.LinkedList)
at java.lang.Object.wait(Object.java:167)
at com.ibm.team.repository.service.internal.scheduler.AsynchronousTaskManager.getNextTask(AsynchronousTaskManager.java:286)
- locked <4dc04dc> (a java.util.LinkedList)
at com.ibm.team.repository.service.internal.scheduler.AsynchronousTaskRunner.run(AsynchronousTaskRunner.java:96)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"qm: AsynchronousTaskRunner-3" - Thread t@174
java.lang.Thread.State: WAITING
at java.lang.Object.wait(Native Method)
- waiting on <4dc04dc> (a java.util.LinkedList)
at java.lang.Object.wait(Object.java:167)
at com.ibm.team.repository.service.internal.scheduler.AsynchronousTaskManager.getNextTask(AsynchronousTaskManager.java:286)
- locked <4dc04dc> (a java.util.LinkedList)
at com.ibm.team.repository.service.internal.scheduler.AsynchronousTaskRunner.run(AsynchronousTaskRunner.java:96)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"qm: AsynchronousTaskRunner-4" - Thread t@175
java.lang.Thread.State: WAITING
at java.lang.Object.wait(Native Method)
- waiting on <4dc04dc> (a java.util.LinkedList)
at java.lang.Object.wait(Object.java:167)
at com.ibm.team.repository.service.internal.scheduler.AsynchronousTaskManager.getNextTask(AsynchronousTaskManager.java:286)
- locked <4dc04dc> (a java.util.LinkedList)
at com.ibm.team.repository.service.internal.scheduler.AsynchronousTaskRunner.run(AsynchronousTaskRunner.java:96)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"qm: Asynchronous local task scheduler" - Thread t@176
java.lang.Thread.State: TIMED_WAITING
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <44a744a7> (a java.util.concurrent.CountDownLatch$Sync)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:211)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1011)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1303)
at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:253)
at com.ibm.team.repository.service.internal.AsynchronousTaskSchedulerService.runQueueingLoopOnce(AsynchronousTaskSchedulerService.java:457)
at com.ibm.team.repository.service.internal.AsynchronousTaskSchedulerService.runQueueingLoop(AsynchronousTaskSchedulerService.java:284)
at com.ibm.team.repository.service.internal.AsynchronousTaskSchedulerService.access$2(AsynchronousTaskSchedulerService.java:279)
at com.ibm.team.repository.service.internal.AsynchronousTaskSchedulerService$1.run(AsynchronousTaskSchedulerService.java:213)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"qm: Asynchronous global task scheduler" - Thread t@177
java.lang.Thread.State: TIMED_WAITING
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <1c281c28> (a java.util.concurrent.CountDownLatch$Sync)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:211)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1011)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1303)
at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:253)
at com.ibm.team.repository.service.internal.AsynchronousTaskSchedulerService.runQueueingLoopOnce(AsynchronousTaskSchedulerService.java:457)
at com.ibm.team.repository.service.internal.AsynchronousTaskSchedulerService.runQueueingLoop(AsynchronousTaskSchedulerService.java:284)
at com.ibm.team.repository.service.internal.AsynchronousTaskSchedulerService.access$2(AsynchronousTaskSchedulerService.java:279)
at com.ibm.team.repository.service.internal.AsynchronousTaskSchedulerService$2.run(AsynchronousTaskSchedulerService.java:220)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"http-bio-9443-exec-14" - Thread t@178
java.lang.Thread.State: TIMED_WAITING
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <70117011> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:211)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:424)
at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:86)
at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:32)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:945)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"http-bio-9443-exec-15" - Thread t@179
java.lang.Thread.State: TIMED_WAITING
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <70117011> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:211)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:424)
at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:86)
at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:32)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:945)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"http-bio-9443-exec-16" - Thread t@180
java.lang.Thread.State: RUNNABLE
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:129)
at com.ibm.jsse2.b.a(b.java:95)
at com.ibm.jsse2.b.a(b.java:65)
at com.ibm.jsse2.SSLSocketImpl.a(SSLSocketImpl.java:242)
- locked <225d225d> (a java.lang.Object)
at com.ibm.jsse2.SSLSocketImpl.a(SSLSocketImpl.java:773)
at com.ibm.jsse2.f.read(f.java:26)
- locked <22852285> (a com.ibm.jsse2.f)
at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:516)
at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:501)
at org.apache.coyote.http11.Http11Processor.setRequestLineReadTimeout(Http11Processor.java:172)
at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:912)
at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:579)
at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:309)
- locked <1cf91cf9> (a org.apache.tomcat.util.net.SocketWrapper)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- locked <2bb02bb0> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

"http-bio-9443-exec-17" - Thread t@181
java.lang.Thread.State: RUNNABLE
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:129)
at com.ibm.jsse2.b.a(b.java:95)
at com.ibm.jsse2.b.a(b.java:65)
at com.ibm.jsse2.SSLSocketImpl.a(SSLSocketImpl.java:242)
- locked <76967696> (a java.lang.Object)
at com.ibm.jsse2.SSLSocketImpl.a(SSLSocketImpl.java:773)
at com.ibm.jsse2.f.read(f.java:26)
- locked <76be76be> (a com.ibm.jsse2.f)
at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:516)
at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:501)
at org.apache.coyote.http11.Http11Processor.setRequestLineReadTimeout(Http11Processor.java:172)
at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:912)
at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:579)
at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:309)
- locked <5c295c29> (a org.apache.tomcat.util.net.SocketWrapper)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- locked <2ecd2ecd> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

"http-bio-9443-exec-18" - Thread t@182
java.lang.Thread.State: RUNNABLE
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:129)
at com.ibm.jsse2.b.a(b.java:95)
at com.ibm.jsse2.b.a(b.java:65)
at com.ibm.jsse2.SSLSocketImpl.a(SSLSocketImpl.java:242)
- locked <543d543d> (a java.lang.Object)
at com.ibm.jsse2.SSLSocketImpl.a(SSLSocketImpl.java:773)
at com.ibm.jsse2.f.read(f.java:26)
- locked <54655465> (a com.ibm.jsse2.f)
at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:516)
at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:501)
at org.apache.coyote.http11.Http11Processor.setRequestLineReadTimeout(Http11Processor.java:172)
at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:912)
at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:579)
at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:309)
- locked <a550a55> (a org.apache.tomcat.util.net.SocketWrapper)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- locked <49184918> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

"http-bio-9443-exec-19" - Thread t@183
java.lang.Thread.State: TIMED_WAITING
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <70117011> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:211)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:424)
at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:86)
at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:32)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:945)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"http-bio-9443-exec-20" - Thread t@185
java.lang.Thread.State: RUNNABLE
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:129)
at com.ibm.jsse2.b.a(b.java:95)
at com.ibm.jsse2.b.a(b.java:65)
at com.ibm.jsse2.SSLSocketImpl.a(SSLSocketImpl.java:242)
- locked <15421542> (a java.lang.Object)
at com.ibm.jsse2.SSLSocketImpl.a(SSLSocketImpl.java:773)
at com.ibm.jsse2.f.read(f.java:26)
- locked <156a156a> (a com.ibm.jsse2.f)
at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:516)
at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:501)
at org.apache.coyote.http11.Http11Processor.setRequestLineReadTimeout(Http11Processor.java:172)
at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:912)
at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:579)
at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:309)
- locked <2bfc2bfc> (a org.apache.tomcat.util.net.SocketWrapper)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- locked <53405340> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

- locked <52715271> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

- locked <24612461> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

- locked <7dc77dc7> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

- locked <30573057> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

"http-bio-9443-exec-21" - Thread t@186
java.lang.Thread.State: RUNNABLE
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:129)
at com.ibm.jsse2.b.a(b.java:95)
at com.ibm.jsse2.b.a(b.java:65)
at com.ibm.jsse2.SSLSocketImpl.a(SSLSocketImpl.java:242)
- locked <5c6f5c6f> (a java.lang.Object)
at com.ibm.jsse2.SSLSocketImpl.a(SSLSocketImpl.java:773)
at com.ibm.jsse2.f.read(f.java:26)
- locked <5c975c97> (a com.ibm.jsse2.f)
at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:516)
at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:501)
at org.apache.coyote.http11.Http11Processor.setRequestLineReadTimeout(Http11Processor.java:172)
at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:912)
at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:579)
at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:309)
- locked <687a687a> (a org.apache.tomcat.util.net.SocketWrapper)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- locked <2ef92ef9> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

"jts: OAuth nonce cleanup timer" - Thread t@187
java.lang.Thread.State: TIMED_WAITING
at java.lang.Object.wait(Native Method)
- waiting on <288a288a> (a java.util.Timer$TimerImpl)
at java.lang.Object.wait(Object.java:196)
at java.util.Timer$TimerImpl.run(Timer.java:246)
- locked <288a288a> (a java.util.Timer$TimerImpl)

Locked ownable synchronizers:
- None

"http-bio-9443-exec-22" - Thread t@188
java.lang.Thread.State: TIMED_WAITING
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <70117011> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:211)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:424)
at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:86)
at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:32)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:945)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"http-bio-9443-exec-23" - Thread t@189
java.lang.Thread.State: TIMED_WAITING
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <70117011> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:211)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:424)
at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:86)
at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:32)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:945)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"jena.query.monitor" - Thread t@190
java.lang.Thread.State: TIMED_WAITING
at java.lang.Thread.sleep(Native Method)
at java.lang.Thread.sleep(Thread.java:851)
at com.ibm.team.jfs.rdf.internal.jena.provider.JenaQueryMonitor.run(JenaQueryMonitor.java:279)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"http-bio-9443-exec-24" - Thread t@192
java.lang.Thread.State: TIMED_WAITING
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <70117011> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:211)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:424)
at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:86)
at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:32)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:945)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"http-bio-9443-exec-25" - Thread t@193
java.lang.Thread.State: RUNNABLE
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:129)
at com.ibm.jsse2.b.a(b.java:95)
at com.ibm.jsse2.b.a(b.java:65)
at com.ibm.jsse2.SSLSocketImpl.a(SSLSocketImpl.java:242)
- locked <45a745a7> (a java.lang.Object)
at com.ibm.jsse2.SSLSocketImpl.a(SSLSocketImpl.java:773)
at com.ibm.jsse2.f.read(f.java:26)
- locked <45cf45cf> (a com.ibm.jsse2.f)
at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:516)
at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:501)
at org.apache.coyote.http11.Http11Processor.setRequestLineReadTimeout(Http11Processor.java:172)
at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:912)
at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:579)
at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:309)
- locked <227e227e> (a org.apache.tomcat.util.net.SocketWrapper)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- locked <6cb16cb1> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

"Worker-0" - Thread t@195
java.lang.Thread.State: TIMED_WAITING
at java.lang.Object.wait(Native Method)
- waiting on <2f842f84> (a org.eclipse.core.internal.jobs.WorkerPool)
at java.lang.Object.wait(Object.java:196)
at org.eclipse.core.internal.jobs.WorkerPool.sleep(WorkerPool.java:185)
- locked <2f842f84> (a org.eclipse.core.internal.jobs.WorkerPool)
at org.eclipse.core.internal.jobs.WorkerPool.startJob(WorkerPool.java:217)
at org.eclipse.core.internal.jobs.Worker.run(Worker.java:50)

Locked ownable synchronizers:
- None

"Thread-34" - Thread t@197
java.lang.Thread.State: WAITING
at java.lang.Object.wait(Native Method)
- waiting on <11a711a7> (a java.util.Timer$TimerImpl)
at java.lang.Object.wait(Object.java:167)
at java.util.Timer$TimerImpl.run(Timer.java:226)
- locked <11a711a7> (a java.util.Timer$TimerImpl)

Locked ownable synchronizers:
- None

"derby.rawStoreDaemon" - Thread t@198
java.lang.Thread.State: TIMED_WAITING
at java.lang.Object.wait(Native Method)
- waiting on <43594359> (a org.apache.derby.impl.services.daemon.BasicDaemon)
at java.lang.Object.wait(Object.java:196)
at org.apache.derby.impl.services.daemon.BasicDaemon.rest(Unknown Source)
- locked <43594359> (a org.apache.derby.impl.services.daemon.BasicDaemon)
at org.apache.derby.impl.services.daemon.BasicDaemon.run(Unknown Source)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"ccm: AsynchronousTaskRunner-0" - Thread t@200
java.lang.Thread.State: WAITING
at java.lang.Object.wait(Native Method)
- waiting on <16631663> (a java.util.LinkedList)
at java.lang.Object.wait(Object.java:167)
at com.ibm.team.repository.service.internal.scheduler.AsynchronousTaskManager.getNextTask(AsynchronousTaskManager.java:286)
- locked <16631663> (a java.util.LinkedList)
at com.ibm.team.repository.service.internal.scheduler.AsynchronousTaskRunner.run(AsynchronousTaskRunner.java:96)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"ccm: AsynchronousTaskRunner-1" - Thread t@201
java.lang.Thread.State: WAITING
at java.lang.Object.wait(Native Method)
- waiting on <16631663> (a java.util.LinkedList)
at java.lang.Object.wait(Object.java:167)
at com.ibm.team.repository.service.internal.scheduler.AsynchronousTaskManager.getNextTask(AsynchronousTaskManager.java:286)
- locked <16631663> (a java.util.LinkedList)
at com.ibm.team.repository.service.internal.scheduler.AsynchronousTaskRunner.run(AsynchronousTaskRunner.java:96)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"ccm: AsynchronousTaskRunner-2" - Thread t@202
java.lang.Thread.State: WAITING
at java.lang.Object.wait(Native Method)
- waiting on <16631663> (a java.util.LinkedList)
at java.lang.Object.wait(Object.java:167)
at com.ibm.team.repository.service.internal.scheduler.AsynchronousTaskManager.getNextTask(AsynchronousTaskManager.java:286)
- locked <16631663> (a java.util.LinkedList)
at com.ibm.team.repository.service.internal.scheduler.AsynchronousTaskRunner.run(AsynchronousTaskRunner.java:96)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"ccm: AsynchronousTaskRunner-3" - Thread t@203
java.lang.Thread.State: WAITING
at java.lang.Object.wait(Native Method)
- waiting on <16631663> (a java.util.LinkedList)
at java.lang.Object.wait(Object.java:167)
at com.ibm.team.repository.service.internal.scheduler.AsynchronousTaskManager.getNextTask(AsynchronousTaskManager.java:286)
- locked <16631663> (a java.util.LinkedList)
at com.ibm.team.repository.service.internal.scheduler.AsynchronousTaskRunner.run(AsynchronousTaskRunner.java:96)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"ccm: AsynchronousTaskRunner-4" - Thread t@204
java.lang.Thread.State: WAITING
at java.lang.Object.wait(Native Method)
- waiting on <16631663> (a java.util.LinkedList)
at java.lang.Object.wait(Object.java:167)
at com.ibm.team.repository.service.internal.scheduler.AsynchronousTaskManager.getNextTask(AsynchronousTaskManager.java:286)
- locked <16631663> (a java.util.LinkedList)
at com.ibm.team.repository.service.internal.scheduler.AsynchronousTaskRunner.run(AsynchronousTaskRunner.java:96)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"ccm: Asynchronous local task scheduler" - Thread t@205
java.lang.Thread.State: TIMED_WAITING
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <63a863a8> (a java.util.concurrent.CountDownLatch$Sync)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:211)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1011)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1303)
at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:253)
at com.ibm.team.repository.service.internal.AsynchronousTaskSchedulerService.runQueueingLoopOnce(AsynchronousTaskSchedulerService.java:457)
at com.ibm.team.repository.service.internal.AsynchronousTaskSchedulerService.runQueueingLoop(AsynchronousTaskSchedulerService.java:284)
at com.ibm.team.repository.service.internal.AsynchronousTaskSchedulerService.access$2(AsynchronousTaskSchedulerService.java:279)
at com.ibm.team.repository.service.internal.AsynchronousTaskSchedulerService$1.run(AsynchronousTaskSchedulerService.java:213)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"ccm: Asynchronous global task scheduler" - Thread t@206
java.lang.Thread.State: TIMED_WAITING
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <55c555c5> (a java.util.concurrent.CountDownLatch$Sync)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:211)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1011)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1303)
at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:253)
at com.ibm.team.repository.service.internal.AsynchronousTaskSchedulerService.runQueueingLoopOnce(AsynchronousTaskSchedulerService.java:457)
at com.ibm.team.repository.service.internal.AsynchronousTaskSchedulerService.runQueueingLoop(AsynchronousTaskSchedulerService.java:284)
at com.ibm.team.repository.service.internal.AsynchronousTaskSchedulerService.access$2(AsynchronousTaskSchedulerService.java:279)
at com.ibm.team.repository.service.internal.AsynchronousTaskSchedulerService$2.run(AsynchronousTaskSchedulerService.java:220)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"Java2D Disposer" - Thread t@207
java.lang.Thread.State: WAITING
at java.lang.Object.wait(Native Method)
- waiting on <18f218f2> (a java.lang.ref.ReferenceQueue)
at java.lang.Object.wait(Object.java:196)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:107)
- locked <18f218f2> (a java.lang.ref.ReferenceQueue)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:79)
at sun.java2d.Disposer.run(Disposer.java:131)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"AD Thread Pool-CSS0" - Thread t@208
java.lang.Thread.State: WAITING
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <79817981> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:171)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
at java.util.concurrent.DelayQueue.take(DelayQueue.java:160)
at com.singularity.ee.util.pd.c(pd.java:523)
at com.singularity.ee.util.pd.take(pd.java:515)
at com.singularity.ee.util.rd.a(rd.java:487)
at com.singularity.ee.util.pb.run(pb.java:691)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"AD Thread Pool-CGG0" - Thread t@209
java.lang.Thread.State: WAITING
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <79c579c5> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:171)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
at java.util.concurrent.DelayQueue.take(DelayQueue.java:160)
at com.singularity.ee.util.pd.c(pd.java:523)
at com.singularity.ee.util.pd.take(pd.java:515)
at com.singularity.ee.util.rd.a(rd.java:487)
at com.singularity.ee.util.pb.run(pb.java:691)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"jena.query.monitor" - Thread t@211
java.lang.Thread.State: TIMED_WAITING
at java.lang.Thread.sleep(Native Method)
at java.lang.Thread.sleep(Thread.java:851)
at com.ibm.team.jfs.rdf.internal.jena.provider.JenaQueryMonitor.run(JenaQueryMonitor.java:279)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"AD Thread Pool-CSS1" - Thread t@212
java.lang.Thread.State: WAITING
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <79817981> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:171)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
at java.util.concurrent.DelayQueue.take(DelayQueue.java:160)
at com.singularity.ee.util.pd.c(pd.java:523)
at com.singularity.ee.util.pd.take(pd.java:515)
at com.singularity.ee.util.rd.a(rd.java:487)
at com.singularity.ee.util.pb.run(pb.java:691)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"RMI TCP Connection(1)-127.0.0.1" - Thread t@213
java.lang.Thread.State: RUNNABLE
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:129)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:218)
at java.io.BufferedInputStream.read(BufferedInputStream.java:237)
- locked <9930993> (a java.io.BufferedInputStream)
at java.io.FilterInputStream.read(FilterInputStream.java:66)
at sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:517)
at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:790)
at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:649)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- locked <39873987> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

"RMI TCP Connection(2)-127.0.0.1" - Thread t@214
java.lang.Thread.State: RUNNABLE
at com.ibm.lang.management.ThreadMXBeanImpl.dumpAllThreadsImpl(Native Method)
at com.ibm.lang.management.ThreadMXBeanImpl.dumpAllThreads(ThreadMXBeanImpl.java:680)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:48)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:600)
at com.ibm.lang.management.DynamicMXBeanImpl.invokeMethod(DynamicMXBeanImpl.java:421)
at com.ibm.lang.management.DynamicMXBeanImpl.invoke(DynamicMXBeanImpl.java:345)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.invoke(DefaultMBeanServerInterceptor.java:836)
at com.sun.jmx.mbeanserver.JmxMBeanServer.invoke(JmxMBeanServer.java:761)
at javax.management.remote.rmi.RMIConnectionImpl.doOperation(RMIConnectionImpl.java:1427)
at javax.management.remote.rmi.RMIConnectionImpl.access$200(RMIConnectionImpl.java:72)
at javax.management.remote.rmi.RMIConnectionImpl$PrivilegedOperation.run(RMIConnectionImpl.java:1265)
at javax.management.remote.rmi.RMIConnectionImpl.doPrivilegedOperation(RMIConnectionImpl.java:1360)
at javax.management.remote.rmi.RMIConnectionImpl.invoke(RMIConnectionImpl.java:788)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:48)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:600)
at sun.rmi.server.UnicastServerRef.dispatch(UnicastServerRef.java:310)
at sun.rmi.transport.Transport$1.run(Transport.java:159)
at java.security.AccessController.doPrivileged(AccessController.java:284)
at sun.rmi.transport.Transport.serviceCall(Transport.java:155)
at sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:535)
at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:790)
at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:649)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- locked <58105810> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

"JMX server connection timeout 215" - Thread t@215
java.lang.Thread.State: TIMED_WAITING
at java.lang.Object.wait(Native Method)
- waiting on <5d1a5d1a> (a [I)
at java.lang.Object.wait(Object.java:196)
at com.sun.jmx.remote.internal.ServerCommunicatorAdmin$Timeout.run(ServerCommunicatorAdmin.java:150)
- locked <5d1a5d1a> (a [I)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"HTTP Cache Scrubber" - Thread t@218
java.lang.Thread.State: TIMED_WAITING
at java.lang.Object.wait(Native Method)
- waiting on <76b876b8> (a java.util.Timer$TimerImpl)
at java.lang.Object.wait(Object.java:196)
at java.util.Timer$TimerImpl.run(Timer.java:246)
- locked <76b876b8> (a java.util.Timer$TimerImpl)

Locked ownable synchronizers:
- None

"Worker-0" - Thread t@219
java.lang.Thread.State: TIMED_WAITING
at java.lang.Object.wait(Native Method)
- waiting on <2c872c87> (a org.eclipse.core.internal.jobs.WorkerPool)
at java.lang.Object.wait(Object.java:196)
at org.eclipse.core.internal.jobs.WorkerPool.sleep(WorkerPool.java:185)
- locked <2c872c87> (a org.eclipse.core.internal.jobs.WorkerPool)
at org.eclipse.core.internal.jobs.WorkerPool.startJob(WorkerPool.java:217)
at org.eclipse.core.internal.jobs.Worker.run(Worker.java:50)

Locked ownable synchronizers:
- None

"Shared FriendsConfig Update Listener" - Thread t@220
java.lang.Thread.State: WAITING
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <fa30fa3> (a java.util.concurrent.CountDownLatch$Sync)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:171)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:811)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:969)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1281)
at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:207)
at com.ibm.team.jfs.app.distributed.InMemorySignal.waitFor(InMemorySignal.java:41)
at com.ibm.team.jfs.app.friendsconfig.internal.InMemoryFriendsConfigStorage$1.run(InMemoryFriendsConfigStorage.java:247)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"jts.jfs.indexer.internal.triple.history" - Thread t@221
java.lang.Thread.State: TIMED_WAITING
at java.lang.Thread.sleep(Native Method)
at java.lang.Thread.sleep(Thread.java:851)
at com.ibm.team.jfs.indexing.service.internal.task.AbstractIndexAgent.sleep(AbstractIndexAgent.java:258)
at com.ibm.team.jfs.indexing.service.internal.task.AbstractIndexAgent.run(AbstractIndexAgent.java:1177)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"jts.jfs.indexer.internal.triple" - Thread t@222
java.lang.Thread.State: TIMED_WAITING
at java.lang.Thread.sleep(Native Method)
at java.lang.Thread.sleep(Thread.java:851)
at com.ibm.team.jfs.indexing.service.internal.task.AbstractIndexAgent.sleep(AbstractIndexAgent.java:258)
at com.ibm.team.jfs.indexing.service.internal.task.AbstractIndexAgent.run(AbstractIndexAgent.java:1177)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"jts.jfs.indexer.internal.text.history" - Thread t@223
java.lang.Thread.State: TIMED_WAITING
at java.lang.Thread.sleep(Native Method)
at java.lang.Thread.sleep(Thread.java:851)
at com.ibm.team.jfs.indexing.service.internal.task.AbstractIndexAgent.sleep(AbstractIndexAgent.java:258)
at com.ibm.team.jfs.indexing.service.internal.task.AbstractIndexAgent.run(AbstractIndexAgent.java:1177)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"jts.jfs.indexer.internal.text" - Thread t@224
java.lang.Thread.State: TIMED_WAITING
at java.lang.Thread.sleep(Native Method)
at java.lang.Thread.sleep(Thread.java:851)
at com.ibm.team.jfs.indexing.service.internal.task.AbstractIndexAgent.sleep(AbstractIndexAgent.java:258)
at com.ibm.team.jfs.indexing.service.internal.task.AbstractIndexAgent.run(AbstractIndexAgent.java:1177)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"LPA Change Event Monitor" - Thread t@225
java.lang.Thread.State: TIMED_WAITING
at java.lang.Object.wait(Native Method)
- waiting on <5a335a33> (a java.util.Timer$TimerImpl)
at java.lang.Object.wait(Object.java:196)
at java.util.Timer$TimerImpl.run(Timer.java:246)
- locked <5a335a33> (a java.util.Timer$TimerImpl)

Locked ownable synchronizers:
- None

"ccm: OAuth nonce cleanup timer" - Thread t@226
java.lang.Thread.State: TIMED_WAITING
at java.lang.Object.wait(Native Method)
- waiting on <3270327> (a java.util.Timer$TimerImpl)
at java.lang.Object.wait(Object.java:196)
at java.util.Timer$TimerImpl.run(Timer.java:246)
- locked <3270327> (a java.util.Timer$TimerImpl)

Locked ownable synchronizers:
- None

"pool-53-thread-2" - Thread t@228
java.lang.Thread.State: TIMED_WAITING
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <5dca5dca> (a java.util.concurrent.SynchronousQueue$TransferStack)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:211)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:424)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:323)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:874)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:945)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"pool-53-thread-1" - Thread t@227
java.lang.Thread.State: TIMED_WAITING
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <5dca5dca> (a java.util.concurrent.SynchronousQueue$TransferStack)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:211)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:424)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:323)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:874)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:945)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"ccm.jfs.indexer.internal.triple.history" - Thread t@229
java.lang.Thread.State: TIMED_WAITING
at java.lang.Thread.sleep(Native Method)
at java.lang.Thread.sleep(Thread.java:851)
at com.ibm.team.jfs.indexing.service.internal.task.AbstractIndexAgent.sleep(AbstractIndexAgent.java:258)
at com.ibm.team.jfs.indexing.service.internal.task.AbstractIndexAgent.run(AbstractIndexAgent.java:1177)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"ccm.jfs.indexer.internal.triple" - Thread t@230
java.lang.Thread.State: TIMED_WAITING
at java.lang.Thread.sleep(Native Method)
at java.lang.Thread.sleep(Thread.java:851)
at com.ibm.team.jfs.indexing.service.internal.task.AbstractIndexAgent.sleep(AbstractIndexAgent.java:258)
at com.ibm.team.jfs.indexing.service.internal.task.AbstractIndexAgent.run(AbstractIndexAgent.java:1177)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"ccm.jfs.indexer.internal.text.history" - Thread t@231
java.lang.Thread.State: TIMED_WAITING
at java.lang.Thread.sleep(Native Method)
at java.lang.Thread.sleep(Thread.java:851)
at com.ibm.team.jfs.indexing.service.internal.task.AbstractIndexAgent.sleep(AbstractIndexAgent.java:258)
at com.ibm.team.jfs.indexing.service.internal.task.AbstractIndexAgent.run(AbstractIndexAgent.java:1177)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"ccm.jfs.indexer.internal.text" - Thread t@232
java.lang.Thread.State: TIMED_WAITING
at java.lang.Thread.sleep(Native Method)
at java.lang.Thread.sleep(Thread.java:851)
at com.ibm.team.jfs.indexing.service.internal.task.AbstractIndexAgent.sleep(AbstractIndexAgent.java:258)
at com.ibm.team.jfs.indexing.service.internal.task.AbstractIndexAgent.run(AbstractIndexAgent.java:1177)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"http-bio-9443-exec-27" - Thread t@234
java.lang.Thread.State: TIMED_WAITING
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <70117011> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:211)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:424)
at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:86)
at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:32)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:945)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- None

"http-bio-9443-exec-26" - Thread t@233
java.lang.Thread.State: RUNNABLE
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:129)
at com.ibm.jsse2.b.a(b.java:95)
at com.ibm.jsse2.b.a(b.java:65)
at com.ibm.jsse2.SSLSocketImpl.a(SSLSocketImpl.java:242)
- locked <a9b0a9b> (a java.lang.Object)
at com.ibm.jsse2.SSLSocketImpl.a(SSLSocketImpl.java:773)
at com.ibm.jsse2.f.read(f.java:26)
- locked <26b026b> (a com.ibm.jsse2.f)
at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:516)
at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:501)
at org.apache.coyote.http11.Http11Processor.setRequestLineReadTimeout(Http11Processor.java:172)
at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:912)
at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:579)
at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:309)
- locked <14fc14fc> (a org.apache.tomcat.util.net.SocketWrapper)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:736)

Locked ownable synchronizers:
- locked <54d154d1> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

- locked <150a150a> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

- locked <297c297c> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

"HTTP Cache Scrubber" - Thread t@235
java.lang.Thread.State: TIMED_WAITING
at java.lang.Object.wait(Native Method)
- waiting on <3f1b3f1b> (a java.util.Timer$TimerImpl)
at java.lang.Object.wait(Object.java:196)
at java.util.Timer$TimerImpl.run(Timer.java:246)
- locked <3f1b3f1b> (a java.util.Timer$TimerImpl)

Locked ownable synchronizers:
- None

0 votes

Permanent link

Davyd Norris

(202●2●10●14) Sep 14 '12, 11:44 p.m.

I am having exactly the same problem with similar set up, but for me it's intermittent - sometimes it seems to run quite quickly and sometimes it's a total slug.

Couple of things:
- make sure you are starting the CLM server as Administrator. Win 2008 and Win7 both use virtual directories for Program Files and so you MUST be an Administrator, otherwise they aren't writable. I initially forgot to run as Admin and it always runs terribly because the caches are not writable and they time out.

- the only thing in my case that seems to be a trend is that the times CLM runs alright I am connected to an actual network (wired or wireless) on my real machine. It seems that when my real network is disconnected it's more likely to run terribly with EXACTLY the same symptoms as you. My VM is using NAT, I have hard coded entries for the server in my hosts file, both in and out of the VM, and it doesn't matter whether I use a browser in or out of the VM it's still slow.

0 votes

Comments

Christopher L

Sep 17 '12, 7:48 p.m.

The issue seems to be approaching this general area. If I -disconnect- the network adapter and rely solely on the hosts file, the speed improves to what I imagine is normal. I tried reverting to release 4.01 (not M2) and it exhibits the same problem. For me, ANY network adapter connection causes the speed problem. Static, DHCP, NAT, Bridged, Private...the network and adapter state don't seem to matter. So far it seems that there mere presence of a network adapter, in any state, causes the speed problem. It will be a few weeks before I get back to working on this one.

sam detweiler

Sep 17 '12, 8:31 p.m.

check your dns server (nslookup...)

Davyd Norris

Sep 17 '12, 8:45 p.m.

I think this is an important point in diagnosing what's going on. To recount my situation:

I have installed CLM 4.0 in a VMware image, which I use for product demos. It seems that when my laptop is connected to my home wireless network, or when I am in the office and again connected to an actual network, my CLM server usually runs well. Set up works fine and I can start and restart the server, set up my demo data, run it from browsers or clients both in and out of the VM image etc.

But at two clients now, it very embarrassingly refuses to cooperate and runs like an absolute slug. The initial login page seems to come up at the same speed, but even trying to bring up the default dashboard page for any of the applications, or even the JTS admin page just seems to hang. The only thing I can see that is different is that my real network is not connected to anything at the client's site.

I have entries for the CLM server in my hosts file on both my real machine and in my VM image, and have NAT set up on the image - this means that the CLM server knows about itself explicitly, and thinks it has a network but the VM's DNS will fail any lookup expect for what's in the hosts file.

Permanent link

sam detweiler

(12.5k●6●195●201) Sep 15 '12, 7:14 a.m.

it seems there is a lot of off local network contacts, the server rename function forces some constant checking, but hosts file isn't enough

0 votes

Your answer

Dashboards and work items are no longer publicly available, so some links may be invalid. We now provide similar information through other means. Learn more here.

Follow this question

By Email:

Once you sign in you will be able to subscribe for any updates here.

By RSS:

Answers

Answers and Comments

Question details

rational-team-concert

× 42,898

installation

× 2,357

windows

× 10

vmware

× 2

slow

× 1

Question asked: Sep 03 '12, 5:29 p.m.

Question was seen: 10,154 times

Last updated: Sep 17 '12, 8:45 p.m.

How (else) to troubleshoot "My RTC server is really really slow"?

Comments

7 answers

10,154 views

0 votes

7 answers

Comments

Comments

Comments

Your answer

Follow this question

Question details

Related questions