It's all about the answers!

Ask a question

How (else) to troubleshoot "My RTC server is really really slow"?


Christopher L (1112) | asked Sep 03 '12, 5:29 p.m.
edited Sep 03 '12, 5:39 p.m.

4.0.1 M2, a brand new install, is insanely slow.  It takes minutes for the web pages to load.

I found the forum posts about it needing 2/2 procs.  That didn't help.

How else can I troubleshoot this?

  • It's running within Windows 2008 R2, on VMWare Workstation 8.
  • Hosted by the Tomcat that was built in to the installer.  Not WAS.
  • The VMWare guest has 6 gigs of ram and 2/2 processors.
  • The VMWare host (my workstation) has 6-dual core @3.47ghz (12 procs), and 12 gigs of ram.  It is running only this one guest.  This isn't a resource availability or scheduling problem.  java.exe only uses 1 gig of ram.
  • I initially installed everything locally using the express method.  With the least possible configuration, it was very slow right out of the box.  I thought perhaps Derby was the culprit.
  • I re-ran the setup using Custom, and pointed it at a SQL server.  This produced no change in the very slow page access times:  Still slow.  (JDBC)
  • I eliminated all possible network interference.  There's no firewall running on the server.  It's slow if I access it over https://localhost:9443/jts or https://fqdn:9443/jts from the local console.
  • Even http://localhost:9443/jts/customSetup takes 60 seconds to load.
  • I have found only one potential clue in the form of an error.  The server page shows no errors.  The diagnostics show all good.  But the page titled "Active Services" shows "Item Handle must not be null" with this in the details:  "$Proxy145.getActiveServiceInfo(Unknown Source)"
  • /admin, /ccm, /qm, and /rm are all installed.  I just took the easiest possible defaults during the installer.
  • Upon addressing the url, the server responds immediately with the SSL Certificate.  I haven't trusted the cert yet so the browser throws a warning and prompts me to press continue.  It's only after pressing continue, where the pages actually render, that the slow speed occurs.
  • I have run other guest operating systems on this VM, hosting similar tomcat servers with applications that use database backends, and haven't seen this before. It "seems" to be specific to TeamConcert. 

Can anyone offer an idea on what else I should look at?  From the operating system side, everything looks great.  CPU/Mem/Disk/Net all look good from within the guest, as well as at the host layer.  Something with TeamConcert is very slow and I don't know how else to go about discovering the issue.

Any ideas?


Comments
Dong Young Kim commented Sep 15 '12, 11:51 a.m.
JAZZ DEVELOPER

How about turning off firewall just for test?

7 answers



permanent link
sam detweiler (12.5k6184201) | answered Sep 03 '12, 8:42 p.m.
Mine turned out to be a bad name server config.  V4 does a LOT more connections via name than before.

fixing my name server config resolved all the problems



Comments
Christopher L commented Sep 04 '12, 10:21 a.m.

Thanks for the response. Name resolution seems to be working fine in this instance. Hard coding things in the hosts file even, shows no improvement.


permanent link
Rajat Singh (59833443) | answered Sep 04 '12, 12:45 a.m.
Are you on the supported browsers?
The list of supported browsers for v4.0:
Firefox 10 ESR
Firefox 3.6
Internet Explorer 9
Internet Explorer 8
Macromedia Flash Player 8
Safari 5

Comments
Christopher L commented Sep 04 '12, 10:22 a.m.

Thanks for the response. I'm using IE9 both from a Windows 7 client, and on the server. It's the same slow page loads from either system. I just tried Chrome and found that it also experiences the exact same speed delay.


permanent link
Christopher L (1112) | answered Sep 04 '12, 3:36 p.m.
Using Fiddler, the hangs are obvious.  The client waits on a get for the login screen.  Once through that, there's a redirect that sends a get for the /jts/admin page.  The client just sits there waiting.  No retries, no errors.  Just a get, and a wait.

Using Wireshark, when the tomcat server starts I see no traffic from the server, out to the network.  (aside from the usual domain stuff).  As soon as my web client hits the login page, however, the RTC starts talking to the SQL server.  What seems odd is that if I just let it sit at the login page, the sql communication runs back and forth for quite a while.  With the client doing nothing, the RTC is quite busy.

And then something unexpected.  After I wait for the SQL traffic to stop, I login, and no additional sql traffic occurs.  I expected to see that after the login page the RTC would be rendering the web page, relying heavily on the SQL DB. Non of that occurred; not even one packet.

So after all SQL traffic dies down, when I login and experience a long delay in the page render, no db queries are occurring.  I am assuming at this point that the RTC already has all of the data that it needs to render the page, and that the delay is entirely within tomcat, taking forever to render the page.

The question, therefore, is how do I see what is occurring within Tomcat?

permanent link
Christopher L (1112) | answered Sep 04 '12, 5:51 p.m.
For posterity...

The way to see what is occurring within Tomcat is to use jconsole, or visualvm, or AppDynamics Lite.

To connect with VisualVM:
  • Create a JMX monitor port by modifying the server.startup.bat to add the following java opts to the end:

    set JAVA_OPTS=%JAVA_OPTS% -Dcom.sun.management.jmxremote.port=8086
    set JAVA_OPTS=%JAVA_OPTS% -Dcom.sun.management.jmxremote.ssl=false
    set JAVA_OPTS=%JAVA_OPTS% -Dcom.sun.management.jmxremote.authenticate=false

  • Start the server
  • Launch visualvm, right click on "Local", add JMX Connection, localhost:8086
  • Then look at the threads.
To connect with AppDynamics Lite:
  • Copy the agent over to the server
  • Modify the startup.bat and add this to the very beginning of the java_opts
    set JAVA_OPTS=%JAVA_OPTS% -javaagent:"C:\AppServerAgentLite-3.3.3.2GA\javaagent.jar"
    set JAVA_OPTS=%JAVA_OPTS% -Dappdynamics.viewer.host=192.168.x.x (ip address of your "viewer")
    set JAVA_OPTS=%JAVA_OPTS% -Dappdynamics.viewer.port=8990
  • Launch the viewer on a client system (or localhost if you want).
  • Then launch the tomcat server using the modified server.bat
  • Initially AppsDynamics will be empty.  Do stuff in RTC and you will being to see the viewer populate.

AppsDynamics Lite has been very helpful in diagnosing the speed problem within Tomcat.  (within the JVM)  It is showing me that .net.jazz.ajax.model.OSGiWebBundle:bundleResource is eventually timing out.  Here is the point of failure:

Name: net.jazz.ajax.model.OSGiWebBundle:bundleResource
Type: POJO
Class: net.jazz.ajax.model.OSGiWebBundle
Method: bundleResource
Line Number: 76

Now I have to figure out what THAT means.


permanent link
Christopher L (1112) | answered Sep 06 '12, 1:11 p.m.

Below is a thread dump.  There are several "locked" things? If anyone has any thoughts... This is over my head.

Also,one part of the dump in particular might be interesting.  It "seems" to say that it's using IPv6?  "at java.net.Inet6AddressImpl.lookupAllHostAddr(Native Method)".  And bundleResource hangs right after URLStreamHandler.getHostAddress.  If it's trying to getHostAddress over ipv6; that would be a problem.

Here's the thread dump:

"http-bio-9443-exec-7" - Thread t@147
java.lang.Thread.State: RUNNABLE
at java.net.Inet6AddressImpl.lookupAllHostAddr(Native Method)
at java.net.InetAddress$2.lookupAllHostAddr(InetAddress.java:937)
at java.net.InetAddress.getAddressFromNameService(InetAddress.java:1308)
at java.net.InetAddress.getAllByName0(InetAddress.java:1256)
at java.net.InetAddress.getAllByName(InetAddress.java:1185)
at java.net.InetAddress.getAllByName(InetAddress.java:1107)
at java.net.InetAddress.getByName(InetAddress.java:1057)
at java.net.URLStreamHandler.getHostAddress(URLStreamHandler.java:426)
- locked <64ee64ee> (a net.jazz.ajax.model.BundleResourceStreamHandler)


2012-09-06 08:38:06
Full thread dump IBM J9 VM (2.4 JRE 1.6.0 IBM J9 2.4 Windows Server 2008 R2 amd64-64 jvmwa6460sr10fp1-20120202_101568 (JIT enabled, AOT enabled)
J9VM - 20120202_101568
JIT  - r9_20111107_21307ifx1
GC   - 20120202_AA_CMPRSS):

"main" - Thread t@1
   java.lang.Thread.State: RUNNABLE
 at java.net.PlainSocketImpl.socketAccept(Native Method)
 at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:438)
 - locked <23aa23aa> (a java.net.SocksSocketImpl)
 at java.net.ServerSocket.implAccept(ServerSocket.java:462)
 at java.net.ServerSocket.accept(ServerSocket.java:430)
 at org.apache.catalina.core.StandardServer.await(StandardServer.java:447)
 at org.apache.catalina.startup.Catalina.await(Catalina.java:728)
 at org.apache.catalina.startup.Catalina.start(Catalina.java:674)
 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:48)
 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
 at java.lang.reflect.Method.invoke(Method.java:600)
 at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:322)
 at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:450)

   Locked ownable synchronizers:
 - None

"JIT Compilation Thread" - Thread t@13
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
 - None

"Signal Dispatcher" - Thread t@2
   java.lang.Thread.State: RUNNABLE
 at com.ibm.misc.SignalDispatcher.waitForSignal(Native Method)
 at com.ibm.misc.SignalDispatcher.run(SignalDispatcher.java:54)

   Locked ownable synchronizers:
 - None

"MemoryPoolMXBean notification dispatcher" - Thread t@7
   java.lang.Thread.State: RUNNABLE
 at com.ibm.lang.management.MemoryNotificationThread.processNotificationLoop(Native Method)
 at com.ibm.lang.management.MemoryNotificationThread.run(MemoryNotificationThread.java:56)

   Locked ownable synchronizers:
 - None

"RMI Scheduler(0)" - Thread t@9
   java.lang.Thread.State: TIMED_WAITING
 at sun.misc.Unsafe.park(Native Method)
 - parking to wait for <65b465b4> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
 at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:211)
 at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
 at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
 at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
 at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
 at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"RMI TCP Accept-0" - Thread t@10
   java.lang.Thread.State: RUNNABLE
 at java.net.PlainSocketImpl.socketAccept(Native Method)
 at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:438)
 - locked <6a666a66> (a java.net.SocksSocketImpl)
 at java.net.ServerSocket.implAccept(ServerSocket.java:462)
 at java.net.ServerSocket.accept(ServerSocket.java:430)
 at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:369)
 at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:341)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"RMI TCP Accept-8086" - Thread t@11
   java.lang.Thread.State: RUNNABLE
 at java.net.PlainSocketImpl.socketAccept(Native Method)
 at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:438)
 - locked <39a039a0> (a java.net.SocksSocketImpl)
 at java.net.ServerSocket.implAccept(ServerSocket.java:462)
 at java.net.ServerSocket.accept(ServerSocket.java:430)
 at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:369)
 at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:341)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"RMI TCP Accept-0" - Thread t@12
   java.lang.Thread.State: RUNNABLE
 at java.net.PlainSocketImpl.socketAccept(Native Method)
 at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:438)
 - locked <4b764b76> (a java.net.SocksSocketImpl)
 at java.net.ServerSocket.implAccept(ServerSocket.java:462)
 at java.net.ServerSocket.accept(ServerSocket.java:430)
 at sun.management.jmxremote.LocalRMIServerSocketFactory$1.accept(LocalRMIServerSocketFactory.java:34)
 at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:369)
 at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:341)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"Concurrent Mark Helper" - Thread t@14
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
 - None

"Gc Slave Thread" - Thread t@15
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
 - None

"Gc Slave Thread" - Thread t@16
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
 - None

"Gc Slave Thread" - Thread t@17
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
 - None

"Thread-6" - Thread t@18
   java.lang.Thread.State: TIMED_WAITING
 at java.lang.Thread.sleep(Native Method)
 at java.lang.Thread.sleep(Thread.java:851)
 at com.singularity.util.org.apache.log4j.helpers.FileWatchdog.run(FileWatchdog.java:104)

   Locked ownable synchronizers:
 - None

"AD Thread-Config Poller" - Thread t@23
   java.lang.Thread.State: TIMED_WAITING
 at java.lang.Thread.sleep(Native Method)
 at java.lang.Thread.sleep(Thread.java:851)
 at com.singularity.util.org.apache.log4j.helpers.FileWatchdog.run(FileWatchdog.java:104)

   Locked ownable synchronizers:
 - None

"AD Thread-Metric Reporter0" - Thread t@24
   java.lang.Thread.State: TIMED_WAITING
 at sun.misc.Unsafe.park(Native Method)
 - parking to wait for <55225522> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
 at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:211)
 at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
 at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
 at com.singularity.ee.util.pd.c(pd.java:523)
 at com.singularity.ee.util.pd.take(pd.java:515)
 at com.singularity.ee.util.rd.a(rd.java:487)
 at com.singularity.ee.util.pb.run(pb.java:691)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"AD Thread Pool-Global0" - Thread t@25
   java.lang.Thread.State: TIMED_WAITING
 at sun.misc.Unsafe.park(Native Method)
 - parking to wait for <461f461f> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
 at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:211)
 at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
 at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
 at com.singularity.ee.util.pd.c(pd.java:523)
 at com.singularity.ee.util.pd.take(pd.java:515)
 at com.singularity.ee.util.rd.a(rd.java:487)
 at com.singularity.ee.util.pb.run(pb.java:691)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"AD Thread Pool-Global1" - Thread t@26
   java.lang.Thread.State: TIMED_WAITING
 at sun.misc.Unsafe.park(Native Method)
 - parking to wait for <461f461f> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
 at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:211)
 at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
 at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
 at com.singularity.ee.util.pd.c(pd.java:523)
 at com.singularity.ee.util.pd.take(pd.java:515)
 at com.singularity.ee.util.rd.a(rd.java:487)
 at com.singularity.ee.util.pb.run(pb.java:691)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"MultiThreadedHttpConnectionManager cleanup" - Thread t@27
   java.lang.Thread.State: WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <385b385b> (a java.lang.ref.ReferenceQueue)
 at java.lang.Object.wait(Object.java:196)
 at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:107)
 - locked <385b385b> (a java.lang.ref.ReferenceQueue)
 at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:79)
 at org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$ReferenceQueueThread.run(MultiThreadedHttpConnectionManager.java:1122)

   Locked ownable synchronizers:
 - None

"Attach API wait loop" - Thread t@30
   java.lang.Thread.State: RUNNABLE
 at com.ibm.tools.attach.javaSE.IPC.waitSemaphore(Native Method)
 at com.ibm.tools.attach.javaSE.CommonDirectory.waitSemaphore(CommonDirectory.java:193)
 at com.ibm.tools.attach.javaSE.AttachHandler$WaitLoop.waitForNotification(AttachHandler.java:331)
 at com.ibm.tools.attach.javaSE.AttachHandler$WaitLoop.run(AttachHandler.java:409)

   Locked ownable synchronizers:
 - None

"GC Daemon" - Thread t@31
   java.lang.Thread.State: TIMED_WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <1e451e45> (a sun.misc.GC$LatencyLock)
 at java.lang.Object.wait(Object.java:196)
 at sun.misc.GC$Daemon.run(GC.java:100)
 - locked <1e451e45> (a sun.misc.GC$LatencyLock)

   Locked ownable synchronizers:
 - None

"Finalizer thread" - Thread t@32
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
 - None

"State Data Manager" - Thread t@35
   java.lang.Thread.State: TIMED_WAITING
 at java.lang.Thread.sleep(Native Method)
 at java.lang.Thread.sleep(Thread.java:851)
 at org.eclipse.osgi.internal.baseadaptor.StateManager.run(StateManager.java:319)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"Start Level Event Dispatcher" - Thread t@36
   java.lang.Thread.State: WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <1330133> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
 at java.lang.Object.wait(Object.java:167)
 at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.getNextEvent(EventManager.java:397)
 - locked <1330133> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
 at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.run(EventManager.java:333)

   Locked ownable synchronizers:
 - None

"Framework Event Dispatcher" - Thread t@37
   java.lang.Thread.State: WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <3a703a70> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
 at java.lang.Object.wait(Object.java:167)
 at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.getNextEvent(EventManager.java:397)
 - locked <3a703a70> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
 at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.run(EventManager.java:333)

   Locked ownable synchronizers:
 - None

"[Timer] - Main Queue Handler" - Thread t@38
   java.lang.Thread.State: TIMED_WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <34dc34dc> (a java.lang.Object)
 at java.lang.Object.wait(Object.java:196)
 at org.eclipse.equinox.internal.util.impl.tpt.timer.TimerImpl.run(TimerImpl.java:141)
 - locked <34dc34dc> (a java.lang.Object)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"Worker-JM" - Thread t@39
   java.lang.Thread.State: WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <56535653> (a java.util.ArrayList)
 at java.lang.Object.wait(Object.java:196)
 at org.eclipse.core.internal.jobs.InternalWorker.run(InternalWorker.java:58)
 - locked <56535653> (a java.util.ArrayList)

   Locked ownable synchronizers:
 - None

"CommonCache Scrubber" - Thread t@40
   java.lang.Thread.State: TIMED_WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <5640564> (a java.util.Timer$TimerImpl)
 at java.lang.Object.wait(Object.java:196)
 at java.util.Timer$TimerImpl.run(Timer.java:246)
 - locked <5640564> (a java.util.Timer$TimerImpl)

   Locked ownable synchronizers:
 - None

"[ThreadPool Manager] - Idle Thread" - Thread t@41
   java.lang.Thread.State: WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <140d140d> (a org.eclipse.equinox.internal.util.impl.tpt.threadpool.Executor)
 at java.lang.Object.wait(Object.java:167)
 at org.eclipse.equinox.internal.util.impl.tpt.threadpool.Executor.run(Executor.java:106)
 - locked <140d140d> (a org.eclipse.equinox.internal.util.impl.tpt.threadpool.Executor)

   Locked ownable synchronizers:
 - None

"pool-8-thread-1" - Thread t@45
   java.lang.Thread.State: TIMED_WAITING
 at sun.misc.Unsafe.park(Native Method)
 - parking to wait for <2a402a40> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
 at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:211)
 at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
 at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
 at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
 at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
 at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"Start Level Event Dispatcher" - Thread t@46
   java.lang.Thread.State: WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <51a651a6> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
 at java.lang.Object.wait(Object.java:167)
 at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.getNextEvent(EventManager.java:397)
 - locked <51a651a6> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
 at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.run(EventManager.java:333)

   Locked ownable synchronizers:
 - None

"Framework Event Dispatcher" - Thread t@47
   java.lang.Thread.State: WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <28182818> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
 at java.lang.Object.wait(Object.java:167)
 at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.getNextEvent(EventManager.java:397)
 - locked <28182818> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
 at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.run(EventManager.java:333)

   Locked ownable synchronizers:
 - None

"Worker-JM" - Thread t@48
   java.lang.Thread.State: WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <5d395d39> (a java.util.ArrayList)
 at java.lang.Object.wait(Object.java:196)
 at org.eclipse.core.internal.jobs.InternalWorker.run(InternalWorker.java:58)
 - locked <5d395d39> (a java.util.ArrayList)

   Locked ownable synchronizers:
 - None

"CommonCache Scrubber" - Thread t@52
   java.lang.Thread.State: TIMED_WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <6eae6eae> (a java.util.Timer$TimerImpl)
 at java.lang.Object.wait(Object.java:196)
 at java.util.Timer$TimerImpl.run(Timer.java:246)
 - locked <6eae6eae> (a java.util.Timer$TimerImpl)

   Locked ownable synchronizers:
 - None

"[Timer] - Main Queue Handler" - Thread t@53
   java.lang.Thread.State: TIMED_WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <3ca33ca3> (a java.lang.Object)
 at java.lang.Object.wait(Object.java:196)
 at org.eclipse.equinox.internal.util.impl.tpt.timer.TimerImpl.run(TimerImpl.java:141)
 - locked <3ca33ca3> (a java.lang.Object)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"[ThreadPool Manager] - Idle Thread" - Thread t@54
   java.lang.Thread.State: WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <5fba5fba> (a org.eclipse.equinox.internal.util.impl.tpt.threadpool.Executor)
 at java.lang.Object.wait(Object.java:167)
 at org.eclipse.equinox.internal.util.impl.tpt.threadpool.Executor.run(Executor.java:106)
 - locked <5fba5fba> (a org.eclipse.equinox.internal.util.impl.tpt.threadpool.Executor)

   Locked ownable synchronizers:
 - None

"Bundle File Closer" - Thread t@55
   java.lang.Thread.State: WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <5b205b2> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
 at java.lang.Object.wait(Object.java:167)
 at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.getNextEvent(EventManager.java:397)
 - locked <5b205b2> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
 at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.run(EventManager.java:333)

   Locked ownable synchronizers:
 - None

"pool-14-thread-1" - Thread t@56
   java.lang.Thread.State: TIMED_WAITING
 at sun.misc.Unsafe.park(Native Method)
 - parking to wait for <574b574b> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
 at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:211)
 at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
 at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
 at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
 at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
 at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"Worker-0" - Thread t@57
   java.lang.Thread.State: TIMED_WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <336d336d> (a org.eclipse.core.internal.jobs.WorkerPool)
 at java.lang.Object.wait(Object.java:196)
 at org.eclipse.core.internal.jobs.WorkerPool.sleep(WorkerPool.java:185)
 - locked <336d336d> (a org.eclipse.core.internal.jobs.WorkerPool)
 at org.eclipse.core.internal.jobs.WorkerPool.startJob(WorkerPool.java:217)
 at org.eclipse.core.internal.jobs.Worker.run(Worker.java:50)

   Locked ownable synchronizers:
 - None

"Framework Active Thread" - Thread t@58
   java.lang.Thread.State: TIMED_WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <da20da2> (a org.eclipse.osgi.framework.internal.core.Framework)
 at java.lang.Object.wait(Object.java:196)
 at org.eclipse.osgi.framework.internal.core.Framework.run(Framework.java:1816)
 - locked <da20da2> (a org.eclipse.osgi.framework.internal.core.Framework)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"State Data Manager" - Thread t@59
   java.lang.Thread.State: TIMED_WAITING
 at java.lang.Thread.sleep(Native Method)
 at java.lang.Thread.sleep(Thread.java:851)
 at org.eclipse.osgi.internal.baseadaptor.StateManager.run(StateManager.java:297)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"Start Level Event Dispatcher" - Thread t@60
   java.lang.Thread.State: WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <56de56de> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
 at java.lang.Object.wait(Object.java:167)
 at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.getNextEvent(EventManager.java:400)
 - locked <56de56de> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
 at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.run(EventManager.java:336)

   Locked ownable synchronizers:
 - None

"Framework Event Dispatcher" - Thread t@61
   java.lang.Thread.State: WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <1750175> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
 at java.lang.Object.wait(Object.java:167)
 at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.getNextEvent(EventManager.java:400)
 - locked <1750175> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
 at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.run(EventManager.java:336)

   Locked ownable synchronizers:
 - None

"[Timer] - Main Queue Handler" - Thread t@63
   java.lang.Thread.State: TIMED_WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <4260426> (a java.lang.Object)
 at java.lang.Object.wait(Object.java:196)
 at org.eclipse.equinox.internal.util.impl.tpt.timer.TimerImpl.run(TimerImpl.java:141)
 - locked <4260426> (a java.lang.Object)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"Bundle File Closer" - Thread t@64
   java.lang.Thread.State: WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <232f232f> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
 at java.lang.Object.wait(Object.java:167)
 at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.getNextEvent(EventManager.java:400)
 - locked <232f232f> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
 at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.run(EventManager.java:336)

   Locked ownable synchronizers:
 - None

"Worker-JM" - Thread t@65
   java.lang.Thread.State: WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <63926392> (a java.util.ArrayList)
 at java.lang.Object.wait(Object.java:196)
 at org.eclipse.core.internal.jobs.InternalWorker.run(InternalWorker.java:58)
 - locked <63926392> (a java.util.ArrayList)

   Locked ownable synchronizers:
 - None

"Thread-19" - Thread t@69
   java.lang.Thread.State: TIMED_WAITING
 at java.lang.Thread.sleep(Native Method)
 at java.lang.Thread.sleep(Thread.java:851)
 at com.ibm.ccl.ut.filter.CacheManager.sleep(CacheManager.java:39)
 at com.ibm.ccl.ut.filter.CacheManager.run(CacheManager.java:48)

   Locked ownable synchronizers:
 - None

"Worker-0" - Thread t@72
   java.lang.Thread.State: TIMED_WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <279b279b> (a org.eclipse.core.internal.jobs.WorkerPool)
 at java.lang.Object.wait(Object.java:196)
 at org.eclipse.core.internal.jobs.WorkerPool.sleep(WorkerPool.java:188)
 - locked <279b279b> (a org.eclipse.core.internal.jobs.WorkerPool)
 at org.eclipse.core.internal.jobs.WorkerPool.startJob(WorkerPool.java:220)
 at org.eclipse.core.internal.jobs.Worker.run(Worker.java:50)

   Locked ownable synchronizers:
 - None

"Provisioning Event Dispatcher" - Thread t@73
   java.lang.Thread.State: WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <755e755e> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
 at java.lang.Object.wait(Object.java:167)
 at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.getNextEvent(EventManager.java:400)
 - locked <755e755e> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
 at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.run(EventManager.java:336)

   Locked ownable synchronizers:
 - None

"State Data Manager" - Thread t@74
   java.lang.Thread.State: TIMED_WAITING
 at java.lang.Thread.sleep(Native Method)
 at java.lang.Thread.sleep(Thread.java:851)
 at org.eclipse.osgi.internal.baseadaptor.StateManager.run(StateManager.java:319)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"Start Level Event Dispatcher" - Thread t@75
   java.lang.Thread.State: WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <59f459f4> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
 at java.lang.Object.wait(Object.java:167)
 at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.getNextEvent(EventManager.java:397)
 - locked <59f459f4> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
 at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.run(EventManager.java:333)

   Locked ownable synchronizers:
 - None

"Framework Event Dispatcher" - Thread t@76
   java.lang.Thread.State: WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <2f602f6> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
 at java.lang.Object.wait(Object.java:167)
 at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.getNextEvent(EventManager.java:397)
 - locked <2f602f6> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
 at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.run(EventManager.java:333)

   Locked ownable synchronizers:
 - None

"Bundle File Closer" - Thread t@77
   java.lang.Thread.State: WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <324e324e> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
 at java.lang.Object.wait(Object.java:167)
 at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.getNextEvent(EventManager.java:397)
 - locked <324e324e> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
 at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.run(EventManager.java:333)

   Locked ownable synchronizers:
 - None

"Worker-JM" - Thread t@80
   java.lang.Thread.State: WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <261e261e> (a java.util.ArrayList)
 at java.lang.Object.wait(Object.java:196)
 at org.eclipse.core.internal.jobs.InternalWorker.run(InternalWorker.java:58)
 - locked <261e261e> (a java.util.ArrayList)

   Locked ownable synchronizers:
 - None

"Start Level Event Dispatcher" - Thread t@81
   java.lang.Thread.State: WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <5f755f75> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
 at java.lang.Object.wait(Object.java:167)
 at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.getNextEvent(EventManager.java:397)
 - locked <5f755f75> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
 at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.run(EventManager.java:333)

   Locked ownable synchronizers:
 - None

"Framework Event Dispatcher" - Thread t@82
   java.lang.Thread.State: WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <7b3b7b3b> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
 at java.lang.Object.wait(Object.java:167)
 at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.getNextEvent(EventManager.java:397)
 - locked <7b3b7b3b> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
 at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.run(EventManager.java:333)

   Locked ownable synchronizers:
 - None

"Worker-JM" - Thread t@83
   java.lang.Thread.State: WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <7b117b11> (a java.util.ArrayList)
 at java.lang.Object.wait(Object.java:196)
 at org.eclipse.core.internal.jobs.InternalWorker.run(InternalWorker.java:58)
 - locked <7b117b11> (a java.util.ArrayList)

   Locked ownable synchronizers:
 - None

"CommonCache Scrubber" - Thread t@87
   java.lang.Thread.State: TIMED_WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <2cad2cad> (a java.util.Timer$TimerImpl)
 at java.lang.Object.wait(Object.java:196)
 at java.util.Timer$TimerImpl.run(Timer.java:246)
 - locked <2cad2cad> (a java.util.Timer$TimerImpl)

   Locked ownable synchronizers:
 - None

"[Timer] - Main Queue Handler" - Thread t@88
   java.lang.Thread.State: TIMED_WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <708d708d> (a java.lang.Object)
 at java.lang.Object.wait(Object.java:196)
 at org.eclipse.equinox.internal.util.impl.tpt.timer.TimerImpl.run(TimerImpl.java:141)
 - locked <708d708d> (a java.lang.Object)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"[ThreadPool Manager] - Idle Thread" - Thread t@89
   java.lang.Thread.State: WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <178e178e> (a org.eclipse.equinox.internal.util.impl.tpt.threadpool.Executor)
 at java.lang.Object.wait(Object.java:167)
 at org.eclipse.equinox.internal.util.impl.tpt.threadpool.Executor.run(Executor.java:106)
 - locked <178e178e> (a org.eclipse.equinox.internal.util.impl.tpt.threadpool.Executor)

   Locked ownable synchronizers:
 - None

"Bundle File Closer" - Thread t@90
   java.lang.Thread.State: WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <65d565d5> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
 at java.lang.Object.wait(Object.java:167)
 at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.getNextEvent(EventManager.java:397)
 - locked <65d565d5> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
 at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.run(EventManager.java:333)

   Locked ownable synchronizers:
 - None

"pool-28-thread-1" - Thread t@91
   java.lang.Thread.State: TIMED_WAITING
 at sun.misc.Unsafe.park(Native Method)
 - parking to wait for <71017101> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
 at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:211)
 at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
 at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
 at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
 at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
 at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"Worker-0" - Thread t@92
   java.lang.Thread.State: TIMED_WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <52085208> (a org.eclipse.core.internal.jobs.WorkerPool)
 at java.lang.Object.wait(Object.java:196)
 at org.eclipse.core.internal.jobs.WorkerPool.sleep(WorkerPool.java:185)
 - locked <52085208> (a org.eclipse.core.internal.jobs.WorkerPool)
 at org.eclipse.core.internal.jobs.WorkerPool.startJob(WorkerPool.java:217)
 at org.eclipse.core.internal.jobs.Worker.run(Worker.java:50)

   Locked ownable synchronizers:
 - None

"Start Level Event Dispatcher" - Thread t@93
   java.lang.Thread.State: WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <9d509d5> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
 at java.lang.Object.wait(Object.java:167)
 at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.getNextEvent(EventManager.java:397)
 - locked <9d509d5> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
 at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.run(EventManager.java:333)

   Locked ownable synchronizers:
 - None

"Framework Event Dispatcher" - Thread t@94
   java.lang.Thread.State: WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <614c614c> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
 at java.lang.Object.wait(Object.java:167)
 at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.getNextEvent(EventManager.java:397)
 - locked <614c614c> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
 at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.run(EventManager.java:333)

   Locked ownable synchronizers:
 - None

"Worker-JM" - Thread t@95
   java.lang.Thread.State: WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <1a031a03> (a java.util.ArrayList)
 at java.lang.Object.wait(Object.java:196)
 at org.eclipse.core.internal.jobs.InternalWorker.run(InternalWorker.java:58)
 - locked <1a031a03> (a java.util.ArrayList)

   Locked ownable synchronizers:
 - None

"Worker-0" - Thread t@99
   java.lang.Thread.State: TIMED_WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <6fde6fde> (a org.eclipse.core.internal.jobs.WorkerPool)
 at java.lang.Object.wait(Object.java:196)
 at org.eclipse.core.internal.jobs.WorkerPool.sleep(WorkerPool.java:185)
 - locked <6fde6fde> (a org.eclipse.core.internal.jobs.WorkerPool)
 at org.eclipse.core.internal.jobs.WorkerPool.startJob(WorkerPool.java:217)
 at org.eclipse.core.internal.jobs.Worker.run(Worker.java:50)

   Locked ownable synchronizers:
 - None

"Java indexing" - Thread t@100
   java.lang.Thread.State: WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <7eef7eef> (a org.eclipse.jdt.internal.core.search.indexing.IndexManager)
 at java.lang.Object.wait(Object.java:167)
 at org.eclipse.jdt.internal.core.search.processing.JobManager.run(JobManager.java:381)
 - locked <7eef7eef> (a org.eclipse.jdt.internal.core.search.indexing.IndexManager)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"Worker-1" - Thread t@101
   java.lang.Thread.State: TIMED_WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <6fde6fde> (a org.eclipse.core.internal.jobs.WorkerPool)
 at java.lang.Object.wait(Object.java:196)
 at org.eclipse.core.internal.jobs.WorkerPool.sleep(WorkerPool.java:185)
 - locked <6fde6fde> (a org.eclipse.core.internal.jobs.WorkerPool)
 at org.eclipse.core.internal.jobs.WorkerPool.startJob(WorkerPool.java:217)
 at org.eclipse.core.internal.jobs.Worker.run(Worker.java:50)

   Locked ownable synchronizers:
 - None

"CommonCache Scrubber" - Thread t@102
   java.lang.Thread.State: TIMED_WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <749d749d> (a java.util.Timer$TimerImpl)
 at java.lang.Object.wait(Object.java:196)
 at java.util.Timer$TimerImpl.run(Timer.java:246)
 - locked <749d749d> (a java.util.Timer$TimerImpl)

   Locked ownable synchronizers:
 - None

"[Timer] - Main Queue Handler" - Thread t@103
   java.lang.Thread.State: TIMED_WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <47904790> (a java.lang.Object)
 at java.lang.Object.wait(Object.java:196)
 at org.eclipse.equinox.internal.util.impl.tpt.timer.TimerImpl.run(TimerImpl.java:141)
 - locked <47904790> (a java.lang.Object)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"[ThreadPool Manager] - Idle Thread" - Thread t@104
   java.lang.Thread.State: WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <6e7f6e7f> (a org.eclipse.equinox.internal.util.impl.tpt.threadpool.Executor)
 at java.lang.Object.wait(Object.java:167)
 at org.eclipse.equinox.internal.util.impl.tpt.threadpool.Executor.run(Executor.java:106)
 - locked <6e7f6e7f> (a org.eclipse.equinox.internal.util.impl.tpt.threadpool.Executor)

   Locked ownable synchronizers:
 - None

"Bundle File Closer" - Thread t@105
   java.lang.Thread.State: WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <72eb72eb> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
 at java.lang.Object.wait(Object.java:167)
 at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.getNextEvent(EventManager.java:397)
 - locked <72eb72eb> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
 at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.run(EventManager.java:333)

   Locked ownable synchronizers:
 - None

"pool-34-thread-1" - Thread t@106
   java.lang.Thread.State: TIMED_WAITING
 at sun.misc.Unsafe.park(Native Method)
 - parking to wait for <7efd7efd> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
 at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:211)
 at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
 at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
 at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
 at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
 at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"Start Level Event Dispatcher" - Thread t@107
   java.lang.Thread.State: WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <ee60ee6> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
 at java.lang.Object.wait(Object.java:167)
 at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.getNextEvent(EventManager.java:397)
 - locked <ee60ee6> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
 at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.run(EventManager.java:333)

   Locked ownable synchronizers:
 - None

"Framework Event Dispatcher" - Thread t@108
   java.lang.Thread.State: WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <61bb61bb> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
 at java.lang.Object.wait(Object.java:167)
 at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.getNextEvent(EventManager.java:397)
 - locked <61bb61bb> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
 at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.run(EventManager.java:333)

   Locked ownable synchronizers:
 - None

"Worker-JM" - Thread t@109
   java.lang.Thread.State: WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <59a459a4> (a java.util.ArrayList)
 at java.lang.Object.wait(Object.java:196)
 at org.eclipse.core.internal.jobs.InternalWorker.run(InternalWorker.java:58)
 - locked <59a459a4> (a java.util.ArrayList)

   Locked ownable synchronizers:
 - None

"CommonCache Scrubber" - Thread t@113
   java.lang.Thread.State: TIMED_WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <58515851> (a java.util.Timer$TimerImpl)
 at java.lang.Object.wait(Object.java:196)
 at java.util.Timer$TimerImpl.run(Timer.java:246)
 - locked <58515851> (a java.util.Timer$TimerImpl)

   Locked ownable synchronizers:
 - None

"pool-43-thread-1" - Thread t@114
   java.lang.Thread.State: TIMED_WAITING
 at sun.misc.Unsafe.park(Native Method)
 - parking to wait for <228a228a> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
 at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:211)
 at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
 at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
 at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
 at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
 at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"[Timer] - Main Queue Handler" - Thread t@115
   java.lang.Thread.State: TIMED_WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <f8e0f8e> (a java.lang.Object)
 at java.lang.Object.wait(Object.java:196)
 at org.eclipse.equinox.internal.util.impl.tpt.timer.TimerImpl.run(TimerImpl.java:141)
 - locked <f8e0f8e> (a java.lang.Object)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"[ThreadPool Manager] - Idle Thread" - Thread t@116
   java.lang.Thread.State: WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <34cd34cd> (a org.eclipse.equinox.internal.util.impl.tpt.threadpool.Executor)
 at java.lang.Object.wait(Object.java:167)
 at org.eclipse.equinox.internal.util.impl.tpt.threadpool.Executor.run(Executor.java:106)
 - locked <34cd34cd> (a org.eclipse.equinox.internal.util.impl.tpt.threadpool.Executor)

   Locked ownable synchronizers:
 - None

"RRC-Project Add Signal Watcher" - Thread t@117
   java.lang.Thread.State: WAITING
 at sun.misc.Unsafe.park(Native Method)
 - parking to wait for <4df54df5> (a java.util.concurrent.CountDownLatch$Sync)
 at java.util.concurrent.locks.LockSupport.park(LockSupport.java:171)
 at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:811)
 at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:969)
 at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1281)
 at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:207)
 at com.ibm.team.jfs.app.distributed.InMemorySignal.waitFor(InMemorySignal.java:41)
 at com.ibm.rdm.fronting.server.services.types.internal.WellKnownTypesCache$1.run(WellKnownTypesCache.java:129)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"RRC-Project Removed Signal Watcher" - Thread t@118
   java.lang.Thread.State: WAITING
 at sun.misc.Unsafe.park(Native Method)
 - parking to wait for <4eba4eba> (a java.util.concurrent.CountDownLatch$Sync)
 at java.util.concurrent.locks.LockSupport.park(LockSupport.java:171)
 at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:811)
 at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:969)
 at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1281)
 at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:207)
 at com.ibm.team.jfs.app.distributed.InMemorySignal.waitFor(InMemorySignal.java:41)
 at com.ibm.rdm.fronting.server.services.types.internal.WellKnownTypesCache$2.run(WellKnownTypesCache.java:200)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"pool-45-thread-1" - Thread t@119
   java.lang.Thread.State: TIMED_WAITING
 at sun.misc.Unsafe.park(Native Method)
 - parking to wait for <44674467> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
 at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:211)
 at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
 at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
 at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
 at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
 at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"RRC-Fronting Property Signal Watcher" - Thread t@120
   java.lang.Thread.State: WAITING
 at sun.misc.Unsafe.park(Native Method)
 - parking to wait for <10701070> (a java.util.concurrent.CountDownLatch$Sync)
 at java.util.concurrent.locks.LockSupport.park(LockSupport.java:171)
 at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:811)
 at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:969)
 at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1281)
 at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:207)
 at com.ibm.team.jfs.app.distributed.InMemorySignal.waitFor(InMemorySignal.java:41)
 at com.ibm.rdm.fronting.server.util.ConfigImpl$1.run(ConfigImpl.java:507)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"EventAdmin Async Event Dispatcher Thread" - Thread t@121
   java.lang.Thread.State: WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <7b137b13> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
 at java.lang.Object.wait(Object.java:167)
 at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.getNextEvent(EventManager.java:397)
 - locked <7b137b13> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
 at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.run(EventManager.java:333)

   Locked ownable synchronizers:
 - None

"Shared FriendsConfig Update Listener" - Thread t@122
   java.lang.Thread.State: WAITING
 at sun.misc.Unsafe.park(Native Method)
 - parking to wait for <28042804> (a java.util.concurrent.CountDownLatch$Sync)
 at java.util.concurrent.locks.LockSupport.park(LockSupport.java:171)
 at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:811)
 at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:969)
 at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1281)
 at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:207)
 at com.ibm.team.jfs.app.distributed.InMemorySignal.waitFor(InMemorySignal.java:41)
 at com.ibm.team.jfs.app.friendsconfig.internal.InMemoryFriendsConfigStorage$1.run(InMemoryFriendsConfigStorage.java:247)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"pool-40-thread-1" - Thread t@123
   java.lang.Thread.State: TIMED_WAITING
 at sun.misc.Unsafe.park(Native Method)
 - parking to wait for <22d622d6> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
 at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:211)
 at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
 at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
 at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
 at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
 at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"Bundle File Closer" - Thread t@125
   java.lang.Thread.State: WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <488c488c> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
 at java.lang.Object.wait(Object.java:167)
 at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.getNextEvent(EventManager.java:397)
 - locked <488c488c> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
 at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.run(EventManager.java:333)

   Locked ownable synchronizers:
 - None

"Worker-1" - Thread t@126
   java.lang.Thread.State: TIMED_WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <279b279b> (a org.eclipse.core.internal.jobs.WorkerPool)
 at java.lang.Object.wait(Object.java:196)
 at org.eclipse.core.internal.jobs.WorkerPool.sleep(WorkerPool.java:188)
 - locked <279b279b> (a org.eclipse.core.internal.jobs.WorkerPool)
 at org.eclipse.core.internal.jobs.WorkerPool.startJob(WorkerPool.java:220)
 at org.eclipse.core.internal.jobs.Worker.run(Worker.java:50)

   Locked ownable synchronizers:
 - None

"ContainerBackgroundProcessor[StandardEngine[Catalina]]" - Thread t@127
   java.lang.Thread.State: TIMED_WAITING
 at java.lang.Thread.sleep(Native Method)
 at java.lang.Thread.sleep(Thread.java:851)
 at org.apache.catalina.core.ContainerBase$ContainerBackgroundProcessor.run(ContainerBase.java:1517)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"http-bio-9080-Acceptor-0" - Thread t@128
   java.lang.Thread.State: RUNNABLE
 at java.net.PlainSocketImpl.socketAccept(Native Method)
 at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:438)
 - locked <69376937> (a java.net.SocksSocketImpl)
 at java.net.ServerSocket.implAccept(ServerSocket.java:462)
 at java.net.ServerSocket.accept(ServerSocket.java:430)
 at org.apache.tomcat.util.net.DefaultServerSocketFactory.acceptSocket(DefaultServerSocketFactory.java:60)
 at org.apache.tomcat.util.net.JIoEndpoint$Acceptor.run(JIoEndpoint.java:216)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"http-bio-9080-AsyncTimeout" - Thread t@129
   java.lang.Thread.State: TIMED_WAITING
 at java.lang.Thread.sleep(Native Method)
 at java.lang.Thread.sleep(Thread.java:851)
 at org.apache.tomcat.util.net.JIoEndpoint$AsyncTimeout.run(JIoEndpoint.java:148)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"http-bio-9443-Acceptor-0" - Thread t@130
   java.lang.Thread.State: RUNNABLE
 at java.net.PlainSocketImpl.socketAccept(Native Method)
 at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:438)
 - locked <661b661b> (a java.net.SocksSocketImpl)
 at java.net.ServerSocket.implAccept(ServerSocket.java:462)
 at com.ibm.jsse2.cd.accept(cd.java:35)
 at org.apache.tomcat.util.net.jsse.JSSESocketFactory.acceptSocket(JSSESocketFactory.java:182)
 at org.apache.tomcat.util.net.JIoEndpoint$Acceptor.run(JIoEndpoint.java:216)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"http-bio-9443-AsyncTimeout" - Thread t@131
   java.lang.Thread.State: TIMED_WAITING
 at java.lang.Thread.sleep(Native Method)
 at java.lang.Thread.sleep(Thread.java:851)
 at org.apache.tomcat.util.net.JIoEndpoint$AsyncTimeout.run(JIoEndpoint.java:148)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"ajp-bio-9009-Acceptor-0" - Thread t@132
   java.lang.Thread.State: RUNNABLE
 at java.net.PlainSocketImpl.socketAccept(Native Method)
 at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:438)
 - locked <10f110f1> (a java.net.SocksSocketImpl)
 at java.net.ServerSocket.implAccept(ServerSocket.java:462)
 at java.net.ServerSocket.accept(ServerSocket.java:430)
 at org.apache.tomcat.util.net.DefaultServerSocketFactory.acceptSocket(DefaultServerSocketFactory.java:60)
 at org.apache.tomcat.util.net.JIoEndpoint$Acceptor.run(JIoEndpoint.java:216)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"ajp-bio-9009-AsyncTimeout" - Thread t@133
   java.lang.Thread.State: TIMED_WAITING
 at java.lang.Thread.sleep(Native Method)
 at java.lang.Thread.sleep(Thread.java:851)
 at org.apache.tomcat.util.net.JIoEndpoint$AsyncTimeout.run(JIoEndpoint.java:148)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"[ThreadPool Manager] - Idle Thread" - Thread t@135
   java.lang.Thread.State: WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <372d372d> (a org.eclipse.equinox.internal.util.impl.tpt.threadpool.Executor)
 at java.lang.Object.wait(Object.java:167)
 at org.eclipse.equinox.internal.util.impl.tpt.threadpool.Executor.run(Executor.java:106)
 - locked <372d372d> (a org.eclipse.equinox.internal.util.impl.tpt.threadpool.Executor)

   Locked ownable synchronizers:
 - None

"pool-7-thread-1" - Thread t@136
   java.lang.Thread.State: WAITING
 at sun.misc.Unsafe.park(Native Method)
 - parking to wait for <6fa16fa1> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
 at java.util.concurrent.locks.LockSupport.park(LockSupport.java:171)
 at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
 at java.util.concurrent.DelayQueue.take(DelayQueue.java:160)
 at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
 at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
 at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"pool-13-thread-1" - Thread t@137
   java.lang.Thread.State: WAITING
 at sun.misc.Unsafe.park(Native Method)
 - parking to wait for <1cab1cab> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
 at java.util.concurrent.locks.LockSupport.park(LockSupport.java:171)
 at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
 at java.util.concurrent.DelayQueue.take(DelayQueue.java:160)
 at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
 at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
 at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"pool-27-thread-1" - Thread t@138
   java.lang.Thread.State: WAITING
 at sun.misc.Unsafe.park(Native Method)
 - parking to wait for <36ae36ae> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
 at java.util.concurrent.locks.LockSupport.park(LockSupport.java:171)
 at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
 at java.util.concurrent.DelayQueue.take(DelayQueue.java:160)
 at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
 at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
 at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"pool-33-thread-1" - Thread t@139
   java.lang.Thread.State: WAITING
 at sun.misc.Unsafe.park(Native Method)
 - parking to wait for <44074407> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
 at java.util.concurrent.locks.LockSupport.park(LockSupport.java:171)
 at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
 at java.util.concurrent.DelayQueue.take(DelayQueue.java:160)
 at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
 at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
 at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"pool-44-thread-1" - Thread t@140
   java.lang.Thread.State: WAITING
 at sun.misc.Unsafe.park(Native Method)
 - parking to wait for <29222922> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
 at java.util.concurrent.locks.LockSupport.park(LockSupport.java:171)
 at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
 at java.util.concurrent.DelayQueue.take(DelayQueue.java:160)
 at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
 at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
 at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"http-bio-9443-exec-1" - Thread t@141
   java.lang.Thread.State: TIMED_WAITING
 at sun.misc.Unsafe.park(Native Method)
 - parking to wait for <70117011> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
 at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:211)
 at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
 at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:424)
 at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:86)
 at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:32)
 at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:945)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"http-bio-9443-exec-2" - Thread t@142
   java.lang.Thread.State: RUNNABLE
 at java.net.SocketInputStream.socketRead0(Native Method)
 at java.net.SocketInputStream.read(SocketInputStream.java:129)
 at com.ibm.jsse2.b.a(b.java:95)
 at com.ibm.jsse2.b.a(b.java:65)
 at com.ibm.jsse2.SSLSocketImpl.a(SSLSocketImpl.java:242)
 - locked <6a0b6a0b> (a java.lang.Object)
 at com.ibm.jsse2.SSLSocketImpl.a(SSLSocketImpl.java:773)
 at com.ibm.jsse2.f.read(f.java:26)
 - locked <6a336a33> (a com.ibm.jsse2.f)
 at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:516)
 at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:501)
 at org.apache.coyote.http11.Http11Processor.setRequestLineReadTimeout(Http11Processor.java:172)
 at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:912)
 at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:579)
 at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:309)
 - locked <6cdd6cdd> (a org.apache.tomcat.util.net.SocketWrapper)
 at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - locked <42164216> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

"http-bio-9443-exec-3" - Thread t@143
   java.lang.Thread.State: TIMED_WAITING
 at sun.misc.Unsafe.park(Native Method)
 - parking to wait for <70117011> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
 at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:211)
 at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
 at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:424)
 at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:86)
 at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:32)
 at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:945)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"http-bio-9443-exec-4" - Thread t@144
   java.lang.Thread.State: TIMED_WAITING
 at sun.misc.Unsafe.park(Native Method)
 - parking to wait for <70117011> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
 at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:211)
 at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
 at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:424)
 at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:86)
 at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:32)
 at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:945)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"http-bio-9443-exec-5" - Thread t@145
   java.lang.Thread.State: RUNNABLE
 at java.net.SocketInputStream.socketRead0(Native Method)
 at java.net.SocketInputStream.read(SocketInputStream.java:129)
 at com.ibm.jsse2.b.a(b.java:95)
 at com.ibm.jsse2.b.a(b.java:65)
 at com.ibm.jsse2.SSLSocketImpl.a(SSLSocketImpl.java:242)
 - locked <273b273b> (a java.lang.Object)
 at com.ibm.jsse2.SSLSocketImpl.a(SSLSocketImpl.java:773)
 at com.ibm.jsse2.f.read(f.java:26)
 - locked <27632763> (a com.ibm.jsse2.f)
 at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:516)
 at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:501)
 at org.apache.coyote.http11.Http11Processor.setRequestLineReadTimeout(Http11Processor.java:172)
 at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:912)
 at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:579)
 at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:309)
 - locked <7a4f7a4f> (a org.apache.tomcat.util.net.SocketWrapper)
 at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - locked <6570657> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

"http-bio-9443-exec-6" - Thread t@146
   java.lang.Thread.State: TIMED_WAITING
 at sun.misc.Unsafe.park(Native Method)
 - parking to wait for <70117011> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
 at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:211)
 at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
 at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:424)
 at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:86)
 at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:32)
 at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:945)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"http-bio-9443-exec-7" - Thread t@147
   java.lang.Thread.State: RUNNABLE
 at java.net.Inet6AddressImpl.lookupAllHostAddr(Native Method)
 at java.net.InetAddress$2.lookupAllHostAddr(InetAddress.java:937)
 at java.net.InetAddress.getAddressFromNameService(InetAddress.java:1308)
 at java.net.InetAddress.getAllByName0(InetAddress.java:1256)
 at java.net.InetAddress.getAllByName(InetAddress.java:1185)
 at java.net.InetAddress.getAllByName(InetAddress.java:1107)
 at java.net.InetAddress.getByName(InetAddress.java:1057)
 at java.net.URLStreamHandler.getHostAddress(URLStreamHandler.java:426)
 - locked <64ee64ee> (a net.jazz.ajax.model.BundleResourceStreamHandler)
 at java.net.URLStreamHandler.hashCode(URLStreamHandler.java:343)
 at java.net.URL.hashCode(URL.java:858)
 - locked <64c664c6> (a java.net.URL)
 at java.util.HashMap.putImpl(HashMap.java:622)
 at java.util.HashMap.put(HashMap.java:607)
 at net.jazz.ajax.model.SpriteLayout$Algorithm.loadImages(SpriteLayout.java:106)
 at net.jazz.ajax.model.SpriteLayout$Algorithm.solve(SpriteLayout.java:88)
 at net.jazz.ajax.model.SpriteLayout.<init>(SpriteLayout.java:48)
 at net.jazz.ajax.model.Sprite.getLayout(Sprite.java:83)
 at net.jazz.ajax.model.Sprite.getState(Sprite.java:113)
 at net.jazz.ajax.servlets.ResourceGraph.trackState(ResourceGraph.java:286)
 at net.jazz.ajax.servlets.ResourceGraph.<init>(ResourceGraph.java:70)
 at net.jazz.ajax.servlets.ResourceGraphOperation.getResult(ResourceGraphOperation.java:61)
 at net.jazz.ajax.internal.util.Cache.execute(Cache.java:78)
 at net.jazz.ajax.internal.util.CacheableOperation.execute(CacheableOperation.java:32)
 at net.jazz.ajax.model.AjaxPage.write(AjaxPage.java:100)
 at net.jazz.ajax.servlets.AjaxPageServlet.doGet(AjaxPageServlet.java:31)
 at javax.servlet.http.HttpServlet.service(HttpServlet.java:621)
 at javax.servlet.http.HttpServlet.service(HttpServlet.java:722)
 at net.jazz.ajax.servlets.LoggingHttpServlet.service(LoggingHttpServlet.java:35)
 at org.eclipse.equinox.http.servlet.internal.ServletRegistration.service(ServletRegistration.java:61)
 at org.eclipse.equinox.http.servlet.internal.ProxyServlet.processAlias(ProxyServlet.java:126)
 at org.eclipse.equinox.http.servlet.internal.ProxyServlet.service(ProxyServlet.java:60)
 at javax.servlet.http.HttpServlet.service(HttpServlet.java:722)
 at org.eclipse.equinox.servletbridge.BridgeServlet.service(BridgeServlet.java:120)
 at com.ibm.team.repository.server.servletbridge.JazzServlet.service(JazzServlet.java:68)
 at javax.servlet.http.HttpServlet.service(HttpServlet.java:722)
 at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:305)
 at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
 at com.ibm.team.repository.server.servletbridge.BridgeFilter.processDelegate(BridgeFilter.java:133)
 at com.ibm.team.repository.server.servletbridge.BridgeFilter.initialize(BridgeFilter.java:264)
 at com.ibm.team.repository.server.servletbridge.BridgeFilter.doFilter(BridgeFilter.java:149)
 at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)
 at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
 at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:224)
 at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:169)
 at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:581)
 at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:168)
 at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:98)
 at org.apache.catalina.authenticator.SingleSignOn.invoke(SingleSignOn.java:336)
 at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:118)
 at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:407)
 at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:987)
 at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:579)
 at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:307)
 - locked <32f432f4> (a org.apache.tomcat.util.net.SocketWrapper)
 at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - locked <33053305> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

"http-bio-9443-exec-8" - Thread t@148
   java.lang.Thread.State: RUNNABLE
 at java.net.SocketInputStream.socketRead0(Native Method)
 at java.net.SocketInputStream.read(SocketInputStream.java:129)
 at com.ibm.jsse2.b.a(b.java:95)
 at com.ibm.jsse2.b.a(b.java:65)
 at com.ibm.jsse2.SSLSocketImpl.a(SSLSocketImpl.java:242)
 - locked <7a957a95> (a java.lang.Object)
 at com.ibm.jsse2.SSLSocketImpl.a(SSLSocketImpl.java:773)
 at com.ibm.jsse2.f.read(f.java:26)
 - locked <7abd7abd> (a com.ibm.jsse2.f)
 at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:516)
 at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:501)
 at org.apache.coyote.http11.Http11Processor.setRequestLineReadTimeout(Http11Processor.java:172)
 at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:912)
 at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:579)
 at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:309)
 - locked <53f753f7> (a org.apache.tomcat.util.net.SocketWrapper)
 at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - locked <44fc44fc> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

"jts: AsynchronousTaskRunner-0" - Thread t@151
   java.lang.Thread.State: WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <5b305b3> (a java.util.LinkedList)
 at java.lang.Object.wait(Object.java:167)
 at com.ibm.team.repository.service.internal.scheduler.AsynchronousTaskManager.getNextTask(AsynchronousTaskManager.java:286)
 - locked <5b305b3> (a java.util.LinkedList)
 at com.ibm.team.repository.service.internal.scheduler.AsynchronousTaskRunner.run(AsynchronousTaskRunner.java:96)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"jts: AsynchronousTaskRunner-1" - Thread t@152
   java.lang.Thread.State: WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <5b305b3> (a java.util.LinkedList)
 at java.lang.Object.wait(Object.java:167)
 at com.ibm.team.repository.service.internal.scheduler.AsynchronousTaskManager.getNextTask(AsynchronousTaskManager.java:286)
 - locked <5b305b3> (a java.util.LinkedList)
 at com.ibm.team.repository.service.internal.scheduler.AsynchronousTaskRunner.run(AsynchronousTaskRunner.java:96)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"jts: AsynchronousTaskRunner-2" - Thread t@153
   java.lang.Thread.State: WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <5b305b3> (a java.util.LinkedList)
 at java.lang.Object.wait(Object.java:167)
 at com.ibm.team.repository.service.internal.scheduler.AsynchronousTaskManager.getNextTask(AsynchronousTaskManager.java:286)
 - locked <5b305b3> (a java.util.LinkedList)
 at com.ibm.team.repository.service.internal.scheduler.AsynchronousTaskRunner.run(AsynchronousTaskRunner.java:96)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"jts: AsynchronousTaskRunner-3" - Thread t@154
   java.lang.Thread.State: WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <5b305b3> (a java.util.LinkedList)
 at java.lang.Object.wait(Object.java:167)
 at com.ibm.team.repository.service.internal.scheduler.AsynchronousTaskManager.getNextTask(AsynchronousTaskManager.java:286)
 - locked <5b305b3> (a java.util.LinkedList)
 at com.ibm.team.repository.service.internal.scheduler.AsynchronousTaskRunner.run(AsynchronousTaskRunner.java:96)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"jts: AsynchronousTaskRunner-4" - Thread t@155
   java.lang.Thread.State: WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <5b305b3> (a java.util.LinkedList)
 at java.lang.Object.wait(Object.java:167)
 at com.ibm.team.repository.service.internal.scheduler.AsynchronousTaskManager.getNextTask(AsynchronousTaskManager.java:286)
 - locked <5b305b3> (a java.util.LinkedList)
 at com.ibm.team.repository.service.internal.scheduler.AsynchronousTaskRunner.run(AsynchronousTaskRunner.java:96)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"jts: Asynchronous local task scheduler" - Thread t@156
   java.lang.Thread.State: TIMED_WAITING
 at sun.misc.Unsafe.park(Native Method)
 - parking to wait for <3e0a3e0a> (a java.util.concurrent.CountDownLatch$Sync)
 at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:211)
 at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1011)
 at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1303)
 at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:253)
 at com.ibm.team.repository.service.internal.AsynchronousTaskSchedulerService.runQueueingLoopOnce(AsynchronousTaskSchedulerService.java:457)
 at com.ibm.team.repository.service.internal.AsynchronousTaskSchedulerService.runQueueingLoop(AsynchronousTaskSchedulerService.java:284)
 at com.ibm.team.repository.service.internal.AsynchronousTaskSchedulerService.access$2(AsynchronousTaskSchedulerService.java:279)
 at com.ibm.team.repository.service.internal.AsynchronousTaskSchedulerService$1.run(AsynchronousTaskSchedulerService.java:213)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"jts: Asynchronous global task scheduler" - Thread t@157
   java.lang.Thread.State: TIMED_WAITING
 at sun.misc.Unsafe.park(Native Method)
 - parking to wait for <710f710f> (a java.util.concurrent.CountDownLatch$Sync)
 at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:211)
 at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1011)
 at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1303)
 at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:253)
 at com.ibm.team.repository.service.internal.AsynchronousTaskSchedulerService.runQueueingLoopOnce(AsynchronousTaskSchedulerService.java:457)
 at com.ibm.team.repository.service.internal.AsynchronousTaskSchedulerService.runQueueingLoop(AsynchronousTaskSchedulerService.java:284)
 at com.ibm.team.repository.service.internal.AsynchronousTaskSchedulerService.access$2(AsynchronousTaskSchedulerService.java:279)
 at com.ibm.team.repository.service.internal.AsynchronousTaskSchedulerService$2.run(AsynchronousTaskSchedulerService.java:220)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"jena.query.monitor" - Thread t@159
   java.lang.Thread.State: TIMED_WAITING
 at java.lang.Thread.sleep(Native Method)
 at java.lang.Thread.sleep(Thread.java:851)
 at com.ibm.team.jfs.rdf.internal.jena.provider.JenaQueryMonitor.run(JenaQueryMonitor.java:279)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"http-bio-9443-exec-9" - Thread t@160
   java.lang.Thread.State: TIMED_WAITING
 at sun.misc.Unsafe.park(Native Method)
 - parking to wait for <70117011> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
 at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:211)
 at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
 at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:424)
 at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:86)
 at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:32)
 at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:945)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"Rational Common Licensing License Operation Handler" - Thread t@161
   java.lang.Thread.State: TIMED_WAITING
 at java.lang.Thread.sleep(Native Method)
 at java.lang.Thread.sleep(Thread.java:851)
 at com.ibm.rational.common.token.licensing.LicenseActionHandler.run(LicenseActionHandler.java:95)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"Failure handler" - Thread t@162
   java.lang.Thread.State: TIMED_WAITING
 at java.lang.Thread.sleep(Native Method)
 at java.lang.Thread.sleep(Thread.java:851)
 at com.ibm.rational.common.token.licensing.FailureHandler.run(FailureHandler.java:110)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"Rational Common Licensing Check In Handler 1" - Thread t@163
   java.lang.Thread.State: TIMED_WAITING
 at java.lang.Thread.sleep(Native Method)
 at java.lang.Thread.sleep(Thread.java:851)
 at com.ibm.rational.common.token.licensing.RLSTokenService$RLSTokenLicenseControlCheckInHandler.run(RLSTokenService.java:510)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"http-bio-9443-exec-10" - Thread t@164
   java.lang.Thread.State: RUNNABLE
 at java.net.SocketInputStream.socketRead0(Native Method)
 at java.net.SocketInputStream.read(SocketInputStream.java:129)
 at com.ibm.jsse2.b.a(b.java:95)
 at com.ibm.jsse2.b.a(b.java:65)
 at com.ibm.jsse2.SSLSocketImpl.a(SSLSocketImpl.java:242)
 - locked <1d3f1d3f> (a java.lang.Object)
 at com.ibm.jsse2.SSLSocketImpl.a(SSLSocketImpl.java:773)
 at com.ibm.jsse2.f.read(f.java:26)
 - locked <1d671d67> (a com.ibm.jsse2.f)
 at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:516)
 at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:501)
 at org.apache.coyote.http11.Http11Processor.setRequestLineReadTimeout(Http11Processor.java:172)
 at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:912)
 at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:579)
 at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:309)
 - locked <1ba41ba4> (a org.apache.tomcat.util.net.SocketWrapper)
 at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - locked <394b394b> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

"http-bio-9443-exec-11" - Thread t@166
   java.lang.Thread.State: RUNNABLE
 at java.net.SocketInputStream.socketRead0(Native Method)
 at java.net.SocketInputStream.read(SocketInputStream.java:129)
 at com.ibm.jsse2.b.a(b.java:95)
 at com.ibm.jsse2.b.a(b.java:65)
 at com.ibm.jsse2.SSLSocketImpl.a(SSLSocketImpl.java:242)
 - locked <74f974f9> (a java.lang.Object)
 at com.ibm.jsse2.SSLSocketImpl.a(SSLSocketImpl.java:773)
 at com.ibm.jsse2.f.read(f.java:26)
 - locked <75217521> (a com.ibm.jsse2.f)
 at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:516)
 at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:501)
 at org.apache.coyote.http11.Http11Processor.setRequestLineReadTimeout(Http11Processor.java:172)
 at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:912)
 at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:579)
 at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:309)
 - locked <76507650> (a org.apache.tomcat.util.net.SocketWrapper)
 at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - locked <58a658a6> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

"http-bio-9443-exec-12" - Thread t@167
   java.lang.Thread.State: RUNNABLE
 at java.net.SocketInputStream.socketRead0(Native Method)
 at java.net.SocketInputStream.read(SocketInputStream.java:129)
 at com.ibm.jsse2.b.a(b.java:95)
 at com.ibm.jsse2.b.a(b.java:65)
 at com.ibm.jsse2.SSLSocketImpl.a(SSLSocketImpl.java:242)
 - locked <6d236d23> (a java.lang.Object)
 at com.ibm.jsse2.SSLSocketImpl.a(SSLSocketImpl.java:773)
 at com.ibm.jsse2.f.read(f.java:26)
 - locked <6d4b6d4b> (a com.ibm.jsse2.f)
 at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:516)
 at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:501)
 at org.apache.coyote.http11.Http11Processor.setRequestLineReadTimeout(Http11Processor.java:172)
 at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:912)
 at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:579)
 at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:309)
 - locked <648b648b> (a org.apache.tomcat.util.net.SocketWrapper)
 at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - locked <599e599e> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

"http-bio-9443-exec-13" - Thread t@168
   java.lang.Thread.State: RUNNABLE
 at java.net.SocketInputStream.socketRead0(Native Method)
 at java.net.SocketInputStream.read(SocketInputStream.java:129)
 at com.ibm.jsse2.b.a(b.java:95)
 at com.ibm.jsse2.b.a(b.java:65)
 at com.ibm.jsse2.SSLSocketImpl.a(SSLSocketImpl.java:242)
 - locked <1bea1bea> (a java.lang.Object)
 at com.ibm.jsse2.SSLSocketImpl.a(SSLSocketImpl.java:773)
 at com.ibm.jsse2.f.read(f.java:26)
 - locked <1c121c12> (a com.ibm.jsse2.f)
 at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:516)
 at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:501)
 at org.apache.coyote.http11.Http11Processor.setRequestLineReadTimeout(Http11Processor.java:172)
 at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:912)
 at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:579)
 at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:309)
 - locked <26f526f5> (a org.apache.tomcat.util.net.SocketWrapper)
 at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - locked <63696369> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

"qm: AsynchronousTaskRunner-0" - Thread t@171
   java.lang.Thread.State: WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <4dc04dc> (a java.util.LinkedList)
 at java.lang.Object.wait(Object.java:167)
 at com.ibm.team.repository.service.internal.scheduler.AsynchronousTaskManager.getNextTask(AsynchronousTaskManager.java:286)
 - locked <4dc04dc> (a java.util.LinkedList)
 at com.ibm.team.repository.service.internal.scheduler.AsynchronousTaskRunner.run(AsynchronousTaskRunner.java:96)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"qm: AsynchronousTaskRunner-1" - Thread t@172
   java.lang.Thread.State: WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <4dc04dc> (a java.util.LinkedList)
 at java.lang.Object.wait(Object.java:167)
 at com.ibm.team.repository.service.internal.scheduler.AsynchronousTaskManager.getNextTask(AsynchronousTaskManager.java:286)
 - locked <4dc04dc> (a java.util.LinkedList)
 at com.ibm.team.repository.service.internal.scheduler.AsynchronousTaskRunner.run(AsynchronousTaskRunner.java:96)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"qm: AsynchronousTaskRunner-2" - Thread t@173
   java.lang.Thread.State: WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <4dc04dc> (a java.util.LinkedList)
 at java.lang.Object.wait(Object.java:167)
 at com.ibm.team.repository.service.internal.scheduler.AsynchronousTaskManager.getNextTask(AsynchronousTaskManager.java:286)
 - locked <4dc04dc> (a java.util.LinkedList)
 at com.ibm.team.repository.service.internal.scheduler.AsynchronousTaskRunner.run(AsynchronousTaskRunner.java:96)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"qm: AsynchronousTaskRunner-3" - Thread t@174
   java.lang.Thread.State: WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <4dc04dc> (a java.util.LinkedList)
 at java.lang.Object.wait(Object.java:167)
 at com.ibm.team.repository.service.internal.scheduler.AsynchronousTaskManager.getNextTask(AsynchronousTaskManager.java:286)
 - locked <4dc04dc> (a java.util.LinkedList)
 at com.ibm.team.repository.service.internal.scheduler.AsynchronousTaskRunner.run(AsynchronousTaskRunner.java:96)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"qm: AsynchronousTaskRunner-4" - Thread t@175
   java.lang.Thread.State: WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <4dc04dc> (a java.util.LinkedList)
 at java.lang.Object.wait(Object.java:167)
 at com.ibm.team.repository.service.internal.scheduler.AsynchronousTaskManager.getNextTask(AsynchronousTaskManager.java:286)
 - locked <4dc04dc> (a java.util.LinkedList)
 at com.ibm.team.repository.service.internal.scheduler.AsynchronousTaskRunner.run(AsynchronousTaskRunner.java:96)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"qm: Asynchronous local task scheduler" - Thread t@176
   java.lang.Thread.State: TIMED_WAITING
 at sun.misc.Unsafe.park(Native Method)
 - parking to wait for <44a744a7> (a java.util.concurrent.CountDownLatch$Sync)
 at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:211)
 at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1011)
 at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1303)
 at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:253)
 at com.ibm.team.repository.service.internal.AsynchronousTaskSchedulerService.runQueueingLoopOnce(AsynchronousTaskSchedulerService.java:457)
 at com.ibm.team.repository.service.internal.AsynchronousTaskSchedulerService.runQueueingLoop(AsynchronousTaskSchedulerService.java:284)
 at com.ibm.team.repository.service.internal.AsynchronousTaskSchedulerService.access$2(AsynchronousTaskSchedulerService.java:279)
 at com.ibm.team.repository.service.internal.AsynchronousTaskSchedulerService$1.run(AsynchronousTaskSchedulerService.java:213)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"qm: Asynchronous global task scheduler" - Thread t@177
   java.lang.Thread.State: TIMED_WAITING
 at sun.misc.Unsafe.park(Native Method)
 - parking to wait for <1c281c28> (a java.util.concurrent.CountDownLatch$Sync)
 at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:211)
 at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1011)
 at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1303)
 at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:253)
 at com.ibm.team.repository.service.internal.AsynchronousTaskSchedulerService.runQueueingLoopOnce(AsynchronousTaskSchedulerService.java:457)
 at com.ibm.team.repository.service.internal.AsynchronousTaskSchedulerService.runQueueingLoop(AsynchronousTaskSchedulerService.java:284)
 at com.ibm.team.repository.service.internal.AsynchronousTaskSchedulerService.access$2(AsynchronousTaskSchedulerService.java:279)
 at com.ibm.team.repository.service.internal.AsynchronousTaskSchedulerService$2.run(AsynchronousTaskSchedulerService.java:220)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"http-bio-9443-exec-14" - Thread t@178
   java.lang.Thread.State: TIMED_WAITING
 at sun.misc.Unsafe.park(Native Method)
 - parking to wait for <70117011> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
 at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:211)
 at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
 at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:424)
 at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:86)
 at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:32)
 at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:945)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"http-bio-9443-exec-15" - Thread t@179
   java.lang.Thread.State: TIMED_WAITING
 at sun.misc.Unsafe.park(Native Method)
 - parking to wait for <70117011> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
 at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:211)
 at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
 at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:424)
 at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:86)
 at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:32)
 at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:945)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"http-bio-9443-exec-16" - Thread t@180
   java.lang.Thread.State: RUNNABLE
 at java.net.SocketInputStream.socketRead0(Native Method)
 at java.net.SocketInputStream.read(SocketInputStream.java:129)
 at com.ibm.jsse2.b.a(b.java:95)
 at com.ibm.jsse2.b.a(b.java:65)
 at com.ibm.jsse2.SSLSocketImpl.a(SSLSocketImpl.java:242)
 - locked <225d225d> (a java.lang.Object)
 at com.ibm.jsse2.SSLSocketImpl.a(SSLSocketImpl.java:773)
 at com.ibm.jsse2.f.read(f.java:26)
 - locked <22852285> (a com.ibm.jsse2.f)
 at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:516)
 at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:501)
 at org.apache.coyote.http11.Http11Processor.setRequestLineReadTimeout(Http11Processor.java:172)
 at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:912)
 at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:579)
 at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:309)
 - locked <1cf91cf9> (a org.apache.tomcat.util.net.SocketWrapper)
 at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - locked <2bb02bb0> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

"http-bio-9443-exec-17" - Thread t@181
   java.lang.Thread.State: RUNNABLE
 at java.net.SocketInputStream.socketRead0(Native Method)
 at java.net.SocketInputStream.read(SocketInputStream.java:129)
 at com.ibm.jsse2.b.a(b.java:95)
 at com.ibm.jsse2.b.a(b.java:65)
 at com.ibm.jsse2.SSLSocketImpl.a(SSLSocketImpl.java:242)
 - locked <76967696> (a java.lang.Object)
 at com.ibm.jsse2.SSLSocketImpl.a(SSLSocketImpl.java:773)
 at com.ibm.jsse2.f.read(f.java:26)
 - locked <76be76be> (a com.ibm.jsse2.f)
 at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:516)
 at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:501)
 at org.apache.coyote.http11.Http11Processor.setRequestLineReadTimeout(Http11Processor.java:172)
 at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:912)
 at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:579)
 at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:309)
 - locked <5c295c29> (a org.apache.tomcat.util.net.SocketWrapper)
 at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - locked <2ecd2ecd> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

"http-bio-9443-exec-18" - Thread t@182
   java.lang.Thread.State: RUNNABLE
 at java.net.SocketInputStream.socketRead0(Native Method)
 at java.net.SocketInputStream.read(SocketInputStream.java:129)
 at com.ibm.jsse2.b.a(b.java:95)
 at com.ibm.jsse2.b.a(b.java:65)
 at com.ibm.jsse2.SSLSocketImpl.a(SSLSocketImpl.java:242)
 - locked <543d543d> (a java.lang.Object)
 at com.ibm.jsse2.SSLSocketImpl.a(SSLSocketImpl.java:773)
 at com.ibm.jsse2.f.read(f.java:26)
 - locked <54655465> (a com.ibm.jsse2.f)
 at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:516)
 at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:501)
 at org.apache.coyote.http11.Http11Processor.setRequestLineReadTimeout(Http11Processor.java:172)
 at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:912)
 at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:579)
 at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:309)
 - locked <a550a55> (a org.apache.tomcat.util.net.SocketWrapper)
 at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - locked <49184918> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

"http-bio-9443-exec-19" - Thread t@183
   java.lang.Thread.State: TIMED_WAITING
 at sun.misc.Unsafe.park(Native Method)
 - parking to wait for <70117011> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
 at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:211)
 at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
 at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:424)
 at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:86)
 at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:32)
 at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:945)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"http-bio-9443-exec-20" - Thread t@185
   java.lang.Thread.State: RUNNABLE
 at java.net.SocketInputStream.socketRead0(Native Method)
 at java.net.SocketInputStream.read(SocketInputStream.java:129)
 at com.ibm.jsse2.b.a(b.java:95)
 at com.ibm.jsse2.b.a(b.java:65)
 at com.ibm.jsse2.SSLSocketImpl.a(SSLSocketImpl.java:242)
 - locked <15421542> (a java.lang.Object)
 at com.ibm.jsse2.SSLSocketImpl.a(SSLSocketImpl.java:773)
 at com.ibm.jsse2.f.read(f.java:26)
 - locked <156a156a> (a com.ibm.jsse2.f)
 at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:516)
 at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:501)
 at org.apache.coyote.http11.Http11Processor.setRequestLineReadTimeout(Http11Processor.java:172)
 at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:912)
 at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:579)
 at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:309)
 - locked <2bfc2bfc> (a org.apache.tomcat.util.net.SocketWrapper)
 at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - locked <53405340> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

 - locked <52715271> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

 - locked <24612461> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

 - locked <7dc77dc7> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

 - locked <30573057> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

"http-bio-9443-exec-21" - Thread t@186
   java.lang.Thread.State: RUNNABLE
 at java.net.SocketInputStream.socketRead0(Native Method)
 at java.net.SocketInputStream.read(SocketInputStream.java:129)
 at com.ibm.jsse2.b.a(b.java:95)
 at com.ibm.jsse2.b.a(b.java:65)
 at com.ibm.jsse2.SSLSocketImpl.a(SSLSocketImpl.java:242)
 - locked <5c6f5c6f> (a java.lang.Object)
 at com.ibm.jsse2.SSLSocketImpl.a(SSLSocketImpl.java:773)
 at com.ibm.jsse2.f.read(f.java:26)
 - locked <5c975c97> (a com.ibm.jsse2.f)
 at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:516)
 at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:501)
 at org.apache.coyote.http11.Http11Processor.setRequestLineReadTimeout(Http11Processor.java:172)
 at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:912)
 at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:579)
 at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:309)
 - locked <687a687a> (a org.apache.tomcat.util.net.SocketWrapper)
 at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - locked <2ef92ef9> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

"jts: OAuth nonce cleanup timer" - Thread t@187
   java.lang.Thread.State: TIMED_WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <288a288a> (a java.util.Timer$TimerImpl)
 at java.lang.Object.wait(Object.java:196)
 at java.util.Timer$TimerImpl.run(Timer.java:246)
 - locked <288a288a> (a java.util.Timer$TimerImpl)

   Locked ownable synchronizers:
 - None

"http-bio-9443-exec-22" - Thread t@188
   java.lang.Thread.State: TIMED_WAITING
 at sun.misc.Unsafe.park(Native Method)
 - parking to wait for <70117011> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
 at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:211)
 at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
 at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:424)
 at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:86)
 at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:32)
 at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:945)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"http-bio-9443-exec-23" - Thread t@189
   java.lang.Thread.State: TIMED_WAITING
 at sun.misc.Unsafe.park(Native Method)
 - parking to wait for <70117011> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
 at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:211)
 at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
 at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:424)
 at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:86)
 at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:32)
 at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:945)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"jena.query.monitor" - Thread t@190
   java.lang.Thread.State: TIMED_WAITING
 at java.lang.Thread.sleep(Native Method)
 at java.lang.Thread.sleep(Thread.java:851)
 at com.ibm.team.jfs.rdf.internal.jena.provider.JenaQueryMonitor.run(JenaQueryMonitor.java:279)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"http-bio-9443-exec-24" - Thread t@192
   java.lang.Thread.State: TIMED_WAITING
 at sun.misc.Unsafe.park(Native Method)
 - parking to wait for <70117011> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
 at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:211)
 at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
 at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:424)
 at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:86)
 at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:32)
 at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:945)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"http-bio-9443-exec-25" - Thread t@193
   java.lang.Thread.State: RUNNABLE
 at java.net.SocketInputStream.socketRead0(Native Method)
 at java.net.SocketInputStream.read(SocketInputStream.java:129)
 at com.ibm.jsse2.b.a(b.java:95)
 at com.ibm.jsse2.b.a(b.java:65)
 at com.ibm.jsse2.SSLSocketImpl.a(SSLSocketImpl.java:242)
 - locked <45a745a7> (a java.lang.Object)
 at com.ibm.jsse2.SSLSocketImpl.a(SSLSocketImpl.java:773)
 at com.ibm.jsse2.f.read(f.java:26)
 - locked <45cf45cf> (a com.ibm.jsse2.f)
 at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:516)
 at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:501)
 at org.apache.coyote.http11.Http11Processor.setRequestLineReadTimeout(Http11Processor.java:172)
 at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:912)
 at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:579)
 at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:309)
 - locked <227e227e> (a org.apache.tomcat.util.net.SocketWrapper)
 at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - locked <6cb16cb1> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

"Worker-0" - Thread t@195
   java.lang.Thread.State: TIMED_WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <2f842f84> (a org.eclipse.core.internal.jobs.WorkerPool)
 at java.lang.Object.wait(Object.java:196)
 at org.eclipse.core.internal.jobs.WorkerPool.sleep(WorkerPool.java:185)
 - locked <2f842f84> (a org.eclipse.core.internal.jobs.WorkerPool)
 at org.eclipse.core.internal.jobs.WorkerPool.startJob(WorkerPool.java:217)
 at org.eclipse.core.internal.jobs.Worker.run(Worker.java:50)

   Locked ownable synchronizers:
 - None

"Thread-34" - Thread t@197
   java.lang.Thread.State: WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <11a711a7> (a java.util.Timer$TimerImpl)
 at java.lang.Object.wait(Object.java:167)
 at java.util.Timer$TimerImpl.run(Timer.java:226)
 - locked <11a711a7> (a java.util.Timer$TimerImpl)

   Locked ownable synchronizers:
 - None

"derby.rawStoreDaemon" - Thread t@198
   java.lang.Thread.State: TIMED_WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <43594359> (a org.apache.derby.impl.services.daemon.BasicDaemon)
 at java.lang.Object.wait(Object.java:196)
 at org.apache.derby.impl.services.daemon.BasicDaemon.rest(Unknown Source)
 - locked <43594359> (a org.apache.derby.impl.services.daemon.BasicDaemon)
 at org.apache.derby.impl.services.daemon.BasicDaemon.run(Unknown Source)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"ccm: AsynchronousTaskRunner-0" - Thread t@200
   java.lang.Thread.State: WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <16631663> (a java.util.LinkedList)
 at java.lang.Object.wait(Object.java:167)
 at com.ibm.team.repository.service.internal.scheduler.AsynchronousTaskManager.getNextTask(AsynchronousTaskManager.java:286)
 - locked <16631663> (a java.util.LinkedList)
 at com.ibm.team.repository.service.internal.scheduler.AsynchronousTaskRunner.run(AsynchronousTaskRunner.java:96)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"ccm: AsynchronousTaskRunner-1" - Thread t@201
   java.lang.Thread.State: WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <16631663> (a java.util.LinkedList)
 at java.lang.Object.wait(Object.java:167)
 at com.ibm.team.repository.service.internal.scheduler.AsynchronousTaskManager.getNextTask(AsynchronousTaskManager.java:286)
 - locked <16631663> (a java.util.LinkedList)
 at com.ibm.team.repository.service.internal.scheduler.AsynchronousTaskRunner.run(AsynchronousTaskRunner.java:96)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"ccm: AsynchronousTaskRunner-2" - Thread t@202
   java.lang.Thread.State: WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <16631663> (a java.util.LinkedList)
 at java.lang.Object.wait(Object.java:167)
 at com.ibm.team.repository.service.internal.scheduler.AsynchronousTaskManager.getNextTask(AsynchronousTaskManager.java:286)
 - locked <16631663> (a java.util.LinkedList)
 at com.ibm.team.repository.service.internal.scheduler.AsynchronousTaskRunner.run(AsynchronousTaskRunner.java:96)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"ccm: AsynchronousTaskRunner-3" - Thread t@203
   java.lang.Thread.State: WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <16631663> (a java.util.LinkedList)
 at java.lang.Object.wait(Object.java:167)
 at com.ibm.team.repository.service.internal.scheduler.AsynchronousTaskManager.getNextTask(AsynchronousTaskManager.java:286)
 - locked <16631663> (a java.util.LinkedList)
 at com.ibm.team.repository.service.internal.scheduler.AsynchronousTaskRunner.run(AsynchronousTaskRunner.java:96)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"ccm: AsynchronousTaskRunner-4" - Thread t@204
   java.lang.Thread.State: WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <16631663> (a java.util.LinkedList)
 at java.lang.Object.wait(Object.java:167)
 at com.ibm.team.repository.service.internal.scheduler.AsynchronousTaskManager.getNextTask(AsynchronousTaskManager.java:286)
 - locked <16631663> (a java.util.LinkedList)
 at com.ibm.team.repository.service.internal.scheduler.AsynchronousTaskRunner.run(AsynchronousTaskRunner.java:96)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"ccm: Asynchronous local task scheduler" - Thread t@205
   java.lang.Thread.State: TIMED_WAITING
 at sun.misc.Unsafe.park(Native Method)
 - parking to wait for <63a863a8> (a java.util.concurrent.CountDownLatch$Sync)
 at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:211)
 at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1011)
 at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1303)
 at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:253)
 at com.ibm.team.repository.service.internal.AsynchronousTaskSchedulerService.runQueueingLoopOnce(AsynchronousTaskSchedulerService.java:457)
 at com.ibm.team.repository.service.internal.AsynchronousTaskSchedulerService.runQueueingLoop(AsynchronousTaskSchedulerService.java:284)
 at com.ibm.team.repository.service.internal.AsynchronousTaskSchedulerService.access$2(AsynchronousTaskSchedulerService.java:279)
 at com.ibm.team.repository.service.internal.AsynchronousTaskSchedulerService$1.run(AsynchronousTaskSchedulerService.java:213)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"ccm: Asynchronous global task scheduler" - Thread t@206
   java.lang.Thread.State: TIMED_WAITING
 at sun.misc.Unsafe.park(Native Method)
 - parking to wait for <55c555c5> (a java.util.concurrent.CountDownLatch$Sync)
 at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:211)
 at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1011)
 at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1303)
 at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:253)
 at com.ibm.team.repository.service.internal.AsynchronousTaskSchedulerService.runQueueingLoopOnce(AsynchronousTaskSchedulerService.java:457)
 at com.ibm.team.repository.service.internal.AsynchronousTaskSchedulerService.runQueueingLoop(AsynchronousTaskSchedulerService.java:284)
 at com.ibm.team.repository.service.internal.AsynchronousTaskSchedulerService.access$2(AsynchronousTaskSchedulerService.java:279)
 at com.ibm.team.repository.service.internal.AsynchronousTaskSchedulerService$2.run(AsynchronousTaskSchedulerService.java:220)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"Java2D Disposer" - Thread t@207
   java.lang.Thread.State: WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <18f218f2> (a java.lang.ref.ReferenceQueue)
 at java.lang.Object.wait(Object.java:196)
 at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:107)
 - locked <18f218f2> (a java.lang.ref.ReferenceQueue)
 at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:79)
 at sun.java2d.Disposer.run(Disposer.java:131)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"AD Thread Pool-CSS0" - Thread t@208
   java.lang.Thread.State: WAITING
 at sun.misc.Unsafe.park(Native Method)
 - parking to wait for <79817981> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
 at java.util.concurrent.locks.LockSupport.park(LockSupport.java:171)
 at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
 at java.util.concurrent.DelayQueue.take(DelayQueue.java:160)
 at com.singularity.ee.util.pd.c(pd.java:523)
 at com.singularity.ee.util.pd.take(pd.java:515)
 at com.singularity.ee.util.rd.a(rd.java:487)
 at com.singularity.ee.util.pb.run(pb.java:691)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"AD Thread Pool-CGG0" - Thread t@209
   java.lang.Thread.State: WAITING
 at sun.misc.Unsafe.park(Native Method)
 - parking to wait for <79c579c5> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
 at java.util.concurrent.locks.LockSupport.park(LockSupport.java:171)
 at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
 at java.util.concurrent.DelayQueue.take(DelayQueue.java:160)
 at com.singularity.ee.util.pd.c(pd.java:523)
 at com.singularity.ee.util.pd.take(pd.java:515)
 at com.singularity.ee.util.rd.a(rd.java:487)
 at com.singularity.ee.util.pb.run(pb.java:691)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"jena.query.monitor" - Thread t@211
   java.lang.Thread.State: TIMED_WAITING
 at java.lang.Thread.sleep(Native Method)
 at java.lang.Thread.sleep(Thread.java:851)
 at com.ibm.team.jfs.rdf.internal.jena.provider.JenaQueryMonitor.run(JenaQueryMonitor.java:279)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"AD Thread Pool-CSS1" - Thread t@212
   java.lang.Thread.State: WAITING
 at sun.misc.Unsafe.park(Native Method)
 - parking to wait for <79817981> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
 at java.util.concurrent.locks.LockSupport.park(LockSupport.java:171)
 at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
 at java.util.concurrent.DelayQueue.take(DelayQueue.java:160)
 at com.singularity.ee.util.pd.c(pd.java:523)
 at com.singularity.ee.util.pd.take(pd.java:515)
 at com.singularity.ee.util.rd.a(rd.java:487)
 at com.singularity.ee.util.pb.run(pb.java:691)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"RMI TCP Connection(1)-127.0.0.1" - Thread t@213
   java.lang.Thread.State: RUNNABLE
 at java.net.SocketInputStream.socketRead0(Native Method)
 at java.net.SocketInputStream.read(SocketInputStream.java:129)
 at java.io.BufferedInputStream.fill(BufferedInputStream.java:218)
 at java.io.BufferedInputStream.read(BufferedInputStream.java:237)
 - locked <9930993> (a java.io.BufferedInputStream)
 at java.io.FilterInputStream.read(FilterInputStream.java:66)
 at sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:517)
 at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:790)
 at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:649)
 at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - locked <39873987> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

"RMI TCP Connection(2)-127.0.0.1" - Thread t@214
   java.lang.Thread.State: RUNNABLE
 at com.ibm.lang.management.ThreadMXBeanImpl.dumpAllThreadsImpl(Native Method)
 at com.ibm.lang.management.ThreadMXBeanImpl.dumpAllThreads(ThreadMXBeanImpl.java:680)
 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:48)
 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
 at java.lang.reflect.Method.invoke(Method.java:600)
 at com.ibm.lang.management.DynamicMXBeanImpl.invokeMethod(DynamicMXBeanImpl.java:421)
 at com.ibm.lang.management.DynamicMXBeanImpl.invoke(DynamicMXBeanImpl.java:345)
 at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.invoke(DefaultMBeanServerInterceptor.java:836)
 at com.sun.jmx.mbeanserver.JmxMBeanServer.invoke(JmxMBeanServer.java:761)
 at javax.management.remote.rmi.RMIConnectionImpl.doOperation(RMIConnectionImpl.java:1427)
 at javax.management.remote.rmi.RMIConnectionImpl.access$200(RMIConnectionImpl.java:72)
 at javax.management.remote.rmi.RMIConnectionImpl$PrivilegedOperation.run(RMIConnectionImpl.java:1265)
 at javax.management.remote.rmi.RMIConnectionImpl.doPrivilegedOperation(RMIConnectionImpl.java:1360)
 at javax.management.remote.rmi.RMIConnectionImpl.invoke(RMIConnectionImpl.java:788)
 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:48)
 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
 at java.lang.reflect.Method.invoke(Method.java:600)
 at sun.rmi.server.UnicastServerRef.dispatch(UnicastServerRef.java:310)
 at sun.rmi.transport.Transport$1.run(Transport.java:159)
 at java.security.AccessController.doPrivileged(AccessController.java:284)
 at sun.rmi.transport.Transport.serviceCall(Transport.java:155)
 at sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:535)
 at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:790)
 at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:649)
 at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - locked <58105810> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

"JMX server connection timeout 215" - Thread t@215
   java.lang.Thread.State: TIMED_WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <5d1a5d1a> (a [I)
 at java.lang.Object.wait(Object.java:196)
 at com.sun.jmx.remote.internal.ServerCommunicatorAdmin$Timeout.run(ServerCommunicatorAdmin.java:150)
 - locked <5d1a5d1a> (a [I)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"HTTP Cache Scrubber" - Thread t@218
   java.lang.Thread.State: TIMED_WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <76b876b8> (a java.util.Timer$TimerImpl)
 at java.lang.Object.wait(Object.java:196)
 at java.util.Timer$TimerImpl.run(Timer.java:246)
 - locked <76b876b8> (a java.util.Timer$TimerImpl)

   Locked ownable synchronizers:
 - None

"Worker-0" - Thread t@219
   java.lang.Thread.State: TIMED_WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <2c872c87> (a org.eclipse.core.internal.jobs.WorkerPool)
 at java.lang.Object.wait(Object.java:196)
 at org.eclipse.core.internal.jobs.WorkerPool.sleep(WorkerPool.java:185)
 - locked <2c872c87> (a org.eclipse.core.internal.jobs.WorkerPool)
 at org.eclipse.core.internal.jobs.WorkerPool.startJob(WorkerPool.java:217)
 at org.eclipse.core.internal.jobs.Worker.run(Worker.java:50)

   Locked ownable synchronizers:
 - None

"Shared FriendsConfig Update Listener" - Thread t@220
   java.lang.Thread.State: WAITING
 at sun.misc.Unsafe.park(Native Method)
 - parking to wait for <fa30fa3> (a java.util.concurrent.CountDownLatch$Sync)
 at java.util.concurrent.locks.LockSupport.park(LockSupport.java:171)
 at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:811)
 at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:969)
 at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1281)
 at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:207)
 at com.ibm.team.jfs.app.distributed.InMemorySignal.waitFor(InMemorySignal.java:41)
 at com.ibm.team.jfs.app.friendsconfig.internal.InMemoryFriendsConfigStorage$1.run(InMemoryFriendsConfigStorage.java:247)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"jts.jfs.indexer.internal.triple.history" - Thread t@221
   java.lang.Thread.State: TIMED_WAITING
 at java.lang.Thread.sleep(Native Method)
 at java.lang.Thread.sleep(Thread.java:851)
 at com.ibm.team.jfs.indexing.service.internal.task.AbstractIndexAgent.sleep(AbstractIndexAgent.java:258)
 at com.ibm.team.jfs.indexing.service.internal.task.AbstractIndexAgent.run(AbstractIndexAgent.java:1177)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"jts.jfs.indexer.internal.triple" - Thread t@222
   java.lang.Thread.State: TIMED_WAITING
 at java.lang.Thread.sleep(Native Method)
 at java.lang.Thread.sleep(Thread.java:851)
 at com.ibm.team.jfs.indexing.service.internal.task.AbstractIndexAgent.sleep(AbstractIndexAgent.java:258)
 at com.ibm.team.jfs.indexing.service.internal.task.AbstractIndexAgent.run(AbstractIndexAgent.java:1177)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"jts.jfs.indexer.internal.text.history" - Thread t@223
   java.lang.Thread.State: TIMED_WAITING
 at java.lang.Thread.sleep(Native Method)
 at java.lang.Thread.sleep(Thread.java:851)
 at com.ibm.team.jfs.indexing.service.internal.task.AbstractIndexAgent.sleep(AbstractIndexAgent.java:258)
 at com.ibm.team.jfs.indexing.service.internal.task.AbstractIndexAgent.run(AbstractIndexAgent.java:1177)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"jts.jfs.indexer.internal.text" - Thread t@224
   java.lang.Thread.State: TIMED_WAITING
 at java.lang.Thread.sleep(Native Method)
 at java.lang.Thread.sleep(Thread.java:851)
 at com.ibm.team.jfs.indexing.service.internal.task.AbstractIndexAgent.sleep(AbstractIndexAgent.java:258)
 at com.ibm.team.jfs.indexing.service.internal.task.AbstractIndexAgent.run(AbstractIndexAgent.java:1177)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"LPA Change Event Monitor" - Thread t@225
   java.lang.Thread.State: TIMED_WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <5a335a33> (a java.util.Timer$TimerImpl)
 at java.lang.Object.wait(Object.java:196)
 at java.util.Timer$TimerImpl.run(Timer.java:246)
 - locked <5a335a33> (a java.util.Timer$TimerImpl)

   Locked ownable synchronizers:
 - None

"ccm: OAuth nonce cleanup timer" - Thread t@226
   java.lang.Thread.State: TIMED_WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <3270327> (a java.util.Timer$TimerImpl)
 at java.lang.Object.wait(Object.java:196)
 at java.util.Timer$TimerImpl.run(Timer.java:246)
 - locked <3270327> (a java.util.Timer$TimerImpl)

   Locked ownable synchronizers:
 - None

"pool-53-thread-2" - Thread t@228
   java.lang.Thread.State: TIMED_WAITING
 at sun.misc.Unsafe.park(Native Method)
 - parking to wait for <5dca5dca> (a java.util.concurrent.SynchronousQueue$TransferStack)
 at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:211)
 at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:424)
 at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:323)
 at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:874)
 at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:945)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"pool-53-thread-1" - Thread t@227
   java.lang.Thread.State: TIMED_WAITING
 at sun.misc.Unsafe.park(Native Method)
 - parking to wait for <5dca5dca> (a java.util.concurrent.SynchronousQueue$TransferStack)
 at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:211)
 at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:424)
 at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:323)
 at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:874)
 at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:945)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"ccm.jfs.indexer.internal.triple.history" - Thread t@229
   java.lang.Thread.State: TIMED_WAITING
 at java.lang.Thread.sleep(Native Method)
 at java.lang.Thread.sleep(Thread.java:851)
 at com.ibm.team.jfs.indexing.service.internal.task.AbstractIndexAgent.sleep(AbstractIndexAgent.java:258)
 at com.ibm.team.jfs.indexing.service.internal.task.AbstractIndexAgent.run(AbstractIndexAgent.java:1177)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"ccm.jfs.indexer.internal.triple" - Thread t@230
   java.lang.Thread.State: TIMED_WAITING
 at java.lang.Thread.sleep(Native Method)
 at java.lang.Thread.sleep(Thread.java:851)
 at com.ibm.team.jfs.indexing.service.internal.task.AbstractIndexAgent.sleep(AbstractIndexAgent.java:258)
 at com.ibm.team.jfs.indexing.service.internal.task.AbstractIndexAgent.run(AbstractIndexAgent.java:1177)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"ccm.jfs.indexer.internal.text.history" - Thread t@231
   java.lang.Thread.State: TIMED_WAITING
 at java.lang.Thread.sleep(Native Method)
 at java.lang.Thread.sleep(Thread.java:851)
 at com.ibm.team.jfs.indexing.service.internal.task.AbstractIndexAgent.sleep(AbstractIndexAgent.java:258)
 at com.ibm.team.jfs.indexing.service.internal.task.AbstractIndexAgent.run(AbstractIndexAgent.java:1177)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"ccm.jfs.indexer.internal.text" - Thread t@232
   java.lang.Thread.State: TIMED_WAITING
 at java.lang.Thread.sleep(Native Method)
 at java.lang.Thread.sleep(Thread.java:851)
 at com.ibm.team.jfs.indexing.service.internal.task.AbstractIndexAgent.sleep(AbstractIndexAgent.java:258)
 at com.ibm.team.jfs.indexing.service.internal.task.AbstractIndexAgent.run(AbstractIndexAgent.java:1177)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"http-bio-9443-exec-27" - Thread t@234
   java.lang.Thread.State: TIMED_WAITING
 at sun.misc.Unsafe.park(Native Method)
 - parking to wait for <70117011> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
 at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:211)
 at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
 at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:424)
 at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:86)
 at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:32)
 at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:945)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - None

"http-bio-9443-exec-26" - Thread t@233
   java.lang.Thread.State: RUNNABLE
 at java.net.SocketInputStream.socketRead0(Native Method)
 at java.net.SocketInputStream.read(SocketInputStream.java:129)
 at com.ibm.jsse2.b.a(b.java:95)
 at com.ibm.jsse2.b.a(b.java:65)
 at com.ibm.jsse2.SSLSocketImpl.a(SSLSocketImpl.java:242)
 - locked <a9b0a9b> (a java.lang.Object)
 at com.ibm.jsse2.SSLSocketImpl.a(SSLSocketImpl.java:773)
 at com.ibm.jsse2.f.read(f.java:26)
 - locked <26b026b> (a com.ibm.jsse2.f)
 at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:516)
 at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:501)
 at org.apache.coyote.http11.Http11Processor.setRequestLineReadTimeout(Http11Processor.java:172)
 at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:912)
 at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:579)
 at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:309)
 - locked <14fc14fc> (a org.apache.tomcat.util.net.SocketWrapper)
 at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
 at java.lang.Thread.run(Thread.java:736)

   Locked ownable synchronizers:
 - locked <54d154d1> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

 - locked <150a150a> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

 - locked <297c297c> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

"HTTP Cache Scrubber" - Thread t@235
   java.lang.Thread.State: TIMED_WAITING
 at java.lang.Object.wait(Native Method)
 - waiting on <3f1b3f1b> (a java.util.Timer$TimerImpl)
 at java.lang.Object.wait(Object.java:196)
 at java.util.Timer$TimerImpl.run(Timer.java:246)
 - locked <3f1b3f1b> (a java.util.Timer$TimerImpl)

   Locked ownable synchronizers:
 - None


permanent link
Davyd Norris (2022914) | answered Sep 14 '12, 11:44 p.m.
I am having exactly the same problem with similar set up, but for me it's intermittent - sometimes it seems to run quite quickly and sometimes it's a total slug.

Couple of things:
 - make sure you are starting the CLM server as Administrator. Win 2008 and Win7 both use virtual directories for Program Files and so you MUST be an Administrator, otherwise they aren't writable. I initially forgot to run as Admin and it always runs terribly because the caches are not writable and they time out.

 - the only thing in my case that seems to be a trend is that the times CLM runs alright I am connected to an actual network (wired or wireless) on my real machine. It seems that when my real network is disconnected it's more likely to run terribly with EXACTLY the same symptoms as you. My VM is using NAT, I have hard coded entries for the server in my hosts file, both in and out of the VM, and it doesn't matter whether I use a browser in or out of the VM it's still slow.

Comments
Christopher L commented Sep 17 '12, 7:48 p.m.

The issue seems to be approaching this general area. If I -disconnect- the network adapter and rely solely on the hosts file, the speed improves to what I imagine is normal. I tried reverting to release 4.01 (not M2) and it exhibits the same problem. For me, ANY network adapter connection causes the speed problem. Static, DHCP, NAT, Bridged, Private...the network and adapter state don't seem to matter. So far it seems that there mere presence of a network adapter, in any state, causes the speed problem. It will be a few weeks before I get back to working on this one.


sam detweiler commented Sep 17 '12, 8:31 p.m.

check your dns server (nslookup...)


Davyd Norris commented Sep 17 '12, 8:45 p.m.

I think this is an important point in diagnosing what's going on. To recount my situation:

I have installed CLM 4.0 in a VMware image, which I use for product demos. It seems that when my laptop is connected to my home wireless network, or when I am in the office and again connected to an actual network, my CLM server usually runs well. Set up works fine and I can start and restart the server, set up my demo data, run it from browsers or clients both in and out of the VM image etc.

But at two clients now, it very embarrassingly refuses to cooperate and runs like an absolute slug. The initial login page seems to come up at the same speed, but even trying to bring up the default dashboard page for any of the applications, or even the JTS admin page just seems to hang. The only thing I can see that is different is that my real network is not connected to anything at the client's site.

I have entries for the CLM server in my hosts file on both my real machine and in my VM image, and have NAT set up on the image - this means that the CLM server knows about itself explicitly, and thinks it has a network but the VM's DNS will fail any lookup expect for what's in the hosts file.


permanent link
sam detweiler (12.5k6184201) | answered Sep 15 '12, 7:14 a.m.
it seems there is a lot of off local network contacts, the server rename function forces some constant checking, but hosts file isn't enough

Your answer


Register or to post your answer.