Details
-
Type:
Bug
-
Status: Resolved (View Workflow)
-
Priority:
Blocker
-
Resolution: Fixed
-
Affects Version/s: 16.0.1
-
Component/s: Database
-
Security Level: Default (Default Security Scheme)
-
Labels:None
-
Environment:RHEL7
-
Sprint:Newts - Phase 6, Newts - Sprint 7
Description
After running for about 2 weeks opennms consums almost all of the cpu
[root@opennms etc]# top
top - 07:24:43 up 50 days, 17:48, 6 users, load average: 6,88, 7,43, 7,18
Tasks: 392 total, 1 running, 391 sleeping, 0 stopped, 0 zombie
%Cpu(s): 97,1 us, 0,3 sy, 0,0 ni, 2,6 id, 0,0 wa, 0,0 hi, 0,0 si, 0,0 st
KiB Mem : 32741312 total, 235860 free, 8058396 used, 24447056 buff/cache
KiB Swap: 2097148 total, 2084096 free, 13052 used. 22985476 avail Mem
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
11901 root 20 0 12,396g 6,834g 33064 S 776,2 21,9 11144:45 java
417 root 20 0 130300 2096 1300 R 0,3 0,0 0:00.16 top
49706 root 20 0 215580 2624 1068 S 0,3 0,0 0:53.58 gammu-smsd
1 root 20 0 202680 4380 2324 S 0,0 0,0 2:12.20 systemd
2 root 20 0 0 0 0 S 0,0 0,0 0:01.19 kthreadd
3 root 20 0 0 0 0 S 0,0 0,0 10:49.44 ksoftirqd/0
5 root 0 -20 0 0 0 S 0,0 0,0 0:00.00 kworker/0:0H
7 root rt 0 0 0 0 S 0,0 0,0 0:01.51 migration/0
8 root 20 0 0 0 0 S 0,0 0,0 0:14.45 rcu_bh
9 root 20 0 0 0 0 S 0,0 0,0 0:00.01 rcuob/0
10 root 20 0 0 0 0 S 0,0 0,0 0:00.00 rcuob/1
11 root 20 0 0 0 0 S 0,0 0,0 0:00.00 rcuob/2
12 root 20 0 0 0 0 S 0,0 0,0 0:00.00 rcuob/3
13 root 20 0 0 0 0 S 0,0 0,0 0:00.00 rcuob/4
14 root 20 0 0 0 0 S 0,0 0,0 0:00.27 rcuob/5
15 root 20 0 0 0 0 S 0,0 0,0 0:00.00 rcuob/6
16 root 20 0 0 0 0 S 0,0 0,0 0:16.01 rcuob/7
17 root 20 0 0 0 0 S 0,0 0,0 0:00.00 rcuob/8
18 root 20 0 0 0 0 S 0,0 0,0 0:00.00 rcuob/9
19 root 20 0 0 0 0 S 0,0 0,0 0:00.00 rcuob/10
and sends false mails with services and interfaces down. Only restart of opennms helps. Looking to the logs the ones that don't look correct for me are
2015-06-10 17:13:58,612 INFO [Main] o.s.b.f.x.XmlBeanDefinitionReader: Loading XML bean definitions from class path resource [META-INF/opennms/applicationContext-eventDaemon.xml] 2015-06-11 07:03:35,632 WARN [Timer-0] c.m.v.a.ThreadPoolAsynchronousRunner: com.mchange.v2.async.ThreadPoolAsynchronousRunner$DeadlockDetector@59804d53 -- APPARENT DEADLOCK!!! Creating emergency threads for unassigned pending tasks! 2015-06-11 07:03:35,640 WARN [Timer-0] c.m.v.a.ThreadPoolAsynchronousRunner: com.mchange.v2.async.ThreadPoolAsynchronousRunner$DeadlockDetector@59804d53 -- APPARENT DEADLOCK!!! Complete Status: Managed Threads: 3 Active Threads: 0 Active Tasks: Pending Tasks: com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@27a621eb com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@35fd5202 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@76554d67 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@67f4e45b com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@714b2837 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@2ef9195e com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@721b5793 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@328da3b7 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@1a2f2f41 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@7cfaf6b3 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@54758170 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@b3a1052 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@680c6353 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@43684f8f com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@3b6e3893 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@600d072c com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@6b10f685 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@6a05c85f com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@20e5df2c com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@2859987b com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@4491e72b com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@1298d6 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@e802b47 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@6afef0ac com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@219dfa67 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@355d02aa com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@3a88cd55 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@27ee2138 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@696ea960 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@34fbaeb5 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@48652f1a com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@1ed420cf com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@26dafdc com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@6b0a3722 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@a76d8a6 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@351b537f com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@5ae7194f com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@606e8616 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@5c61d155 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@338ee10d com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@51c1bb52 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@458bc94a com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@17b243d7 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@53f04ea5 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@f3764a2 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@146d3d97 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@11447836 Pool thread stack traces: Thread[com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#2,5,main] java.lang.Object.wait(Native Method) com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:534) Thread[com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#1,5,main] java.lang.Object.wait(Native Method) com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:534) Thread[com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#0,5,main] java.lang.Object.wait(Native Method) com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:534) 2015-06-11 07:06:17,299 WARN [Timer-0] c.m.v.a.ThreadPoolAsynchronousRunner: com.mchange.v2.async.ThreadPoolAsynchronousRunner$DeadlockDetector@59804d53 -- APPARENT DEADLOCK!!! Creating emergency threads for unassigned pending tasks! 2015-06-11 07:06:17,306 WARN [Timer-0] c.m.v.a.ThreadPoolAsynchronousRunner: com.mchange.v2.async.ThreadPoolAsynchronousRunner$DeadlockDetector@59804d53 -- APPARENT DEADLOCK!!! Complete Status: Managed Threads: 3 Active Threads: 3 Active Tasks: com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@771be579 (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#0) com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@1a6654e6 (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#2) com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@6c5c7817 (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#1) Pending Tasks: com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@404eba42 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@6856bf1f com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@40bf0797 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@4fac4357 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@7a857c4a com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@27768a42 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@1fcda284 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@3256fcd1 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@63e0a1fd com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@70d71359 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@2fc4645 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@74992bf com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@61c024e2 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@2945ae58 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@49eb0b5b com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@2fcb4b3 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@62fb773a com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@66c82253 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@77684c02 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@10563770 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@29add0e7 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@e50a53b com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@3b6de0af com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@1a21ad05 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@5dcc6c4e com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@56be73b1 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@2029951 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@155c5591 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@2b4ce568 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@e4a284b com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@1894e0c2 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@6f93de9c com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@233811a3 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@7cef7dff com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@43421050 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@32d4419a com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@5102eb6a com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@56057430 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@5963e30 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@155e6789 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@53c197f3 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@2e98cd4f com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@1acb0112 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@7ccf5fed Pool thread stack traces: Thread[com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#2,5,main] com.mchange.v2.c3p0.impl.NewPooledConnection.getConnection(NewPooledConnection.java:194) com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool$1PooledConnectionResourcePoolManager.refurbishResourceOnCheckin(C3P0PooledConnectionPool.java:284) com.mchange.v2.resourcepool.BasicResourcePool.attemptRefurbishResourceOnCheckin(BasicResourcePool.java:1606) com.mchange.v2.resourcepool.BasicResourcePool.access$200(BasicResourcePool.java:32) com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask.run(BasicResourcePool.java:1228) com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:547) Thread[com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#0,5,main] com.mchange.v2.c3p0.impl.NewPooledConnection.getConnection(NewPooledConnection.java:194) com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool$1PooledConnectionResourcePoolManager.refurbishResourceOnCheckin(C3P0PooledConnectionPool.java:284) com.mchange.v2.resourcepool.BasicResourcePool.attemptRefurbishResourceOnCheckin(BasicResourcePool.java:1606) com.mchange.v2.resourcepool.BasicResourcePool.access$200(BasicResourcePool.java:32) com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask.run(BasicResourcePool.java:1228) com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:547) Thread[com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#1,5,main] com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:560) 2015-06-11 07:10:27,802 WARN [Timer-0] c.m.v.a.ThreadPoolAsynchronousRunner: com.mchange.v2.async.ThreadPoolAsynchronousRunner$DeadlockDetector@59804d53 -- APPARENT DEADLOCK!!! Creating emergency threads for unassigned pending tasks! 2015-06-11 07:10:38,806 WARN [Timer-0] c.m.v.a.ThreadPoolAsynchronousRunner: com.mchange.v2.async.ThreadPoolAsynchronousRunner$DeadlockDetector@59804d53 -- APPARENT DEADLOCK!!! Complete Status: Managed Threads: 3 Active Threads: 3 Active Tasks: com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@5d732d17 (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#1) com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@357f58ac (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#0) com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@15e55dd8 (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#2) com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@3c86bed com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@4717e516 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@8627f60 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@37d6e829 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@77016a3d com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@f461e9e com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@14c4e969 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@1453cc78 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@68ff0c4d com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@57f25d22 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@64ce6914 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@6ef459f9 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@7ef9ad0e com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@3ba7e4be com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@2c36bc17 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@60c103f9 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@53634332 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@5765dff4 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@4eaa170b com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@261c1bec com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@6f2fa6ce com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@164c5ea0 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@8c0012d com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@4e45a8a2 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@5cce7e72 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@28039215 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@20423751 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@43a19b43 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@6cb340ab com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@5814e412 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@695da8fe com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@26694d15 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@5029f76b com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@2fe2bd08 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@2bfcea52 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@47111bdd com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@589c2efb com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@622cd21d com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@2ece1a70 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@61ce3387 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@589c22b3 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@5ca4bf87 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@26733f9 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@12257a39 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@2b955b74 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@52b49106 Pool thread stack traces: Thread[com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#0,5,main] com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:560) Thread[com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#2,5,main] com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:560) Thread[com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#1,5,main] com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:560) 2015-06-11 07:12:30,368 WARN [Timer-0] c.m.v.a.ThreadPoolAsynchronousRunner: com.mchange.v2.async.ThreadPoolAsynchronousRunner$DeadlockDetector@59804d53 -- APPARENT DEADLOCK!!! Creating emergency threads for unassigned pending tasks! 2015-06-11 07:12:35,749 WARN [Timer-0] c.m.v.a.ThreadPoolAsynchronousRunner: com.mchange.v2.async.ThreadPoolAsynchronousRunner$DeadlockDetector@59804d53 -- APPARENT DEADLOCK!!! Complete Status: Managed Threads: 3 Active Threads: 0 Active Tasks: Pending Tasks: com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@72df525b com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@747c021c com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@e900e78 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@56283497 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@5eedf983 com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@4a156ca0 Pool thread stack traces: Thread[com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#0,5,main] java.lang.Object.wait(Native Method) com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:534) Thread[com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#2,5,main] java.lang.Object.wait(Native Method) com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:534) Thread[com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#1,5,main] java.lang.Object.wait(Native Method) com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:534) ....
