Uploaded image for project: 'OpenNMS'
  1. OpenNMS
  2. NMS-7755

c.m.v.a.ThreadPoolAsynchronousRunner: com.mchange.v2.async.ThreadPoolAsynchronousRunner$DeadlockDetector@59804d53 -- APPARENT DEADLOCK!!! Creating emergency threads for unassigned pending tasks!

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Resolved (View Workflow)
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 16.0.1
    • Fix Version/s: 16.0.4, 17.0.0
    • Component/s: Database
    • Security Level: Default (Default Security Scheme)
    • Labels:
      None
    • Environment:
      RHEL7
    • Sprint:
      Newts - Phase 6, Newts - Sprint 7

      Description

      After running for about 2 weeks opennms consums almost all of the cpu

      [root@opennms etc]# top
top - 07:24:43 up 50 days, 17:48,  6 users,  load average: 6,88, 7,43, 7,18
Tasks: 392 total,   1 running, 391 sleeping,   0 stopped,   0 zombie
%Cpu(s): 97,1 us,  0,3 sy,  0,0 ni,  2,6 id,  0,0 wa,  0,0 hi,  0,0 si,  0,0 st
KiB Mem : 32741312 total,   235860 free,  8058396 used, 24447056 buff/cache
KiB Swap:  2097148 total,  2084096 free,    13052 used. 22985476 avail Mem 

  PID USER      PR  NI    VIRT    RES    SHR S  %CPU %MEM     TIME+ COMMAND                                                                                                                                                                  
11901 root      20   0 12,396g 6,834g  33064 S 776,2 21,9  11144:45 java                                                                                                                                                                     
  417 root      20   0  130300   2096   1300 R   0,3  0,0   0:00.16 top                                                                                                                                                                      
49706 root      20   0  215580   2624   1068 S   0,3  0,0   0:53.58 gammu-smsd                                                                                                                                                               
    1 root      20   0  202680   4380   2324 S   0,0  0,0   2:12.20 systemd                                                                                                                                                                  
    2 root      20   0       0      0      0 S   0,0  0,0   0:01.19 kthreadd                                                                                                                                                                 
    3 root      20   0       0      0      0 S   0,0  0,0  10:49.44 ksoftirqd/0                                                                                                                                                              
    5 root       0 -20       0      0      0 S   0,0  0,0   0:00.00 kworker/0:0H                                                                                                                                                             
    7 root      rt   0       0      0      0 S   0,0  0,0   0:01.51 migration/0                                                                                                                                                              
    8 root      20   0       0      0      0 S   0,0  0,0   0:14.45 rcu_bh                                                                                                                                                                   
    9 root      20   0       0      0      0 S   0,0  0,0   0:00.01 rcuob/0                                                                                                                                                                  
   10 root      20   0       0      0      0 S   0,0  0,0   0:00.00 rcuob/1                                                                                                                                                                  
   11 root      20   0       0      0      0 S   0,0  0,0   0:00.00 rcuob/2                                                                                                                                                                  
   12 root      20   0       0      0      0 S   0,0  0,0   0:00.00 rcuob/3                                                                                                                                                                  
   13 root      20   0       0      0      0 S   0,0  0,0   0:00.00 rcuob/4                                                                                                                                                                  
   14 root      20   0       0      0      0 S   0,0  0,0   0:00.27 rcuob/5                                                                                                                                                                  
   15 root      20   0       0      0      0 S   0,0  0,0   0:00.00 rcuob/6                                                                                                                                                                  
   16 root      20   0       0      0      0 S   0,0  0,0   0:16.01 rcuob/7                                                                                                                                                                  
   17 root      20   0       0      0      0 S   0,0  0,0   0:00.00 rcuob/8                                                                                                                                                                  
   18 root      20   0       0      0      0 S   0,0  0,0   0:00.00 rcuob/9                                                                                                                                                                  
   19 root      20   0       0      0      0 S   0,0  0,0   0:00.00 rcuob/10

      and sends false mails with services and interfaces down. Only restart of opennms helps. Looking to the logs the ones that don't look correct for me are 

      2015-06-10 17:13:58,612 INFO  [Main] o.s.b.f.x.XmlBeanDefinitionReader: Loading XML bean definitions from class path resource [META-INF/opennms/applicationContext-eventDaemon.xml]
2015-06-11 07:03:35,632 WARN  [Timer-0] c.m.v.a.ThreadPoolAsynchronousRunner: com.mchange.v2.async.ThreadPoolAsynchronousRunner$DeadlockDetector@59804d53 -- APPARENT DEADLOCK!!! Creating emergency threads for unassigned pending tasks!
2015-06-11 07:03:35,640 WARN  [Timer-0] c.m.v.a.ThreadPoolAsynchronousRunner: com.mchange.v2.async.ThreadPoolAsynchronousRunner$DeadlockDetector@59804d53 -- APPARENT DEADLOCK!!! Complete Status: 
        Managed Threads: 3
        Active Threads: 0
        Active Tasks: 
        Pending Tasks: 
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@27a621eb
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@35fd5202
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@76554d67
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@67f4e45b
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@714b2837
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@2ef9195e
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@721b5793
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@328da3b7
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@1a2f2f41
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@7cfaf6b3
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@54758170
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@b3a1052
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@680c6353
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@43684f8f
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@3b6e3893
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@600d072c
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@6b10f685
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@6a05c85f
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@20e5df2c
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@2859987b
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@4491e72b
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@1298d6
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@e802b47
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@6afef0ac
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@219dfa67
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@355d02aa
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@3a88cd55
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@27ee2138
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@696ea960
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@34fbaeb5
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@48652f1a
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@1ed420cf
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@26dafdc
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@6b0a3722
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@a76d8a6
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@351b537f
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@5ae7194f
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@606e8616
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@5c61d155
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@338ee10d
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@51c1bb52
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@458bc94a
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@17b243d7
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@53f04ea5
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@f3764a2
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@146d3d97
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@11447836
Pool thread stack traces:
        Thread[com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#2,5,main]
                java.lang.Object.wait(Native Method)
                com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:534)
        Thread[com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#1,5,main]
                java.lang.Object.wait(Native Method)
                com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:534)
        Thread[com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#0,5,main]
                java.lang.Object.wait(Native Method)
                com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:534)


2015-06-11 07:06:17,299 WARN  [Timer-0] c.m.v.a.ThreadPoolAsynchronousRunner: com.mchange.v2.async.ThreadPoolAsynchronousRunner$DeadlockDetector@59804d53 -- APPARENT DEADLOCK!!! Creating emergency threads for unassigned pending tasks!
2015-06-11 07:06:17,306 WARN  [Timer-0] c.m.v.a.ThreadPoolAsynchronousRunner: com.mchange.v2.async.ThreadPoolAsynchronousRunner$DeadlockDetector@59804d53 -- APPARENT DEADLOCK!!! Complete Status: 
        Managed Threads: 3
        Active Threads: 3
        Active Tasks: 
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@771be579 (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#0)
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@1a6654e6 (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#2)
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@6c5c7817 (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#1)
        Pending Tasks: 
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@404eba42
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@6856bf1f
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@40bf0797
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@4fac4357
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@7a857c4a
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@27768a42
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@1fcda284
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@3256fcd1
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@63e0a1fd
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@70d71359
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@2fc4645
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@74992bf
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@61c024e2
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@2945ae58
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@49eb0b5b
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@2fcb4b3
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@62fb773a
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@66c82253
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@77684c02
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@10563770
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@29add0e7
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@e50a53b
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@3b6de0af
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@1a21ad05
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@5dcc6c4e
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@56be73b1
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@2029951
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@155c5591
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@2b4ce568
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@e4a284b
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@1894e0c2
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@6f93de9c
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@233811a3
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@7cef7dff
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@43421050
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@32d4419a
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@5102eb6a
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@56057430
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@5963e30
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@155e6789
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@53c197f3
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@2e98cd4f
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@1acb0112
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@7ccf5fed
Pool thread stack traces:
        Thread[com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#2,5,main]
                com.mchange.v2.c3p0.impl.NewPooledConnection.getConnection(NewPooledConnection.java:194)
                com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool$1PooledConnectionResourcePoolManager.refurbishResourceOnCheckin(C3P0PooledConnectionPool.java:284)
                com.mchange.v2.resourcepool.BasicResourcePool.attemptRefurbishResourceOnCheckin(BasicResourcePool.java:1606)
                com.mchange.v2.resourcepool.BasicResourcePool.access$200(BasicResourcePool.java:32)
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask.run(BasicResourcePool.java:1228)
                com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:547)
        Thread[com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#0,5,main]
                com.mchange.v2.c3p0.impl.NewPooledConnection.getConnection(NewPooledConnection.java:194)
                com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool$1PooledConnectionResourcePoolManager.refurbishResourceOnCheckin(C3P0PooledConnectionPool.java:284)
                com.mchange.v2.resourcepool.BasicResourcePool.attemptRefurbishResourceOnCheckin(BasicResourcePool.java:1606)
                com.mchange.v2.resourcepool.BasicResourcePool.access$200(BasicResourcePool.java:32)
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask.run(BasicResourcePool.java:1228)
                com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:547)
        Thread[com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#1,5,main]
                com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:560)


2015-06-11 07:10:27,802 WARN  [Timer-0] c.m.v.a.ThreadPoolAsynchronousRunner: com.mchange.v2.async.ThreadPoolAsynchronousRunner$DeadlockDetector@59804d53 -- APPARENT DEADLOCK!!! Creating emergency threads for unassigned pending tasks!
2015-06-11 07:10:38,806 WARN  [Timer-0] c.m.v.a.ThreadPoolAsynchronousRunner: com.mchange.v2.async.ThreadPoolAsynchronousRunner$DeadlockDetector@59804d53 -- APPARENT DEADLOCK!!! Complete Status: 
        Managed Threads: 3
        Active Threads: 3
        Active Tasks: 
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@5d732d17 (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#1)
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@357f58ac (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#0)
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@15e55dd8 (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#2)
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@3c86bed
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@4717e516
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@8627f60
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@37d6e829
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@77016a3d
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@f461e9e
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@14c4e969
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@1453cc78
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@68ff0c4d
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@57f25d22
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@64ce6914
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@6ef459f9
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@7ef9ad0e
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@3ba7e4be
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@2c36bc17
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@60c103f9
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@53634332
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@5765dff4
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@4eaa170b
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@261c1bec
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@6f2fa6ce
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@164c5ea0
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@8c0012d
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@4e45a8a2
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@5cce7e72
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@28039215
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@20423751
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@43a19b43
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@6cb340ab
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@5814e412
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@695da8fe
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@26694d15
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@5029f76b
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@2fe2bd08
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@2bfcea52
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@47111bdd
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@589c2efb
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@622cd21d
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@2ece1a70
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@61ce3387
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@589c22b3
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@5ca4bf87
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@26733f9
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@12257a39
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@2b955b74
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@52b49106
Pool thread stack traces:
        Thread[com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#0,5,main]
                com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:560)
        Thread[com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#2,5,main]
                com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:560)
        Thread[com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#1,5,main]
                com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:560)


2015-06-11 07:12:30,368 WARN  [Timer-0] c.m.v.a.ThreadPoolAsynchronousRunner: com.mchange.v2.async.ThreadPoolAsynchronousRunner$DeadlockDetector@59804d53 -- APPARENT DEADLOCK!!! Creating emergency threads for unassigned pending tasks!
2015-06-11 07:12:35,749 WARN  [Timer-0] c.m.v.a.ThreadPoolAsynchronousRunner: com.mchange.v2.async.ThreadPoolAsynchronousRunner$DeadlockDetector@59804d53 -- APPARENT DEADLOCK!!! Complete Status: 
        Managed Threads: 3
        Active Threads: 0
        Active Tasks: 
        Pending Tasks: 
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@72df525b
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@747c021c
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@e900e78
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@56283497
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@5eedf983
                com.mchange.v2.resourcepool.BasicResourcePool$1RefurbishCheckinResourceTask@4a156ca0
Pool thread stack traces:
        Thread[com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#0,5,main]
                java.lang.Object.wait(Native Method)
                com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:534)
        Thread[com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#2,5,main]
                java.lang.Object.wait(Native Method)
                com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:534)
        Thread[com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#1,5,main]
                java.lang.Object.wait(Native Method)
                com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:534)
....

        Attachments

          Issue Links

          blocks

          Bug - A problem which impairs or prevents the functions of the product. NMS-7899 Deadlocks on Demo

          • Blocker - Blocks development and/or testing work, production could not run.
          • Resolved
          is duplicated by

          Bug - A problem which impairs or prevents the functions of the product. NMS-7732 JDBCExceptionReporter: ERROR: deadlock detected

          • Major - Major loss of function.
          • Resolved

            Activity

              People

              Assignee:
              j-white Jesse White
              Reporter:
              robertpenz Robert Penz
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved: