Uploaded image for project: 'OpenNMS'
  1. OpenNMS
  2. NMS-10667

health:check command times out when a health check command gets stuck

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Resolved (View Workflow)
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 23.0.4, 24.0.0
    • Fix Version/s: 24.1.0
    • Component/s: None
    • Security Level: Default (Default Security Scheme)
    • Labels:
      None
    • Sprint:
      Horizon 2019 - 19

      Description

      admin@opennms> health:check
      Verifying the health of the container
      
      Verifying installed bundles                    [ Timeout  ] => Health Check did not finish within 5000 ms                                        
      OIA :: Sample Project :: Service Extensions    [ Timeout  ] => Health Check did not finish within 5000 ms                                        
      OIA :: Sample Project :: Health Check          [ Timeout  ] => Health Check did not finish within 5000 ms                                        
      OIA :: Sample Project :: Alarm Lifecycle       [ Timeout  ] => Health Check did not finish within 5000 ms                                        
      OIA :: Sample Project :: Requisition           [ Timeout  ] => Health Check did not finish within 5000 ms                                        
      OIA :: Sample Project :: User Defined Link     [ Timeout  ] => Health Check did not finish within 5000 ms                                        
      Connecting to ElasticSearch ReST API (Flows)   [ Timeout  ] => Health Check did not finish within 5000 ms                                        
      
      => Oh no, something is wrong
      

      Stack shows:

      "health-check-0" #596 prio=5 os_prio=0 tid=0x00007f93c802a800 nid=0xe6cb runnable [0x00007f93047e2000]
         java.lang.Thread.State: RUNNABLE
              at java.lang.Class.getDeclaredConstructors0(Native Method)
              at java.lang.Class.privateGetDeclaredConstructors(Class.java:2671)
              at java.lang.Class.getConstructor0(Class.java:3075)
              at java.lang.Class.newInstance(Class.java:412)
              at sun.reflect.MethodAccessorGenerator$1.run(MethodAccessorGenerator.java:403)
              at sun.reflect.MethodAccessorGenerator$1.run(MethodAccessorGenerator.java:394)
              at java.security.AccessController.doPrivileged(Native Method)
              at sun.reflect.MethodAccessorGenerator.generate(MethodAccessorGenerator.java:393)
              at sun.reflect.MethodAccessorGenerator.generateMethod(MethodAccessorGenerator.java:75)
              at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:53)
              at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
              at java.lang.reflect.Method.invoke(Method.java:498)
              at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:302)
              at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:190)
              at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:157)
              at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:99)
              at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:281)
              at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:96)
              at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179)
              at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:208)
              at com.sun.proxy.$Proxy348.getLocationName(Unknown Source)
              at org.opennms.netmgt.collection.core.DefaultCollectionAgent.getLocationName(DefaultCollectionAgent.java:242)
              at org.opennms.netmgt.collection.client.rpc.CollectorRequestBuilderImpl.execute(CollectorRequestBuilderImpl.java:126)
              at org.opennms.features.apilayer.collectors.CollectorRequestBuilderImpl.execute(CollectorRequestBuilderImpl.java:111)
              at org.opennms.integration.api.sample.health.ServiceExtensionHealthCheck.perform(ServiceExtensionHealthCheck.java:115)
              at org.opennms.integration.api.sample.health.ChainedHealthCheck.perform(ChainedHealthCheck.java:61)
              at Proxy921b63b1_ced9_4158_a9d9_109678e17c49.perform(Unknown Source)
              at org.opennms.features.apilayer.health.HealthCheckManager$1.perform(HealthCheckManager.java:54)
              at org.opennms.core.health.impl.DefaultHealthCheckService.lambda$runChecks$3(DefaultHealthCheckService.java:121)
              at org.opennms.core.health.impl.DefaultHealthCheckService$$Lambda$825/1768501126.call(Unknown Source)
              at java.util.concurrent.FutureTask.run(FutureTask.java:266)
              at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
              at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
              at java.lang.Thread.run(Thread.java:748)
       

      which appears to be stuck from a previous run.

        Attachments

          Activity

            People

            • Assignee:
              mvr Markus von RĂ¼den
              Reporter:
              j-white Jesse White
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: