Uploaded image for project: 'OpenNMS'
  1. OpenNMS
  2. NMS-12285

Poller take a long time to startup/initialize on large systems

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Resolved (View Workflow)
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 25.0.0
    • Fix Version/s: 25.0.0
    • Component/s: None
    • Security Level: Default (Default Security Scheme)
    • Labels:
      None
    • Sprint:
      Horizon 2019 - September 11th, Horizon 2019 - September 18th

      Description

      Deployed OpenNMS 25.0.0-SNAPSHOT to a system with 3k nodes and 12k interfaces.

      OpenNMS takes a long time to start, hanging on the poller:

      2019-09-16 12:50:06,469 DEBUG [Main] o.o.n.v.Invoker: pass 0 on service OpenNMS:Name=Pollerd will invoke method "init"
      2019-09-16 12:50:06,469 DEBUG [Main] o.o.n.v.Invoker: Invoking init on object OpenNMS:Name=Pollerd
      2019-09-16 13:12:07,493 DEBUG [Main] o.o.n.v.Invoker: Invocation init successful for MBean OpenNMS:Name=Pollerd
      2019-09-16 13:12:07,493 DEBUG [Main] o.o.n.v.Invoker: pass 0 on service OpenNMS:Name=EnhancedLinkd will invoke method "init"
      

      (20+ minutes) 

      Thread dumps show:

       at com.sun.proxy.$Proxy123.getActiveIPAddressList(Unknown Source)
              at org.opennms.netmgt.config.PollerConfigManager.getIpList(PollerConfigManager.java:490)
              at org.opennms.netmgt.config.PollerConfigManager.createPackageIpListMap(PollerConfigManager.java:462)
              at org.opennms.netmgt.config.PollerConfigManager.rebuildPackageIpListMap(PollerConfigManager.java:505)
              at org.opennms.netmgt.config.PollerConfig.pollableServiceInPackage(PollerConfig.java:424)
              at org.opennms.netmgt.config.PollerConfig.findPackageForService(PollerConfig.java:408)
              at org.opennms.netmgt.poller.Poller.scheduleService(Poller.java:488)
              at org.opennms.netmgt.poller.Poller.access$100(Poller.java:82)
              at org.opennms.netmgt.poller.Poller$2.doInTransaction(Poller.java:467)
              at org.opennms.netmgt.poller.Poller$2.doInTransaction(Poller.java:462)
              at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:133)
              at org.opennms.netmgt.poller.Poller.scheduleServices(Poller.java:462)
              at org.opennms.netmgt.poller.Poller.scheduleExistingServices(Poller.java:395)
              at org.opennms.netmgt.poller.Poller.onInit(Poller.java:307)
       

       

        Attachments

          Activity

            People

            • Assignee:
              fooker Dustin Frisch
              Reporter:
              j-white Jesse White
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: