Skip to:

  1. Skip to Jira Navigation
  2. Skip to Side Navigation
  3. Skip to Main Content

Startup fails with Syslogd enabled

Description

Change line 317 of service-configuration.xml from enabled="false" to enabled="true" to enable the Syslogd service daemon, then try to restart or cold start. Startup fails right away with only manager.log containing anything. Here's the complete stack trace with some context:

2015-10-12 21:32:10,261 DEBUG [Main] o.o.n.c.ServiceConfigFactory: ServiceConfigFactory.init: config file path /opt/opennms/etc/service-configuration.xml 2015-10-12 21:32:10,808 DEBUG [Main] o.o.c.x.JaxbUtils: @ValidateUsing is missing from class class org.opennms.netmgt.config.service.ServiceConfiguration 2015-10-12 21:32:10,808 DEBUG [Main] o.o.c.x.JaxbUtils: No schema files found for validating class org.opennms.netmgt.config.service.ServiceConfiguration 2015-10-12 21:32:10,873 DEBUG [Thread-30161] o.o.n.v.Manager: Beginning status check 2015-10-12 21:32:10,874 DEBUG [Thread-30161] o.o.n.c.ServiceConfigFactory: ServiceConfigFactory.init: config file path /opt/opennms/etc/service-configuration.xml 2015-10-12 21:32:10,975 DEBUG [Thread-30161] o.o.c.x.JaxbUtils: @ValidateUsing is missing from class class org.opennms.netmgt.config.service.ServiceConfiguration 2015-10-12 21:32:10,975 DEBUG [Thread-30161] o.o.c.x.JaxbUtils: No schema files found for validating class org.opennms.netmgt.config.service.ServiceConfiguration 2015-10-12 21:32:11,078 DEBUG [Thread-30161] o.o.n.v.Invoker: finding mbean instance :Name=XSLTProcessor 2015-10-12 21:32:11,078 DEBUG [Thread-30161] o.o.n.v.Invoker: finding mbean instance :Name=HttpAdaptor 2015-10-12 21:32:11,078 DEBUG [Thread-30161] o.o.n.v.Invoker: finding mbean instance :Name=HttpAdaptorMgmt 2015-10-12 21:32:11,078 DEBUG [Thread-30161] o.o.n.v.Invoker: finding mbean instance OpenNMS:Name=Manager 2015-10-12 21:32:11,078 DEBUG [Thread-30161] o.o.n.v.Invoker: finding mbean instance OpenNMS:Name=TestLoadLibraries 2015-10-12 21:32:11,078 DEBUG [Thread-30161] o.o.n.v.Invoker: finding mbean instance OpenNMS:Name=Eventd 2015-10-12 21:32:11,078 DEBUG [Thread-30161] o.o.n.v.Invoker: finding mbean instance OpenNMS:Name=Trapd 2015-10-12 21:32:11,078 DEBUG [Thread-30161] o.o.n.v.Invoker: finding mbean instance OpenNMS:Name=Queued 2015-10-12 21:32:11,078 DEBUG [Thread-30161] o.o.n.v.Invoker: finding mbean instance OpenNMS:Name=Actiond 2015-10-12 21:32:11,078 DEBUG [Thread-30161] o.o.n.v.Invoker: finding mbean instance OpenNMS:Name=Notifd 2015-10-12 21:32:11,078 DEBUG [Thread-30161] o.o.n.v.Invoker: finding mbean instance OpenNMS:Name=Scriptd 2015-10-12 21:32:11,078 DEBUG [Thread-30161] o.o.n.v.Invoker: finding mbean instance OpenNMS:Name=Rtcd 2015-10-12 21:32:11,078 DEBUG [Thread-30161] o.o.n.v.Invoker: finding mbean instance OpenNMS:Name=Pollerd 2015-10-12 21:32:11,078 DEBUG [Thread-30161] o.o.n.v.Invoker: finding mbean instance OpenNMS:Name=PollerBackEnd 2015-10-12 21:32:11,078 DEBUG [Thread-30161] o.o.n.v.Invoker: finding mbean instance OpenNMS:Name=EnhancedLinkd 2015-10-12 21:32:11,078 DEBUG [Thread-30161] o.o.n.v.Invoker: finding mbean instance OpenNMS:Name=Ticketer 2015-10-12 21:32:11,078 DEBUG [Thread-30161] o.o.n.v.Invoker: finding mbean instance OpenNMS:Name=Collectd 2015-10-12 21:32:11,078 DEBUG [Thread-30161] o.o.n.v.Invoker: finding mbean instance OpenNMS:Name=Discovery 2015-10-12 21:32:11,078 DEBUG [Thread-30161] o.o.n.v.Invoker: finding mbean instance OpenNMS:Name=Vacuumd 2015-10-12 21:32:11,078 DEBUG [Thread-30161] o.o.n.v.Invoker: finding mbean instance OpenNMS:Name=EventTranslator 2015-10-12 21:32:11,078 DEBUG [Thread-30161] o.o.n.v.Invoker: finding mbean instance OpenNMS:Name=PassiveStatusd 2015-10-12 21:32:11,078 DEBUG [Thread-30161] o.o.n.v.Invoker: finding mbean instance OpenNMS:Name=Statsd 2015-10-12 21:32:11,078 DEBUG [Thread-30161] o.o.n.v.Invoker: finding mbean instance OpenNMS:Name=Provisiond 2015-10-12 21:32:11,078 DEBUG [Thread-30161] o.o.n.v.Invoker: finding mbean instance OpenNMS:Name=Reportd 2015-10-12 21:32:11,078 DEBUG [Thread-30161] o.o.n.v.Invoker: finding mbean instance OpenNMS:Name=Alarmd 2015-10-12 21:32:11,078 DEBUG [Thread-30161] o.o.n.v.Invoker: finding mbean instance OpenNMS:Name=Ackd 2015-10-12 21:32:11,078 DEBUG [Thread-30161] o.o.n.v.Invoker: finding mbean instance OpenNMS:Name=JettyServer 2015-10-12 21:32:11,078 DEBUG [Thread-30161] o.o.n.v.Invoker: finding mbean instance OpenNMS:Name=Syslogd 2015-10-12 21:32:11,078 ERROR [Thread-30161] o.o.n.v.Invoker: An error occurred loading the mbean OpenNMS:Name=Syslogd of type org.opennms.netmgt.syslogd.jmx.Syslogd it will be skipped 2015-10-12 21:32:11,078 DEBUG [Thread-30161] o.o.n.v.Invoker: finding mbean instance OpenNMS:Name=Syslogd 2015-10-12 21:32:11,078 ERROR [Thread-30161] o.o.n.v.Invoker: An error occurred loading the mbean OpenNMS:Name=Syslogd of type org.opennms.netmgt.syslogd.jmx.Syslogd it will be skipped javax.management.InstanceNotFoundException: OpenNMS:Name=Syslogd at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(Unknown Source) ~[?:1.8.0_40] at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getObjectInstance(Unknown Source) ~[?:1.8.0_40] at com.sun.jmx.mbeanserver.JmxMBeanServer.getObjectInstance(Unknown Source) ~[?:1.8.0_40] at org.opennms.netmgt.vmmgr.Invoker.getObjectInstances(Invoker.java:158) [org.opennms.core.daemon-17.0.0-SNAPSHOT.jar:?] at org.opennms.netmgt.vmmgr.Manager.status(Manager.java:147) [org.opennms.core.daemon-17.0.0-SNAPSHOT.jar:?] at org.opennms.netmgt.vmmgr.Manager.status(Manager.java:133) [org.opennms.core.daemon-17.0.0-SNAPSHOT.jar:?] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_40] at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) ~[?:1.8.0_40] at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) ~[?:1.8.0_40] at java.lang.reflect.Method.invoke(Unknown Source) ~[?:1.8.0_40] at sun.reflect.misc.Trampoline.invoke(Unknown Source) [?:1.8.0_40] at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source) ~[?:?] at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) ~[?:1.8.0_40] at java.lang.reflect.Method.invoke(Unknown Source) ~[?:1.8.0_40] at sun.reflect.misc.MethodUtil.invoke(Unknown Source) [?:1.8.0_40] at com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(Unknown Source) [?:1.8.0_40] at com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(Unknown Source) [?:1.8.0_40] at com.sun.jmx.mbeanserver.MBeanIntrospector.invokeM(Unknown Source) [?:1.8.0_40] at com.sun.jmx.mbeanserver.PerInterface.invoke(Unknown Source) [?:1.8.0_40] at com.sun.jmx.mbeanserver.MBeanSupport.invoke(Unknown Source) [?:1.8.0_40] at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.invoke(Unknown Source) [?:1.8.0_40] at com.sun.jmx.mbeanserver.JmxMBeanServer.invoke(Unknown Source) [?:1.8.0_40] at mx4j.tools.adaptor.http.InvokeOperationCommandProcessor.executeRequest(InvokeOperationCommandProcessor.java:164) [mx4j-tools-3.0.1.jar:?] at mx4j.tools.adaptor.http.HttpAdaptor$HttpClient.run(HttpAdaptor.java:980) [mx4j-tools-3.0.1.jar:?] 2015-10-12 21:32:11,080 DEBUG [Thread-30161] o.o.n.v.Invoker: starting pass 0 2015-10-12 21:32:11,080 DEBUG [Thread-30161] o.o.n.v.Invoker: pass 0 on service OpenNMS:Name=Eventd will invoke method "status" 2015-10-12 21:32:11,080 DEBUG [Thread-30161] o.o.n.v.Invoker: Invoking status on object OpenNMS:Name=Eventd 2015-10-12 21:32:11,080 DEBUG [Thread-30161] o.o.n.v.Invoker: Invocation status successful for MBean OpenNMS:Name=Eventd 2015-10-12 21:32:11,080 DEBUG [Thread-30161] o.o.n.v.Invoker: pass 0 on service OpenNMS:Name=Trapd will invoke method "status" 2015-10-12 21:32:11,080 DEBUG [Thread-30161] o.o.n.v.Invoker: Invoking status on object OpenNMS:Name=Trapd 2015-10-12 21:32:11,080 DEBUG [Thread-30161] o.o.n.v.Invoker: Invocation status successful for MBean OpenNMS:Name=Trapd 2015-10-12 21:32:11,080 DEBUG [Thread-30161] o.o.n.v.Invoker: pass 0 on service OpenNMS:Name=Queued will invoke method "status" 2015-10-12 21:32:11,080 DEBUG [Thread-30161] o.o.n.v.Invoker: Invoking status on object OpenNMS:Name=Queued 2015-10-12 21:32:11,080 DEBUG [Thread-30161] o.o.n.v.Invoker: Invocation status successful for MBean OpenNMS:Name=Queued 2015-10-12 21:32:11,080 DEBUG [Thread-30161] o.o.n.v.Invoker: pass 0 on service OpenNMS:Name=Actiond will invoke method "status" 2015-10-12 21:32:11,080 DEBUG [Thread-30161] o.o.n.v.Invoker: Invoking status on object OpenNMS:Name=Actiond 2015-10-12 21:32:11,080 DEBUG [Thread-30161] o.o.n.v.Invoker: Invocation status successful for MBean OpenNMS:Name=Actiond

Environment

A pretty fresh RPM install of opennms-core-17.0.0-0.20151006.onms.develop.135.noarch (not upgraded from any prior release, only slightly abused for about a week) This is on a slightly unusual CentOS 7 system (ask me for details) with lots of strange bridge interfaces that could be implicated, but the rest of the system has so far worked just fine.

Acceptance / Success Criteria

None

Lucidchart Diagrams

Activity

Show:

Jeff Gehlbach November 6, 2015 at 3:18 PM

Resolving

Jeff Gehlbach November 6, 2015 at 3:18 PM

It went away on its own after updating to a newer build. Will resolve.

Seth Leger November 6, 2015 at 2:55 PM

Did we ever make any more diagnosis on this?

Jeff Gehlbach October 12, 2015 at 5:48 PM

Yes, the named class is present in the services JAR:

[root@controller-a opennms]# unzip -v /opt/opennms/lib/opennms-services-17.0.0-SNAPSHOT.jar | grep Syslogd 367 Defl:N 245 33% 10-06-2015 09:44 d0c6f9a0 org/opennms/netmgt/syslogd/SyslogdIPMgr.class 3619 Defl:N 1725 52% 10-06-2015 09:44 7e31d57b org/opennms/netmgt/syslogd/Syslogd.class 2947 Defl:N 1524 48% 10-06-2015 09:44 765fb6f7 org/opennms/netmgt/syslogd/SyslogdIPMgrJDBCImpl.class 1060 Defl:N 496 53% 10-06-2015 09:44 452b83bb org/opennms/netmgt/syslogd/jmx/Syslogd.class 183 Defl:N 142 22% 10-06-2015 09:44 7c2c34a4 org/opennms/netmgt/syslogd/jmx/SyslogdMBean.class 2824 Defl:N 1353 52% 10-06-2015 09:44 2df1650e org/opennms/netmgt/syslogd/SyslogdIPMgrDaoImpl.class
Cannot Reproduce

Details

Assignee

Reporter

Components

Fix versions

Affects versions

Priority

PagerDuty

Created October 12, 2015 at 5:47 PM
Updated November 6, 2015 at 3:18 PM
Resolved November 6, 2015 at 3:18 PM

Flag notifications