Atlassian uses cookies to improve your browsing experience, perform analytics and research, and conduct advertising. Accept all cookies to indicate that you agree to our use of cookies on your device. Atlassian cookies and tracking notice, (opens new window)
Updated one of my OpenNMS test system running 30.0.3 on Ubuntu (I understand that this might not be the most common Linux distro for our OpenNMS installs).
W: Conflicting distribution: https://debian.opennms.org stable Release (expected stable but got opennms-31)
E: Repository 'https://debian.opennms.org stable Release' changed its 'Label' value from 'OpenNMS Repository - opennms-30' to 'OpenNMS Repository - opennms-31'
N: Repository 'https://debian.opennms.org stable Release' changed its 'Suite' value from 'opennms-30' to 'opennms-31'
E: Repository 'https://debian.opennms.org stable Release' changed its 'Codename' value from 'opennms-30' to 'opennms-31'
N: This must be accepted explicitly before updates for this repository can be applied. See apt-secure(8) manpage for details.
Suggest documenting the above somewhere - release notes or notes in instructions?
During sudo apt-get upgrade opennms, there were chown errors reported.
Setting up opennms-db (31.0.0-1) ...
chown: missing operand after ‘115:121’
Try 'chown --help' for more information.
Setting up opennms-server (31.0.0-1) ...
*** Installation complete. You must still run the installer at
*** $OPENNMS_HOME/bin/install to be sure your database is up
*** to date before you start OpenNMS. See the install guide and
*** release notes for details at https://docs.opennms.com.
Setting up opennms-plugin-cloud (1.0.2-1) ...
chown: missing operand after ‘/usr/share/opennms/etc/examples/opennms.properties.d’
Try 'chown --help' for more information.
chown: missing operand after ‘/usr/share/opennms/etc/featuresBoot.d/plugin-cloud.boot’
Try 'chown --help' for more information.
Please make sure org.opennms.timeseries.strategy=integration
Example config is located at /usr/share/opennms/etc/examples/opennms.properties.d/timeseries.properties
Likely as a result of above, sudo /usr/share/opennms/bin/install -dis returned errors.
17:58:44.515 [Main] WARN org.opennms.install.Installer - Could not create file: /usr/share/opennms/etc/libraries.properties
17:58:44.556 [Main] ERROR org.opennms.install.Installer - OpenNMS is configured to run as 'opennms' but '/usr/share/opennms/etc/featuresBoot.d/plugin-cloud.boot' is not writable by that account.
17:58:44.556 [Main] ERROR org.opennms.install.Installer - To fix permissions, run '/usr/share/opennms/bin/fix-permissions' as root
Initially run just /usr/share/opennms/bin/fix-permissions to fix permissions. Maybe these temp files (from hawtio?) should not be created with root?
Reran sudo /usr/share/opennms/bin/install -dis Completed with complaints about liquid base ... seen those before not sure if there is any concerns here.
19:14:31.254 [Main] INFO liquibase.changelog.StandardChangeLogHistoryService - Reading from public.databasechangelog
19:14:31.254 [Main] INFO liquibase.executor.jvm.JdbcExecutor - SELECT * FROM public.databasechangelog ORDER BY DATEEXECUTED ASC, ORDEREXECUTED ASC
19:14:31.517 [Main] INFO liquibase.executor.jvm.JdbcExecutor - SELECT COUNT(e.extname)
FROM pg_catalog.pg_extension e LEFT JOIN pg_catalog.pg_description c ON c.objoid = e.oid AND c.classoid =
'pg_catalog.pg_extension'::pg_catalog.regclass
WHERE e.extname LIKE 'timescaledb'
19:14:31.517 [Main] INFO liquibase.changelog.ChangeSet - Marking ChangeSet: 29.0.4/changelog.xml::29.0.4-bmp-ip-rib-log-create-hypertable::aramos ran despite precondition failure due to onFail='MARK_RAN':
jar:file:/usr/share/opennms/lib/org.opennms.core.schema-31.0.0-liquibase.jar!/changelog.xml : SQL Precondition failed. Expected '1' got '0'
19:14:31.518 [Main] INFO liquibase.executor.jvm.JdbcExecutor - SELECT MAX(ORDEREXECUTED) FROM public.databasechangelog
19:14:31.519 [Main] INFO liquibase.executor.jvm.JdbcExecutor - UPDATE public.databasechangelog SET DATEEXECUTED = NOW(), DEPLOYMENT_ID = '8107671267', EXECTYPE = 'RERAN', MD5SUM = '8:6219a727f244439747a2f64319fec2c2', ORDEREXECUTED = 374 WHERE ID = '29.0.4-bmp-ip-rib-log-create-hypertable' AND AUTHOR = 'aramos' AND FILENAME = '29.0.4/changelog.xml'
19:14:31.522 [Main] INFO liquibase.executor.jvm.JdbcExecutor - SELECT COUNT(e.extname)
FROM pg_catalog.pg_extension e LEFT JOIN pg_catalog.pg_description c ON c.objoid = e.oid AND c.classoid =
'pg_catalog.pg_extension'::pg_catalog.regclass
WHERE e.extname LIKE 'timescaledb'
19:14:31.522 [Main] INFO liquibase.changelog.ChangeSet - Marking ChangeSet: 29.0.4/changelog.xml::29.0.4-bmp-stats_by-peer-create-hypertable::aramos ran despite precondition failure due to onFail='MARK_RAN':
jar:file:/usr/share/opennms/lib/org.opennms.core.schema-31.0.0-liquibase.jar!/changelog.xml : SQL Precondition failed. Expected '1' got '0'
19:14:31.522 [Main] INFO liquibase.executor.jvm.JdbcExecutor - UPDATE public.databasechangelog SET DATEEXECUTED = NOW(), DEPLOYMENT_ID = '8107671267', EXECTYPE = 'RERAN', MD5SUM = '8:e33b34d0e537ddefd09cd02874a23108', ORDEREXECUTED = 375 WHERE ID = '29.0.4-bmp-stats_by-peer-create-hypertable' AND AUTHOR = 'aramos' AND FILENAME = '29.0.4/changelog.xml'
19:14:31.530 [Main] INFO liquibase.executor.jvm.JdbcExecutor - SELECT COUNT(e.extname)
FROM pg_catalog.pg_extension e LEFT JOIN pg_catalog.pg_description c ON c.objoid = e.oid AND c.classoid =
'pg_catalog.pg_extension'::pg_catalog.regclass
WHERE e.extname LIKE 'timescaledb'
19:14:31.530 [Main] INFO liquibase.changelog.ChangeSet - Marking ChangeSet: 29.0.4/changelog.xml::29.0.4-bmp-stats_by-asn-create-hypertable::aramos ran despite precondition failure due to onFail='MARK_RAN':
jar:file:/usr/share/opennms/lib/org.opennms.core.schema-31.0.0-liquibase.jar!/changelog.xml : SQL Precondition failed. Expected '1' got '0'
19:14:31.531 [Main] INFO liquibase.executor.jvm.JdbcExecutor - UPDATE public.databasechangelog SET DATEEXECUTED = NOW(), DEPLOYMENT_ID = '8107671267', EXECTYPE = 'RERAN', MD5SUM = '8:6a4af049b4aedea49f33a61cc7eb2c32', ORDEREXECUTED = 376 WHERE ID = '29.0.4-bmp-stats_by-asn-create-hypertable' AND AUTHOR = 'aramos' AND FILENAME = '29.0.4/changelog.xml'
19:14:31.538 [Main] INFO liquibase.executor.jvm.JdbcExecutor - SELECT COUNT(e.extname)
FROM pg_catalog.pg_extension e LEFT JOIN pg_catalog.pg_description c ON c.objoid = e.oid AND c.classoid =
'pg_catalog.pg_extension'::pg_catalog.regclass
WHERE e.extname LIKE 'timescaledb'
19:14:31.539 [Main] INFO liquibase.changelog.ChangeSet - Marking ChangeSet: 29.0.4/changelog.xml::29.0.4-bmp-stats_by-prefix-create-hypertable::aramos ran despite precondition failure due to onFail='MARK_RAN':
jar:file:/usr/share/opennms/lib/org.opennms.core.schema-31.0.0-liquibase.jar!/changelog.xml : SQL Precondition failed. Expected '1' got '0'
19:14:31.539 [Main] INFO liquibase.executor.jvm.JdbcExecutor - UPDATE public.databasechangelog SET DATEEXECUTED = NOW(), DEPLOYMENT_ID = '8107671267', EXECTYPE = 'RERAN', MD5SUM = '8:ff775efd4fde41ce19108b9f6cb4ffdd', ORDEREXECUTED = 377 WHERE ID = '29.0.4-bmp-stats_by-prefix-create-hypertable' AND AUTHOR = 'aramos' AND FILENAME = '29.0.4/changelog.xml'
19:14:31.547 [Main] INFO liquibase.executor.jvm.JdbcExecutor - SELECT COUNT(e.extname)
FROM pg_catalog.pg_extension e LEFT JOIN pg_catalog.pg_description c ON c.objoid = e.oid AND c.classoid =
'pg_catalog.pg_extension'::pg_catalog.regclass
WHERE e.extname LIKE 'timescaledb'
19:14:31.547 [Main] INFO liquibase.changelog.ChangeSet - Marking ChangeSet: 29.0.4/changelog.xml::29.0.4-bmp-stats-peer-rib-create-hypertable::aramos ran despite precondition failure due to onFail='MARK_RAN':
jar:file:/usr/share/opennms/lib/org.opennms.core.schema-31.0.0-liquibase.jar!/changelog.xml : SQL Precondition failed. Expected '1' got '0'
19:14:31.547 [Main] INFO liquibase.executor.jvm.JdbcExecutor - UPDATE public.databasechangelog SET DATEEXECUTED = NOW(), DEPLOYMENT_ID = '8107671267', EXECTYPE = 'RERAN', MD5SUM = '8:8d7ca803a4e93c365e59a348cb8b90b9', ORDEREXECUTED = 378 WHERE ID = '29.0.4-bmp-stats-peer-rib-create-hypertable' AND AUTHOR = 'aramos' AND FILENAME = '29.0.4/changelog.xml'
19:14:31.555 [Main] INFO liquibase.executor.jvm.JdbcExecutor - SELECT COUNT(e.extname)
FROM pg_catalog.pg_extension e LEFT JOIN pg_catalog.pg_description c ON c.objoid = e.oid AND c.classoid =
'pg_catalog.pg_extension'::pg_catalog.regclass
WHERE e.extname LIKE 'timescaledb'
19:14:31.555 [Main] INFO liquibase.changelog.ChangeSet - Marking ChangeSet: 29.0.4/changelog.xml::29.0.4-bmp-stats-ip-origins-create-hypertable::aramos ran despite precondition failure due to onFail='MARK_RAN':
jar:file:/usr/share/opennms/lib/org.opennms.core.schema-31.0.0-liquibase.jar!/changelog.xml : SQL Precondition failed. Expected '1' got '0'
Also seen in the journalctl logs
Nov 10 19:11:13 dellr240 opennms[396270]: Exception in thread "Thread-409" org.springframework.dao.InvalidDataAccessResourceUsageException: could not execute query; SQL [select this_.id as id1_0_, this_.counter as counter1_0_, this_.metric_name as metric3_1_0_, this_.namespace as namespace1_0_ from usage_analytics this_ where this_.metric_name=?]; nested exception is org.hibernate.exception.SQLGrammarException: could not execute query
Nov 10 19:11:13 dellr240 opennms[396270]: Exception in thread "Timer-105" at org.springframework.orm.hibernate3.SessionFactoryUtils.convertHibernateAccessException(SessionFactoryUtils.java:642)
Nov 10 19:11:13 dellr240 opennms[396270]: at org.springframework.orm.hibernate3.HibernateAccessor.convertHibernateAccessException(HibernateAccessor.java:414)
Nov 10 19:11:13 dellr240 opennms[396270]: at org.springframework.orm.hibernate3.HibernateTemplate.doExecute(HibernateTemplate.java:415)
Nov 10 19:11:13 dellr240 opennms[396270]: at org.springframework.orm.hibernate3.HibernateTemplate.execute(HibernateTemplate.java:341)
Nov 10 19:11:13 dellr240 opennms[396270]: at org.opennms.netmgt.dao.hibernate.AbstractDaoHibernate.findMatching(AbstractDaoHibernate.java:282)
Nov 10 19:11:13 dellr240 opennms[396270]: at org.opennms.features.usageanalytics.impl.UsageAnalyticDaoImpl.getValueByMetricName(UsageAnalyticDaoImpl.java:64)
Nov 10 19:11:13 dellr240 opennms[396270]: at Proxy520f52c0_9c46_4a20_9f26_b8751b23db48.getValueByMetricName(Unknown Source)
Nov 10 19:11:13 dellr240 opennms[396270]: at org.opennms.features.datachoices.internal.UsageStatisticsReporter.generateReport(UsageStatisticsReporter.java:292)
Nov 10 19:11:13 dellr240 opennms[396270]: at org.opennms.features.datachoices.internal.UsageStatisticsReporter$Task.run(UsageStatisticsReporter.java:210)
Nov 10 19:11:13 dellr240 opennms[396270]: at java.base/java.lang.Thread.run(Thread.java:829)
Nov 10 19:11:13 dellr240 opennms[396270]: Caused by: org.hibernate.exception.SQLGrammarException: could not execute query
Nov 10 19:11:13 dellr240 opennms[396270]: at org.hibernate.exception.SQLStateConverter.convert(SQLStateConverter.java:92)
Nov 10 19:11:13 dellr240 opennms[396270]: at org.hibernate.exception.JDBCExceptionHelper.convert(JDBCExceptionHelper.java:66)
Nov 10 19:11:13 dellr240 opennms[396270]: at org.hibernate.loader.Loader.doList(Loader.java:2545)
Nov 10 19:11:13 dellr240 opennms[396270]: at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2276)
Nov 10 19:11:13 dellr240 opennms[396270]: at org.hibernate.loader.Loader.list(Loader.java:2271)
Nov 10 19:11:13 dellr240 opennms[396270]: at org.hibernate.loader.criteria.CriteriaLoader.list(CriteriaLoader.java:119)
Nov 10 19:11:13 dellr240 opennms[396270]: at org.hibernate.impl.SessionImpl.list(SessionImpl.java:1716)
Nov 10 19:11:13 dellr240 opennms[396270]: at jdk.internal.reflect.GeneratedMethodAccessor708.invoke(Unknown Source)
Nov 10 19:11:13 dellr240 opennms[396270]: at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
Nov 10 19:11:13 dellr240 opennms[396270]: at java.base/java.lang.reflect.Method.invoke(Method.java:566)
Nov 10 19:11:13 dellr240 opennms[396270]: at org.springframework.orm.hibernate3.HibernateTemplate$CloseSuppressingInvocationHandler.invoke(HibernateTemplate.java:1378)
Nov 10 19:11:13 dellr240 opennms[396270]: at com.sun.proxy.$Proxy140.list(Unknown Source)
Nov 10 19:11:13 dellr240 opennms[396270]: at org.hibernate.impl.CriteriaImpl.list(CriteriaImpl.java:347)
Nov 10 19:11:13 dellr240 opennms[396270]: at org.opennms.netmgt.dao.hibernate.AbstractDaoHibernate$4.doInHibernate(AbstractDaoHibernate.java:332)
Nov 10 19:11:13 dellr240 opennms[396270]: at org.opennms.netmgt.dao.hibernate.AbstractDaoHibernate$4.doInHibernate(AbstractDaoHibernate.java:327)
Nov 10 19:11:13 dellr240 opennms[396270]: at org.springframework.orm.hibernate3.HibernateTemplate.doExecute(HibernateTemplate.java:410)
Nov 10 19:11:13 dellr240 opennms[396270]: ... 7 more
Nov 10 19:11:13 dellr240 opennms[396270]: Caused by: org.postgresql.util.PSQLException: ERROR: relation "usage_analytics" does not exist
Nov 10 19:11:13 dellr240 opennms[396270]: Position: 131
Nov 10 19:11:13 dellr240 opennms[396270]: at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2676)
Nov 10 19:11:13 dellr240 opennms[396270]: at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2366)
Nov 10 19:11:13 dellr240 opennms[396270]: at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:356)
Nov 10 19:11:13 dellr240 opennms[396270]: at org.postgresql.jdbc.PgStatement.executeInternal(PgStatement.java:490)
Nov 10 19:11:13 dellr240 opennms[396270]: at org.postgresql.jdbc.PgStatement.execute(PgStatement.java:408)
Nov 10 19:11:13 dellr240 opennms[396270]: at org.postgresql.jdbc.PgPreparedStatement.executeWithFlags(PgPreparedStatement.java:181)
Nov 10 19:11:13 dellr240 opennms[396270]: at org.postgresql.jdbc.PgPreparedStatement.executeQuery(PgPreparedStatement.java:133)
Nov 10 19:11:13 dellr240 opennms[396270]: at com.zaxxer.hikari.pool.ProxyPreparedStatement.executeQuery(ProxyPreparedStatement.java:52)
Nov 10 19:11:13 dellr240 opennms[396270]: at com.zaxxer.hikari.pool.HikariProxyPreparedStatement.executeQuery(HikariProxyPreparedStatement.java)
Nov 10 19:11:13 dellr240 opennms[396270]: at org.hibernate.jdbc.AbstractBatcher.getResultSet(AbstractBatcher.java:208)
Nov 10 19:11:13 dellr240 opennms[396270]: at org.hibernate.loader.Loader.getResultSet(Loader.java:1953)
Nov 10 19:11:13 dellr240 opennms[396270]: at org.hibernate.loader.Loader.doQuery(Loader.java:802)
Nov 10 19:11:13 dellr240 opennms[396270]: at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:274)
Nov 10 19:11:13 dellr240 opennms[396270]: at org.hibernate.loader.Loader.doList(Loader.java:2542)
Nov 10 19:11:13 dellr240 opennms[396270]: ... 20 more
Nov 10 19:11:13 dellr240 opennms[396270]: org.springframework.dao.InvalidDataAccessResourceUsageException: could not execute query; SQL [select this_.id as id1_0_, this_.counter as counter1_0_, this_.metric_name as metric3_1_0_, this_.namespace as namespace1_0_ from usage_analytics this_ where this_.metric_name=?]; nested exception is org.hibernate.exception.SQLGrammarException: could not execute query
Nov 10 19:11:13 dellr240 opennms[396270]: at org.springframework.orm.hibernate3.SessionFactoryUtils.convertHibernateAccessException(SessionFactoryUtils.java:642)
Nov 10 19:11:13 dellr240 opennms[396270]: at org.springframework.orm.hibernate3.HibernateAccessor.convertHibernateAccessException(HibernateAccessor.java:414)
Nov 10 19:11:13 dellr240 opennms[396270]: at org.springframework.orm.hibernate3.HibernateTemplate.doExecute(HibernateTemplate.java:415)
Nov 10 19:11:13 dellr240 opennms[396270]: at org.springframework.orm.hibernate3.HibernateTemplate.execute(HibernateTemplate.java:341)
Nov 10 19:11:13 dellr240 opennms[396270]: at org.opennms.netmgt.dao.hibernate.AbstractDaoHibernate.findMatching(AbstractDaoHibernate.java:282)
Nov 10 19:11:13 dellr240 opennms[396270]: at org.opennms.features.usageanalytics.impl.UsageAnalyticDaoImpl.getValueByMetricName(UsageAnalyticDaoImpl.java:64)
Nov 10 19:11:13 dellr240 opennms[396270]: at Proxy520f52c0_9c46_4a20_9f26_b8751b23db48.getValueByMetricName(Unknown Source)
Nov 10 19:11:13 dellr240 opennms[396270]: at org.opennms.features.datachoices.internal.UsageStatisticsReporter.generateReport(UsageStatisticsReporter.java:292)
Nov 10 19:11:13 dellr240 opennms[396270]: at org.opennms.features.datachoices.internal.UsageStatisticsReporter$Task.run(UsageStatisticsReporter.java:210)
Nov 10 19:11:13 dellr240 opennms[396270]: at java.base/java.util.TimerThread.mainLoop(Timer.java:556)
Nov 10 19:11:13 dellr240 opennms[396270]: at java.base/java.util.TimerThread.run(Timer.java:506)
Nov 10 19:11:13 dellr240 opennms[396270]: Caused by: org.hibernate.exception.SQLGrammarException: could not execute query
Nov 10 19:11:13 dellr240 opennms[396270]: at org.hibernate.exception.SQLStateConverter.convert(SQLStateConverter.java:92)
Nov 10 19:11:13 dellr240 opennms[396270]: at org.hibernate.exception.JDBCExceptionHelper.convert(JDBCExceptionHelper.java:66)
Nov 10 19:11:13 dellr240 opennms[396270]: at org.hibernate.loader.Loader.doList(Loader.java:2545)
Nov 10 19:11:13 dellr240 opennms[396270]: at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2276)
Nov 10 19:11:13 dellr240 opennms[396270]: at org.hibernate.loader.Loader.list(Loader.java:2271)
Nov 10 19:11:13 dellr240 opennms[396270]: at org.hibernate.loader.criteria.CriteriaLoader.list(CriteriaLoader.java:119)
Nov 10 19:11:13 dellr240 opennms[396270]: at org.hibernate.impl.SessionImpl.list(SessionImpl.java:1716)
Nov 10 19:11:13 dellr240 opennms[396270]: at jdk.internal.reflect.GeneratedMethodAccessor708.invoke(Unknown Source)
Nov 10 19:11:13 dellr240 opennms[396270]: at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
Nov 10 19:11:13 dellr240 opennms[396270]: at java.base/java.lang.reflect.Method.invoke(Method.java:566)
Nov 10 19:11:13 dellr240 opennms[396270]: at org.springframework.orm.hibernate3.HibernateTemplate$CloseSuppressingInvocationHandler.invoke(HibernateTemplate.java:1378)
Nov 10 19:11:13 dellr240 opennms[396270]: at com.sun.proxy.$Proxy140.list(Unknown Source)
Nov 10 19:11:13 dellr240 opennms[396270]: at org.hibernate.impl.CriteriaImpl.list(CriteriaImpl.java:347)
Nov 10 19:11:13 dellr240 opennms[396270]: at org.opennms.netmgt.dao.hibernate.AbstractDaoHibernate$4.doInHibernate(AbstractDaoHibernate.java:332)
Nov 10 19:11:13 dellr240 opennms[396270]: at org.opennms.netmgt.dao.hibernate.AbstractDaoHibernate$4.doInHibernate(AbstractDaoHibernate.java:327)
Nov 10 19:11:13 dellr240 opennms[396270]: at org.springframework.orm.hibernate3.HibernateTemplate.doExecute(HibernateTemplate.java:410)
Nov 10 19:11:13 dellr240 opennms[396270]: ... 8 more
Nov 10 19:11:13 dellr240 opennms[396270]: Caused by: org.postgresql.util.PSQLException: ERROR: relation "usage_analytics" does not exist
Nov 10 19:11:13 dellr240 opennms[396270]: Position: 131
Nov 10 19:11:13 dellr240 opennms[396270]: at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2676)
Nov 10 19:11:13 dellr240 opennms[396270]: at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2366)
Nov 10 19:11:13 dellr240 opennms[396270]: at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:356)
Nov 10 19:11:13 dellr240 opennms[396270]: at org.postgresql.jdbc.PgStatement.executeInternal(PgStatement.java:490)
Nov 10 19:11:13 dellr240 opennms[396270]: at org.postgresql.jdbc.PgStatement.execute(PgStatement.java:408)
Nov 10 19:11:13 dellr240 opennms[396270]: at org.postgresql.jdbc.PgPreparedStatement.executeWithFlags(PgPreparedStatement.java:181)
Nov 10 19:11:13 dellr240 opennms[396270]: at org.postgresql.jdbc.PgPreparedStatement.executeQuery(PgPreparedStatement.java:133)
Nov 10 19:11:13 dellr240 opennms[396270]: at com.zaxxer.hikari.pool.ProxyPreparedStatement.executeQuery(ProxyPreparedStatement.java:52)
Nov 10 19:11:13 dellr240 opennms[396270]: at com.zaxxer.hikari.pool.HikariProxyPreparedStatement.executeQuery(HikariProxyPreparedStatement.java)
Nov 10 19:11:13 dellr240 opennms[396270]: at org.hibernate.jdbc.AbstractBatcher.getResultSet(AbstractBatcher.java:208)
Nov 10 19:11:13 dellr240 opennms[396270]: at org.hibernate.loader.Loader.getResultSet(Loader.java:1953)
Nov 10 19:11:13 dellr240 opennms[396270]: at org.hibernate.loader.Loader.doQuery(Loader.java:802)
Nov 10 19:11:13 dellr240 opennms[396270]: at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:274)
Nov 10 19:11:13 dellr240 opennms[396270]: at org.hibernate.loader.Loader.doList(Loader.java:2542)
Nov 10 19:11:13 dellr240 opennms[396270]: ... 21 more
Acceptance / Success Criteria
None
Lucidchart Diagrams
Activity
Show:
Benjamin Reed November 15, 2022 at 6:30 PM
As for the other issues...
1. conflicting distribution is normal when a new major version comes out; this is hard to address with our current repo tools, it will be fixed by moving to cloudsmith (or some other tool) permanently 2. the chown should be fixed by cloud plugin 1.0.3, which is now available in the yum/apt repos 3. as I noted above, I'm not sure how to solve the hawtio issue, files in data/tmp are created at runtime, and I can't imagine how they'd be root-owned unless you ran opennms as root, could they be leftover files from a previous install from before "non-root" was a thing? 4. the liquibase thing is annoying but harmless; because of the nature of liquibase changelogs, we can't really fix it
Chantal Moffatt November 15, 2022 at 3:46 PM
@Benjamin Reed It is possible. I performed some OpenNMS restart on this system after deleting the files and they were recreated with opennms:opennms permissions. Also checked a HZN 30.0.4 and the permissions were opennms:opennms.
Benjamin Reed November 14, 2022 at 3:16 PM
Maybe these temp files (from hawtio?) should not be created with root?
@Chantal Moffatt I'm not entirely sure how that would happen unless you ran OpenNMS as root at some point. Those are not created upon installation, AFAIK.
Updated one of my OpenNMS test system running 30.0.3 on Ubuntu (I understand that this might not be the most common Linux distro for our OpenNMS installs).
Followed upgrade instructions in https://docs.opennms.com/horizon/31/deployment/upgrade/basic.html and my system was updated to 30.0.4.
I had to run 'sudo apt-get update --allow-releaseinfo-change' to be able to get HZN 31 work around this warning
W: Conflicting distribution: https://debian.opennms.org stable Release (expected stable but got opennms-31) E: Repository 'https://debian.opennms.org stable Release' changed its 'Label' value from 'OpenNMS Repository - opennms-30' to 'OpenNMS Repository - opennms-31' N: Repository 'https://debian.opennms.org stable Release' changed its 'Suite' value from 'opennms-30' to 'opennms-31' E: Repository 'https://debian.opennms.org stable Release' changed its 'Codename' value from 'opennms-30' to 'opennms-31' N: This must be accepted explicitly before updates for this repository can be applied. See apt-secure(8) manpage for details.
Suggest documenting the above somewhere - release notes or notes in instructions?
During sudo apt-get upgrade opennms, there were chown errors reported.
Setting up opennms-db (31.0.0-1) ... chown: missing operand after ‘115:121’ Try 'chown --help' for more information. Setting up opennms-server (31.0.0-1) ... *** Installation complete. You must still run the installer at *** $OPENNMS_HOME/bin/install to be sure your database is up *** to date before you start OpenNMS. See the install guide and *** release notes for details at https://docs.opennms.com. Setting up opennms-plugin-cloud (1.0.2-1) ... chown: missing operand after ‘/usr/share/opennms/etc/examples/opennms.properties.d’ Try 'chown --help' for more information. chown: missing operand after ‘/usr/share/opennms/etc/featuresBoot.d/plugin-cloud.boot’ Try 'chown --help' for more information. Please make sure org.opennms.timeseries.strategy=integration Example config is located at /usr/share/opennms/etc/examples/opennms.properties.d/timeseries.properties
Likely as a result of above, sudo /usr/share/opennms/bin/install -dis returned errors.
17:58:44.515 [Main] WARN org.opennms.install.Installer - Could not create file: /usr/share/opennms/etc/libraries.properties 17:58:44.556 [Main] ERROR org.opennms.install.Installer - OpenNMS is configured to run as 'opennms' but '/usr/share/opennms/etc/featuresBoot.d/plugin-cloud.boot' is not writable by that account. 17:58:44.556 [Main] ERROR org.opennms.install.Installer - To fix permissions, run '/usr/share/opennms/bin/fix-permissions' as root
Initially run just /usr/share/opennms/bin/fix-permissions to fix permissions.
Maybe these temp files (from hawtio?) should not be created with root?
find: ‘/usr/share/opennms/data/tmp/jetty-0_0_0_0-8980-opennms-_opennms-any-558510034797318730’: Permission denied find: ‘/usr/share/opennms/data/tmp/jetty-0_0_0_0-8980-ROOT-_-any-11579560546460459977’: Permission denied find: ‘/usr/share/opennms/data/tmp/jetty-0_0_0_0-8980-hawtio-_hawtio-any-5913101544266210169’: Permission denied
Ran fix permissions with sudo - all good
Reran sudo /usr/share/opennms/bin/install -dis
Completed with complaints about liquid base ... seen those before not sure if there is any concerns here.
19:14:31.254 [Main] INFO liquibase.changelog.StandardChangeLogHistoryService - Reading from public.databasechangelog 19:14:31.254 [Main] INFO liquibase.executor.jvm.JdbcExecutor - SELECT * FROM public.databasechangelog ORDER BY DATEEXECUTED ASC, ORDEREXECUTED ASC 19:14:31.517 [Main] INFO liquibase.executor.jvm.JdbcExecutor - SELECT COUNT(e.extname) FROM pg_catalog.pg_extension e LEFT JOIN pg_catalog.pg_description c ON c.objoid = e.oid AND c.classoid = 'pg_catalog.pg_extension'::pg_catalog.regclass WHERE e.extname LIKE 'timescaledb' 19:14:31.517 [Main] INFO liquibase.changelog.ChangeSet - Marking ChangeSet: 29.0.4/changelog.xml::29.0.4-bmp-ip-rib-log-create-hypertable::aramos ran despite precondition failure due to onFail='MARK_RAN': jar:file:/usr/share/opennms/lib/org.opennms.core.schema-31.0.0-liquibase.jar!/changelog.xml : SQL Precondition failed. Expected '1' got '0' 19:14:31.518 [Main] INFO liquibase.executor.jvm.JdbcExecutor - SELECT MAX(ORDEREXECUTED) FROM public.databasechangelog 19:14:31.519 [Main] INFO liquibase.executor.jvm.JdbcExecutor - UPDATE public.databasechangelog SET DATEEXECUTED = NOW(), DEPLOYMENT_ID = '8107671267', EXECTYPE = 'RERAN', MD5SUM = '8:6219a727f244439747a2f64319fec2c2', ORDEREXECUTED = 374 WHERE ID = '29.0.4-bmp-ip-rib-log-create-hypertable' AND AUTHOR = 'aramos' AND FILENAME = '29.0.4/changelog.xml' 19:14:31.522 [Main] INFO liquibase.executor.jvm.JdbcExecutor - SELECT COUNT(e.extname) FROM pg_catalog.pg_extension e LEFT JOIN pg_catalog.pg_description c ON c.objoid = e.oid AND c.classoid = 'pg_catalog.pg_extension'::pg_catalog.regclass WHERE e.extname LIKE 'timescaledb' 19:14:31.522 [Main] INFO liquibase.changelog.ChangeSet - Marking ChangeSet: 29.0.4/changelog.xml::29.0.4-bmp-stats_by-peer-create-hypertable::aramos ran despite precondition failure due to onFail='MARK_RAN': jar:file:/usr/share/opennms/lib/org.opennms.core.schema-31.0.0-liquibase.jar!/changelog.xml : SQL Precondition failed. Expected '1' got '0' 19:14:31.522 [Main] INFO liquibase.executor.jvm.JdbcExecutor - UPDATE public.databasechangelog SET DATEEXECUTED = NOW(), DEPLOYMENT_ID = '8107671267', EXECTYPE = 'RERAN', MD5SUM = '8:e33b34d0e537ddefd09cd02874a23108', ORDEREXECUTED = 375 WHERE ID = '29.0.4-bmp-stats_by-peer-create-hypertable' AND AUTHOR = 'aramos' AND FILENAME = '29.0.4/changelog.xml' 19:14:31.530 [Main] INFO liquibase.executor.jvm.JdbcExecutor - SELECT COUNT(e.extname) FROM pg_catalog.pg_extension e LEFT JOIN pg_catalog.pg_description c ON c.objoid = e.oid AND c.classoid = 'pg_catalog.pg_extension'::pg_catalog.regclass WHERE e.extname LIKE 'timescaledb' 19:14:31.530 [Main] INFO liquibase.changelog.ChangeSet - Marking ChangeSet: 29.0.4/changelog.xml::29.0.4-bmp-stats_by-asn-create-hypertable::aramos ran despite precondition failure due to onFail='MARK_RAN': jar:file:/usr/share/opennms/lib/org.opennms.core.schema-31.0.0-liquibase.jar!/changelog.xml : SQL Precondition failed. Expected '1' got '0' 19:14:31.531 [Main] INFO liquibase.executor.jvm.JdbcExecutor - UPDATE public.databasechangelog SET DATEEXECUTED = NOW(), DEPLOYMENT_ID = '8107671267', EXECTYPE = 'RERAN', MD5SUM = '8:6a4af049b4aedea49f33a61cc7eb2c32', ORDEREXECUTED = 376 WHERE ID = '29.0.4-bmp-stats_by-asn-create-hypertable' AND AUTHOR = 'aramos' AND FILENAME = '29.0.4/changelog.xml' 19:14:31.538 [Main] INFO liquibase.executor.jvm.JdbcExecutor - SELECT COUNT(e.extname) FROM pg_catalog.pg_extension e LEFT JOIN pg_catalog.pg_description c ON c.objoid = e.oid AND c.classoid = 'pg_catalog.pg_extension'::pg_catalog.regclass WHERE e.extname LIKE 'timescaledb' 19:14:31.539 [Main] INFO liquibase.changelog.ChangeSet - Marking ChangeSet: 29.0.4/changelog.xml::29.0.4-bmp-stats_by-prefix-create-hypertable::aramos ran despite precondition failure due to onFail='MARK_RAN': jar:file:/usr/share/opennms/lib/org.opennms.core.schema-31.0.0-liquibase.jar!/changelog.xml : SQL Precondition failed. Expected '1' got '0' 19:14:31.539 [Main] INFO liquibase.executor.jvm.JdbcExecutor - UPDATE public.databasechangelog SET DATEEXECUTED = NOW(), DEPLOYMENT_ID = '8107671267', EXECTYPE = 'RERAN', MD5SUM = '8:ff775efd4fde41ce19108b9f6cb4ffdd', ORDEREXECUTED = 377 WHERE ID = '29.0.4-bmp-stats_by-prefix-create-hypertable' AND AUTHOR = 'aramos' AND FILENAME = '29.0.4/changelog.xml' 19:14:31.547 [Main] INFO liquibase.executor.jvm.JdbcExecutor - SELECT COUNT(e.extname) FROM pg_catalog.pg_extension e LEFT JOIN pg_catalog.pg_description c ON c.objoid = e.oid AND c.classoid = 'pg_catalog.pg_extension'::pg_catalog.regclass WHERE e.extname LIKE 'timescaledb' 19:14:31.547 [Main] INFO liquibase.changelog.ChangeSet - Marking ChangeSet: 29.0.4/changelog.xml::29.0.4-bmp-stats-peer-rib-create-hypertable::aramos ran despite precondition failure due to onFail='MARK_RAN': jar:file:/usr/share/opennms/lib/org.opennms.core.schema-31.0.0-liquibase.jar!/changelog.xml : SQL Precondition failed. Expected '1' got '0' 19:14:31.547 [Main] INFO liquibase.executor.jvm.JdbcExecutor - UPDATE public.databasechangelog SET DATEEXECUTED = NOW(), DEPLOYMENT_ID = '8107671267', EXECTYPE = 'RERAN', MD5SUM = '8:8d7ca803a4e93c365e59a348cb8b90b9', ORDEREXECUTED = 378 WHERE ID = '29.0.4-bmp-stats-peer-rib-create-hypertable' AND AUTHOR = 'aramos' AND FILENAME = '29.0.4/changelog.xml' 19:14:31.555 [Main] INFO liquibase.executor.jvm.JdbcExecutor - SELECT COUNT(e.extname) FROM pg_catalog.pg_extension e LEFT JOIN pg_catalog.pg_description c ON c.objoid = e.oid AND c.classoid = 'pg_catalog.pg_extension'::pg_catalog.regclass WHERE e.extname LIKE 'timescaledb' 19:14:31.555 [Main] INFO liquibase.changelog.ChangeSet - Marking ChangeSet: 29.0.4/changelog.xml::29.0.4-bmp-stats-ip-origins-create-hypertable::aramos ran despite precondition failure due to onFail='MARK_RAN': jar:file:/usr/share/opennms/lib/org.opennms.core.schema-31.0.0-liquibase.jar!/changelog.xml : SQL Precondition failed. Expected '1' got '0'
Also seen in the journalctl logs
Nov 10 19:11:13 dellr240 opennms[396270]: Exception in thread "Thread-409" org.springframework.dao.InvalidDataAccessResourceUsageException: could not execute query; SQL [select this_.id as id1_0_, this_.counter as counter1_0_, this_.metric_name as metric3_1_0_, this_.namespace as namespace1_0_ from usage_analytics this_ where this_.metric_name=?]; nested exception is org.hibernate.exception.SQLGrammarException: could not execute query Nov 10 19:11:13 dellr240 opennms[396270]: Exception in thread "Timer-105" at org.springframework.orm.hibernate3.SessionFactoryUtils.convertHibernateAccessException(SessionFactoryUtils.java:642) Nov 10 19:11:13 dellr240 opennms[396270]: at org.springframework.orm.hibernate3.HibernateAccessor.convertHibernateAccessException(HibernateAccessor.java:414) Nov 10 19:11:13 dellr240 opennms[396270]: at org.springframework.orm.hibernate3.HibernateTemplate.doExecute(HibernateTemplate.java:415) Nov 10 19:11:13 dellr240 opennms[396270]: at org.springframework.orm.hibernate3.HibernateTemplate.execute(HibernateTemplate.java:341) Nov 10 19:11:13 dellr240 opennms[396270]: at org.opennms.netmgt.dao.hibernate.AbstractDaoHibernate.findMatching(AbstractDaoHibernate.java:282) Nov 10 19:11:13 dellr240 opennms[396270]: at org.opennms.features.usageanalytics.impl.UsageAnalyticDaoImpl.getValueByMetricName(UsageAnalyticDaoImpl.java:64) Nov 10 19:11:13 dellr240 opennms[396270]: at Proxy520f52c0_9c46_4a20_9f26_b8751b23db48.getValueByMetricName(Unknown Source) Nov 10 19:11:13 dellr240 opennms[396270]: at org.opennms.features.datachoices.internal.UsageStatisticsReporter.generateReport(UsageStatisticsReporter.java:292) Nov 10 19:11:13 dellr240 opennms[396270]: at org.opennms.features.datachoices.internal.UsageStatisticsReporter$Task.run(UsageStatisticsReporter.java:210) Nov 10 19:11:13 dellr240 opennms[396270]: at java.base/java.lang.Thread.run(Thread.java:829) Nov 10 19:11:13 dellr240 opennms[396270]: Caused by: org.hibernate.exception.SQLGrammarException: could not execute query Nov 10 19:11:13 dellr240 opennms[396270]: at org.hibernate.exception.SQLStateConverter.convert(SQLStateConverter.java:92) Nov 10 19:11:13 dellr240 opennms[396270]: at org.hibernate.exception.JDBCExceptionHelper.convert(JDBCExceptionHelper.java:66) Nov 10 19:11:13 dellr240 opennms[396270]: at org.hibernate.loader.Loader.doList(Loader.java:2545) Nov 10 19:11:13 dellr240 opennms[396270]: at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2276) Nov 10 19:11:13 dellr240 opennms[396270]: at org.hibernate.loader.Loader.list(Loader.java:2271) Nov 10 19:11:13 dellr240 opennms[396270]: at org.hibernate.loader.criteria.CriteriaLoader.list(CriteriaLoader.java:119) Nov 10 19:11:13 dellr240 opennms[396270]: at org.hibernate.impl.SessionImpl.list(SessionImpl.java:1716) Nov 10 19:11:13 dellr240 opennms[396270]: at jdk.internal.reflect.GeneratedMethodAccessor708.invoke(Unknown Source) Nov 10 19:11:13 dellr240 opennms[396270]: at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) Nov 10 19:11:13 dellr240 opennms[396270]: at java.base/java.lang.reflect.Method.invoke(Method.java:566) Nov 10 19:11:13 dellr240 opennms[396270]: at org.springframework.orm.hibernate3.HibernateTemplate$CloseSuppressingInvocationHandler.invoke(HibernateTemplate.java:1378) Nov 10 19:11:13 dellr240 opennms[396270]: at com.sun.proxy.$Proxy140.list(Unknown Source) Nov 10 19:11:13 dellr240 opennms[396270]: at org.hibernate.impl.CriteriaImpl.list(CriteriaImpl.java:347) Nov 10 19:11:13 dellr240 opennms[396270]: at org.opennms.netmgt.dao.hibernate.AbstractDaoHibernate$4.doInHibernate(AbstractDaoHibernate.java:332) Nov 10 19:11:13 dellr240 opennms[396270]: at org.opennms.netmgt.dao.hibernate.AbstractDaoHibernate$4.doInHibernate(AbstractDaoHibernate.java:327) Nov 10 19:11:13 dellr240 opennms[396270]: at org.springframework.orm.hibernate3.HibernateTemplate.doExecute(HibernateTemplate.java:410) Nov 10 19:11:13 dellr240 opennms[396270]: ... 7 more Nov 10 19:11:13 dellr240 opennms[396270]: Caused by: org.postgresql.util.PSQLException: ERROR: relation "usage_analytics" does not exist Nov 10 19:11:13 dellr240 opennms[396270]: Position: 131 Nov 10 19:11:13 dellr240 opennms[396270]: at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2676) Nov 10 19:11:13 dellr240 opennms[396270]: at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2366) Nov 10 19:11:13 dellr240 opennms[396270]: at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:356) Nov 10 19:11:13 dellr240 opennms[396270]: at org.postgresql.jdbc.PgStatement.executeInternal(PgStatement.java:490) Nov 10 19:11:13 dellr240 opennms[396270]: at org.postgresql.jdbc.PgStatement.execute(PgStatement.java:408) Nov 10 19:11:13 dellr240 opennms[396270]: at org.postgresql.jdbc.PgPreparedStatement.executeWithFlags(PgPreparedStatement.java:181) Nov 10 19:11:13 dellr240 opennms[396270]: at org.postgresql.jdbc.PgPreparedStatement.executeQuery(PgPreparedStatement.java:133) Nov 10 19:11:13 dellr240 opennms[396270]: at com.zaxxer.hikari.pool.ProxyPreparedStatement.executeQuery(ProxyPreparedStatement.java:52) Nov 10 19:11:13 dellr240 opennms[396270]: at com.zaxxer.hikari.pool.HikariProxyPreparedStatement.executeQuery(HikariProxyPreparedStatement.java) Nov 10 19:11:13 dellr240 opennms[396270]: at org.hibernate.jdbc.AbstractBatcher.getResultSet(AbstractBatcher.java:208) Nov 10 19:11:13 dellr240 opennms[396270]: at org.hibernate.loader.Loader.getResultSet(Loader.java:1953) Nov 10 19:11:13 dellr240 opennms[396270]: at org.hibernate.loader.Loader.doQuery(Loader.java:802) Nov 10 19:11:13 dellr240 opennms[396270]: at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:274) Nov 10 19:11:13 dellr240 opennms[396270]: at org.hibernate.loader.Loader.doList(Loader.java:2542) Nov 10 19:11:13 dellr240 opennms[396270]: ... 20 more Nov 10 19:11:13 dellr240 opennms[396270]: org.springframework.dao.InvalidDataAccessResourceUsageException: could not execute query; SQL [select this_.id as id1_0_, this_.counter as counter1_0_, this_.metric_name as metric3_1_0_, this_.namespace as namespace1_0_ from usage_analytics this_ where this_.metric_name=?]; nested exception is org.hibernate.exception.SQLGrammarException: could not execute query Nov 10 19:11:13 dellr240 opennms[396270]: at org.springframework.orm.hibernate3.SessionFactoryUtils.convertHibernateAccessException(SessionFactoryUtils.java:642) Nov 10 19:11:13 dellr240 opennms[396270]: at org.springframework.orm.hibernate3.HibernateAccessor.convertHibernateAccessException(HibernateAccessor.java:414) Nov 10 19:11:13 dellr240 opennms[396270]: at org.springframework.orm.hibernate3.HibernateTemplate.doExecute(HibernateTemplate.java:415) Nov 10 19:11:13 dellr240 opennms[396270]: at org.springframework.orm.hibernate3.HibernateTemplate.execute(HibernateTemplate.java:341) Nov 10 19:11:13 dellr240 opennms[396270]: at org.opennms.netmgt.dao.hibernate.AbstractDaoHibernate.findMatching(AbstractDaoHibernate.java:282) Nov 10 19:11:13 dellr240 opennms[396270]: at org.opennms.features.usageanalytics.impl.UsageAnalyticDaoImpl.getValueByMetricName(UsageAnalyticDaoImpl.java:64) Nov 10 19:11:13 dellr240 opennms[396270]: at Proxy520f52c0_9c46_4a20_9f26_b8751b23db48.getValueByMetricName(Unknown Source) Nov 10 19:11:13 dellr240 opennms[396270]: at org.opennms.features.datachoices.internal.UsageStatisticsReporter.generateReport(UsageStatisticsReporter.java:292) Nov 10 19:11:13 dellr240 opennms[396270]: at org.opennms.features.datachoices.internal.UsageStatisticsReporter$Task.run(UsageStatisticsReporter.java:210) Nov 10 19:11:13 dellr240 opennms[396270]: at java.base/java.util.TimerThread.mainLoop(Timer.java:556) Nov 10 19:11:13 dellr240 opennms[396270]: at java.base/java.util.TimerThread.run(Timer.java:506) Nov 10 19:11:13 dellr240 opennms[396270]: Caused by: org.hibernate.exception.SQLGrammarException: could not execute query Nov 10 19:11:13 dellr240 opennms[396270]: at org.hibernate.exception.SQLStateConverter.convert(SQLStateConverter.java:92) Nov 10 19:11:13 dellr240 opennms[396270]: at org.hibernate.exception.JDBCExceptionHelper.convert(JDBCExceptionHelper.java:66) Nov 10 19:11:13 dellr240 opennms[396270]: at org.hibernate.loader.Loader.doList(Loader.java:2545) Nov 10 19:11:13 dellr240 opennms[396270]: at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2276) Nov 10 19:11:13 dellr240 opennms[396270]: at org.hibernate.loader.Loader.list(Loader.java:2271) Nov 10 19:11:13 dellr240 opennms[396270]: at org.hibernate.loader.criteria.CriteriaLoader.list(CriteriaLoader.java:119) Nov 10 19:11:13 dellr240 opennms[396270]: at org.hibernate.impl.SessionImpl.list(SessionImpl.java:1716) Nov 10 19:11:13 dellr240 opennms[396270]: at jdk.internal.reflect.GeneratedMethodAccessor708.invoke(Unknown Source) Nov 10 19:11:13 dellr240 opennms[396270]: at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) Nov 10 19:11:13 dellr240 opennms[396270]: at java.base/java.lang.reflect.Method.invoke(Method.java:566) Nov 10 19:11:13 dellr240 opennms[396270]: at org.springframework.orm.hibernate3.HibernateTemplate$CloseSuppressingInvocationHandler.invoke(HibernateTemplate.java:1378) Nov 10 19:11:13 dellr240 opennms[396270]: at com.sun.proxy.$Proxy140.list(Unknown Source) Nov 10 19:11:13 dellr240 opennms[396270]: at org.hibernate.impl.CriteriaImpl.list(CriteriaImpl.java:347) Nov 10 19:11:13 dellr240 opennms[396270]: at org.opennms.netmgt.dao.hibernate.AbstractDaoHibernate$4.doInHibernate(AbstractDaoHibernate.java:332) Nov 10 19:11:13 dellr240 opennms[396270]: at org.opennms.netmgt.dao.hibernate.AbstractDaoHibernate$4.doInHibernate(AbstractDaoHibernate.java:327) Nov 10 19:11:13 dellr240 opennms[396270]: at org.springframework.orm.hibernate3.HibernateTemplate.doExecute(HibernateTemplate.java:410) Nov 10 19:11:13 dellr240 opennms[396270]: ... 8 more Nov 10 19:11:13 dellr240 opennms[396270]: Caused by: org.postgresql.util.PSQLException: ERROR: relation "usage_analytics" does not exist Nov 10 19:11:13 dellr240 opennms[396270]: Position: 131 Nov 10 19:11:13 dellr240 opennms[396270]: at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2676) Nov 10 19:11:13 dellr240 opennms[396270]: at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2366) Nov 10 19:11:13 dellr240 opennms[396270]: at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:356) Nov 10 19:11:13 dellr240 opennms[396270]: at org.postgresql.jdbc.PgStatement.executeInternal(PgStatement.java:490) Nov 10 19:11:13 dellr240 opennms[396270]: at org.postgresql.jdbc.PgStatement.execute(PgStatement.java:408) Nov 10 19:11:13 dellr240 opennms[396270]: at org.postgresql.jdbc.PgPreparedStatement.executeWithFlags(PgPreparedStatement.java:181) Nov 10 19:11:13 dellr240 opennms[396270]: at org.postgresql.jdbc.PgPreparedStatement.executeQuery(PgPreparedStatement.java:133) Nov 10 19:11:13 dellr240 opennms[396270]: at com.zaxxer.hikari.pool.ProxyPreparedStatement.executeQuery(ProxyPreparedStatement.java:52) Nov 10 19:11:13 dellr240 opennms[396270]: at com.zaxxer.hikari.pool.HikariProxyPreparedStatement.executeQuery(HikariProxyPreparedStatement.java) Nov 10 19:11:13 dellr240 opennms[396270]: at org.hibernate.jdbc.AbstractBatcher.getResultSet(AbstractBatcher.java:208) Nov 10 19:11:13 dellr240 opennms[396270]: at org.hibernate.loader.Loader.getResultSet(Loader.java:1953) Nov 10 19:11:13 dellr240 opennms[396270]: at org.hibernate.loader.Loader.doQuery(Loader.java:802) Nov 10 19:11:13 dellr240 opennms[396270]: at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:274) Nov 10 19:11:13 dellr240 opennms[396270]: at org.hibernate.loader.Loader.doList(Loader.java:2542) Nov 10 19:11:13 dellr240 opennms[396270]: ... 21 more