Unresolved
Details
Assignee
DJ GregorDJ GregorReporter
DJ GregorDJ GregorHB Grooming Date
Nov 22, 2022HB Backlog Status
Refined BacklogFix versions
Priority
Medium
Details
Details
Assignee
DJ Gregor
DJ GregorReporter
DJ Gregor
DJ GregorHB Grooming Date
Nov 22, 2022
HB Backlog Status
Refined Backlog
Fix versions
Priority
PagerDuty
PagerDuty
PagerDuty
Created November 22, 2022 at 4:40 PM
Updated January 31, 2023 at 4:06 PM
I was in the process of adding time series dual-write support to the OpenNMS helm chart in onms-k8s-poc to write to both RRD and Cortex and I could not get the dual-write support to work. I eventually found a number of exceptions like this in the logs:
The issue of loading the opennms-timeseries-api was fixed in NMS-14874, but it appears that the Karaf container isn't healthy after loading it, regardless of whether a TSS plugin is loaded.
I have a PR with smoke tests that attempt to load plugins and check the health of the container (I tweaked one existing and added two new):
Tweaked the TimeseriesAPIIT test to do a health-check afterwards. This currently fails (but it might be right for this to fail if there's no TSS plugin installed for it to delegate writes to).
Added CortexTssPluginIT to test loading the Cortex plugin. This one works fine. It doesn't not currently attempt to read/write data.
Added CortexTssTimeseriesPluginIT to test loading the Cortex plugin and the opennms-timeseries-api plugin. This fails in the same way as #1 above. This is the combination that a customer wants to be able to use.
PR: https://github.com/OpenNMS/opennms/pull/5526
Failures: https://app.circleci.com/pipelines/github/OpenNMS/opennms/25685/workflows/c80b9abd-d352-45e7-8227-5622ffa6394a/jobs/201528/tests