Design thresholding support for telemetryd on Sentinel

Description

Related to , we should support thresholding in telemetryd when running on Sentinel.

Given the distributed nature of Sentinel there are additional considerations that need to be made: Is it possible to reliably route the metrics for a given resource to the same Sentinel? If not then how we do track the thresholding state and share this across Sentinels?

Success criteria:

  • We can trigger thresholds for metrics persisted by telemetryd on Sentinel

 

Acceptance / Success Criteria

None
100% Done
Loading...

Lucidchart Diagrams

Activity

Show:

Jesse White July 3, 2019 at 5:56 PM

With we have moved thresholding out of the opennms-services module and introduced a new ThresholdingService interface which can be used to apply thresholding to any CollectionSet.

In telemetryd will be updated to use this new service, allowing us to apply thresholding to streaming telemetry.

The next challenges arise from processing streaming telemetry on Sentinel. (config), (events), (stickiness) and (state) should provide the building blocks necessary for making this work.

Jesse White April 12, 2019 at 4:04 PM
Edited

We also need to solve the problem of sharing the thresholding configuration with the core and the Sentinels. This could be an opportunity to move this to the database, or we could find a more generic solution that works with our configuration files as-is.
 

Fixed

Details

Assignee

Reporter

Sprint

Fix versions

Priority

PagerDuty

Created April 11, 2019 at 3:59 PM
Updated July 3, 2019 at 5:56 PM
Resolved July 3, 2019 at 5:56 PM