Skip to:

  1. Skip to Jira Navigation
  2. Skip to Side Navigation
  3. Skip to Main Content

Make Kafka RPC topics configurable to use module in topic names

Description

Currently Kafka RPC follows OpenNMSInstance.component.module , OpenNMSInstance.location.component.module pattern. We can remove module from the topic name and move it to proto message. That will save number of topics on Kafka in the order of number of RPC modules.

Acceptance / Success Criteria

None

Lucidchart Diagrams

Activity

Show:

Chandra Gorantla January 23, 2020 at 9:59 PM

We decided to make it configurable to disable topics keeping current implementation as default.

Chandra Gorantla January 21, 2020 at 12:53 AM

Chandra Gorantla January 15, 2020 at 5:14 PM

We already have a pattern for dynamically subscribing to Kafka topics on OpenNMS side although currently it only supports adding topics not removing topics. We could extend that to remove topics and dynamically change topics that consumer subscribe to.

Jesse White January 15, 2020 at 4:15 PM

One thing we may want to consider here is that it is currently possible for a Minion to only load specific modules, and as a result only be responsible for specific tasks like polling, but not data collection. In the current scheme, the Minion will only consume from topics for which it has the appropriate module loaded.

Fixed

Details

Assignee

Reporter

Sprint

Fix versions

Priority

PagerDuty

Created January 15, 2020 at 3:39 PM
Updated February 6, 2020 at 4:43 PM
Resolved February 6, 2020 at 4:43 PM