Uploaded image for project: 'OpenNMS'
  1. OpenNMS
  2. NMS-14415

Kafka Consumer stops commits when overloaded

    XMLWordPrintable

Details

    • Horizon 22 - Jun 9 - 23
    • 1199

    Description

      When a large number of events are sent to Kafka Consumer topics in a short period of time (say 1000+ messages in a burst), the messages are not processed fast enough and "something" stops processing. The consumer attempts to reconnect to Kafka and reprocesses all messages, then gets caught in the same loop. This means that the server will infinitely keep duplicating events and never processes the new additions to clear out the backlog.

      Attachments

        Activity

          People

            amay Alex May
            mmahacek Mark Mahacek
            Votes:
            1 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: