Uploaded image for project: 'OpenNMS'
  1. OpenNMS
  2. NMS-13407

Limit CollectionSet size in Kafka Producer to less than 1MB.

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Resolved (View Workflow)
    • Priority: Medium
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 29.0.0
    • Component/s: None
    • Security Level: Default (Default Security Scheme)
    • Labels:
      None
    • Sprint:
      Horizon 2021 - Jun 23 - Jul 7

      Description

      Currently, Kafka Producer for metrics doesn't split message and put all the metrics it receives for a resource into one message.

      Sometimes this may be over 1MB which may result in MessageSizeTooLargeException exceptions in Kafka.

      To resolve this, we could split resources into several chunks and send with the same timestamp.

        Attachments

          Activity

            People

            Assignee:
            cgorantla Chandra Gorantla
            Reporter:
            cgorantla Chandra Gorantla
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved:

                Git Integration