Uploaded image for project: 'OpenNMS'
  1. OpenNMS
  2. NMS-10586

Sink API: Persistent Off-Heap Storage

    XMLWordPrintable

    Details

    • Type: Enhancement
    • Status: Resolved (View Workflow)
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 25.2.0
    • Component/s: Minion
    • Security Level: Default (Default Security Scheme)
    • Labels:
      None
    • Sprint:
      Horizon 2019 - July 10th 2019, Horizon 2019 - July 17th 2019, Horizon 2019 - July 24th, Horizon 2019 - July 31st, Horizon 2019 - August 7th, Horizon 2019 - August 14th, Horizon 2019 - August 21st, Horizon 2019 - August 28th, Horizon 2020 - January 8th, Horizon 2020 - January 22nd

      Description

      We currently support off-heap storage for Sink messages on Minion when it can't reach the broker (added in https://issues.opennms.org/browse/NMS-10942).

      The current solution uses H2 database as key value store (MVStore) for an in-memory (off-heap) solution. Some of the drawback of this solution are:

      • Large memory overhead per message
      • Messages are lost on when the Minion is restarted

      We now have additional requirements to make the messages persist across Minion restarts, while continuing to make a best effort to preserve the order.

      Here we explore options to replace the current H2 implementation with one that is backed by RocksDB.

        Attachments

          Activity

            People

            Assignee:
            mbrooks Matthew Brooks
            Reporter:
            cgorantla Chandra Gorantla
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved: