Uploaded image for project: 'OpenNMS'
  1. OpenNMS
  2. NMS-10586

Sink API: Persistent Off-Heap Storage

    XMLWordPrintable

Details

    • Enhancement
    • Status: Resolved (View Workflow)
    • Major
    • Resolution: Fixed
    • None
    • 25.2.0
    • Minion
    • Security Level: Default (Default Security Scheme)
    • None
    • Horizon 2019 - July 10th 2019, Horizon 2019 - July 17th 2019, Horizon 2019 - July 24th, Horizon 2019 - July 31st, Horizon 2019 - August 7th, Horizon 2019 - August 14th, Horizon 2019 - August 21st, Horizon 2019 - August 28th, Horizon 2020 - January 8th, Horizon 2020 - January 22nd

    Description

      We currently support off-heap storage for Sink messages on Minion when it can't reach the broker (added in https://issues.opennms.org/browse/NMS-10942).

      The current solution uses H2 database as key value store (MVStore) for an in-memory (off-heap) solution. Some of the drawback of this solution are:

      • Large memory overhead per message
      • Messages are lost on when the Minion is restarted

      We now have additional requirements to make the messages persist across Minion restarts, while continuing to make a best effort to preserve the order.

      Here we explore options to replace the current H2 implementation with one that is backed by RocksDB.

      Attachments

        Activity

          People

            mbrooks Matthew Brooks (Inactive)
            cgorantla Chandra Gorantla
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: