As an operator I want to configure the Horizon service stack to use an Apache Kafka Cluster, so I can scale messaging communication in reliable and low latency network environments.
The messaging communication between a Minion and Horizon is configurable and allows to use different Message Queuing technologies such as ActiveMQ or Apache Kafka. By default, the embedded message broker ActiveMQ is used. It is possible to configure to use Apache Kafka which provides a distributed streaming messaging platform. The Docker images for Horizon and Minion on DockerHub should provide the possibility to configure a service stack to use an already provisioned and running Apache Kafka Cluster.
- Download the container images for Horizon and Minion from DockerHub, set environment variables to use the Kafka Cluster with 1..n nodes
- Provide a service stack definition using docker-compose to run a service stack with Horizon, Minion and 3 Kafka Nodes in a cluster on Docker
- Publish the image on DockerHub with documentation how to use it