Kafka 3.2.0 introduced a bug in the way that consumers handle rebalancing ( ), which is fixed from 3.2.1 onward.
We’ve seen the behavior described in that issue in our Horizon and Minion servers, and no amount of tuning of the brokers, consumers, and producers has resolved it.
The Kafka dependency should be upgraded as far as possible, but at least to 3.2.1.
The most recent Kafka release is 3.3.
Acceptance / Success Criteria
None
Activity
Show:
Benjamin Reed January 24, 2023 at 3:36 PM
Yup, it’ll go into 31.0.4.
JianYet January 24, 2023 at 3:00 PM
Edited
I see that the PR is merged into foundation-2023. Can you confirm if this will also be fixed in Horizon and which release? I see fix versions includes 31.0.4 but just wanted to be sure.
Jeff Gehlbach January 20, 2023 at 3:38 PM
Getting eyes on this to evaluate for inclusion in the February releases (which include Meridian 2023).
Will Keaney January 19, 2023 at 10:38 PM
In my opinion, this should be addressed before Meridian 2023 starts shipping, to avoid incorporating the KAFKA-14024 into it.
Kafka 3.2.0 introduced a bug in the way that consumers handle rebalancing ( ), which is fixed from 3.2.1 onward.
We’ve seen the behavior described in that issue in our Horizon and Minion servers, and no amount of tuning of the brokers, consumers, and producers has resolved it.
The Kafka dependency should be upgraded as far as possible, but at least to 3.2.1.
The most recent Kafka release is 3.3.