Kafka consumer - how to add a topic -


in scenario, have n consumers (all consumers have 1 stream/no partitioning), each subscribed separate set of topics, how process new topics, added producers?

should create new consumer each added topic? or can add topic working consumer? (how that?)

or better keep 1 consumer group n consumers , not divide topics between n consumers(streams)?

the initial config, described, topics devided between consumers of same consumer group not goood @ all. consumer not able fail=over each other, because have different lists of topics. kafka issue unnecessary rebalance.

you need not add consumer each added topic - better consume such topics beginning, adding them common path /mytopics/*

you better divide topics partitions , add new partitions if need. transparent , without effort.


Comments

Popular posts from this blog

c++ - Difference between pre and post decrement in recursive function argument -

php - Nothing but 'run(); ' when browsing to my local project, how do I fix this? -

php - How can I echo out this array? -