Hi Adit

There is another option.

* For producers, create a service which pushed to kafka. All of other services etc call this service to produce.

* For consumers, the consumer groups would depend on the throughput and they can connect directly to the kafka cluster.

Senior Staff Engineer @freshworks. Ex-McKinsey/Microsoft/Slideshare/SAP, Tech Enthusiast, Passionate about India. Opinions are mine