In this blog post, we will setup Kafka and Zookeeper cluster with following requirements: System will handle 15K events per second of 1 KB each System will be reliable and will not loose data System will support monitoring with Prometheus and Grafana System will be load tested with JMeter Things…

Events are lifeline of an Event Driven Architecture. All microservices rely on the data in these events to be accurate and complete. One of the many ways to implement Event Driven Architecture is through Amazon Simple Notification Service (SNS) and Amazon Simple Queue Service (SQS).

How to set up a logging Infrastructureusing using ElasticSearch, Fluentd, and Kibana. — Setting up the right logging infrastructure helps us in finding what happened, debugging and monitoring the application. At a very basic level, we should expect the following from our infrastructure: Ability to free text search on our logs Ability to search for specific api logs Ability to search per statusCode…

Learn how to CI/CD with GitHub Actions and Docker — This article will cover the following: Use Docker instead of bare metal deployment Use GitHub actions for continuous integration of your app Use GitHub actions for continuous deployment by pushing the Docker image to a Docker registry (Docker Hub) Our workflow will look like this

Rules for an optimized caching mechanism — For every complex problem, there is an answer that is clear, simple, and wrong. Let’s look at how a typical cache miss workflow looks like

Why we might need one? — There can be scenarios where we have some code which is used by many micro-services. For example, we can have a code on how to make interservice calls with the circuit breaker, logging, timeouts and much more. We want every service in our infrastructure to adhere to same guidelines. It…

Time series data in its most basic form is a sequence of data points measuring a particular thing over a period of time. For more information, you can read the first part of this post What the heck is time-series data? Our use case is pretty simple. We have users…

We were working for a telecom client where we were rolling out offers for our customers. They had tons of business logic based on which the user will be given an offer. In addition to that, they would create more categories of offer as time passes by. We saw the…

Choose between http/1.1 and gRPC. TL; DR: Use gRPC How microservices communicate with each other can affect performance and scalability of the application. Communication between services can be synchronous or asynchronous. For this blog post, we will focus on synchronous. We have 2 common protocols at our disposal HTTP/1.1: The…