Learn Kafka part 1

 Hello All,

If you are more eager to learn about the kafka, then you can scroll down to know more about the Kafka.

In this chapter i will cover Introduction, benefits and architecture

Introduction:

Apache Kafka is a distributed, open source message technology.

Kafka is fast, it's big, and its highly reliable.

You can think that kakfa as a giant logging mechanism of steroids.

It is used to collect big data, conduct real-time analysis, and process real-time streams of data—and it has the power to do all three at the same time.

Apache Kafka itself is written in Java and Scala, it runs on JVMs. Kafka's native API was written in Java as well. But you can write application code that interacts with Kafka in a number of other programming languages, such as Go, Python, or sC#\

Benefits:

One of the nice things about Kafka from a developer's point of view is that getting it up and running and then doing hands-on experimentation is a fairly easy undertaking. Of course, there's a lot more work that goes into implementing Kafka clusters at the enterprise level. For enterprise installations, many companies will use a scalable platform such as Red Hat OpenShift or a service provider. Using a Kafka service provider abstracts away the work and maintenance that goes with supporting large-scale Kafka implementations. All that developers need to concern themselves with when using a service provider is producing messages into and consuming messages out of Kafka. The service provider takes care of the rest.

Kafka architecture

The Kafka messaging architecture is made up of three components: producers, the Kafka broker, and consumers, as illustrated in Figure 1. We'll discuss these in more detail in the following sections.

                                Figure 1: Producing and consuming event messages using Kafka.