In this thread, I will give a little brief overview of the Apache Kafka platform. Like what it is, how it works, core concepts, its use cases, and the benefits of using it.

#100DaysOfCode #ApacheKafka #Kafka
🧵👇
1. What is Apache Kafka?

Apache Kafka is an open-source distributed streaming platform developed originally by LinkedIn as a messaging queue, but now Kafka is much more than a messaging queue. and later donated to the Apache Software Foundation. (1/3)

👇
(cont'd...)

The project, written in Scala and Java, aims to provide a unified, high-throughput, low-latency platform for handling real-time data feeds. (2/3)

👇
(cont'd...)

In general, Kafka is used to building real-time event streaming applications. As Kafka is distributed, which means that it can be scaled up when needed. All that you need to do is to add new nodes (servers) to the Kafka cluster. (3/3)

👇
2. How does Apache Kafka Work?

The platform leverages a streaming process enabling the processing of data in a parallelly connected system. This feature allows different apps to execute the record as soon as it arrives,(1/2)

👇
(cont'd...)

instead of waiting for the output of the previous record. It stores the data in a fault-tolerant durable way. In simple terms, Kafka producer applications write data to topics, and the consumer applications read from the topic. (2/2)

👇
3. Why use Apache Kafka?

There are numerous choices when it comes to choosing to publish/subscribe to messaging systems. This begs the question as to what makes Kafka a standout choice for developers. (1/2)

👇
(cont'd...)

- Multiple producers & consumers
- Disk-Based Retention
- High performance
- Scalable (2/2)

👇
4. The real use cases of Apache Kafka

- Real-time data processing
- Application activity monitoring
- Logging and/or monitoring system
- Messaging
- Metrics & logging
- Stream processing

👇
5. 4 major Kafka components:

Topic – stream of messages belonging to the same type
Producer – that can publish messages to a topic
Brokers – set of servers where publishes messages are stored
Consumer – that subscribes to various topics & pulls data from brokers.

👇
Apache Kafka® 101: Topics

Apache Kafka®'s topic is a log of events, and a log is a simple data structure with well-known semantics.

▶️

👇
Apache Kafka® 101: Producers

A producer is an external application that writes messages to a Kafka cluster, communicating with the cluster using Kafka’s network protocol.

▶️

👇
Apache Kafka® 101: Brokers

Kafka is made up of brokers or a network of machines. These might be containers running on pods and on virtualized servers running on actual processors in a physical datacenter, rather than distinct physical servers.

▶️

👇
Apache Kafka® 101: Consumers

The consumer is an external application that reads messages from Kafka topics and does some work with them, like filtering, aggregating or enriching them with other information sources.

▶️

👇
6. Apache Kafka's has benefits above traditional messaging:

- Fast: A single Kafka broker can serve thousands of clients by handling megabytes of reads and writes/second
- Scalable: Data are partitioned and streamlined over a cluster of machines to enable larger data (1/2)

👇
(cont'd...)

- Durable: Messages are persistent and is replicated within the cluster to prevent data loss
- Distributed by Design: It provides fault tolerance guarantees and durability
That;s all for this thread and thank you for reading this thread, liking it and sharing it.

• • •

Missing some Tweet in this thread? You can try to force a refresh
 

Keep Current with Ministry of Coding 🇮🇳

Ministry of Coding 🇮🇳 Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

More from @NaveenS16

5 Dec 20
🧵 M E G A T H R E A D

Check out all of my amazing threads that cover various topics like #JavaScript, #React, my favourite podcasts and many more...

👇#100DaysOfCode #CodeNewbie
Thread #1: This is the place where you can find most of the amazing resources, tutorials, code snippets, tips and tricks about #JavaScript. Happy Coding Days 😎

👇#100DaysOfCode #CodeNewbie #React
Thread #2: This is the place where you can learn most of the thing about #React. Find out some of the best resources, tutorials, code snippets, tips and tricks to enhance your React skills.

👇#100DaysOfCode #CodeNewbie #JavaScript #ReactHooks
Read 21 tweets
15 Oct 20
A thread on #HeadlessCMS where you will know most of things about what it is, how is it different to traditional #CMS, why it matters, pros & con's, and the most popular Headless CMS.

👇 #100DaysOfCode
So before you understand what this #HeadlessCMS is all about, in the first place you should know need to understand the difference between a Headless CMS and a conventional (or traditional) #CMS.

👇 #100DaysOfCode
Traditional #CMS platforms, like Joomla for instance, come with a front-end delivery layer, otherwise known as the “head” — that dictates how the content is presented to the end-user (1/3).

,👇 #HeadlessCMS #100DaysOfCode
Read 20 tweets
7 May 20
#Git Tips 👉 This is how to remove sensitive data from history, after a push 😎

#GitHub #DevTips #100DaysOfCode #CodeNewbie #301DaysOfCode
#Git Tips 👉 To show all the tracked and untracked files. #GitHub #DevTips #100DaysOfCode #CodeNewbie #301DaysOfCode
#Git Tips 👉 This one comes in handy when you accidentally commit something with a typo or misleading commit message. The -v is optional, but I like it coz it shows lot of info about changes which helps to write a more descriptive commit message. #100DaysOfCode #CodeNewbie
Read 43 tweets

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Too expensive? Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal Become our Patreon

Thank you for your support!

Follow Us on Twitter!

:(