Apache Kafka: The Beginners’ Guide
Photo by Bongkarn Thanyakij from Pixels

BEGINNER’S GUIDE

How Apache Kafka works?

Understand different components and architecture of Apache Kafka, an event streaming platform capable of handling trillion requests a day.

What is Apache Kafka?

Apache Kafka’s official logo
Apache Kafka’s official logo

Key Concepts

Records

Example of Record in Kafka:Key: “1234421”
Value: “{“product”: “xyz”, “cost”: 12.7}”
Timestamp: “Oct. 19, 2020 at 8:20 p.m.”

Topic and Partitions

Topic and Partitions in Apache Kafka
Topic and Partitions in Apache Kafka
Image from Official Documentation of Kafka
Partition Distribution among brokers
Partition Distribution among brokers

Kafka Brokers

Producers

Consumers

Partition distribution among consumer and consumer groups
Partition distribution among consumer and consumer groups
Partition distribution among consumer and consumer groups

Pros and Cons of Apache Kafka

Summary

Software Engineer at Newfold Digital