Overview

Apache Kafka is an open-source distributed event streaming platform used for building real-time data pipelines and streaming applications. It allows applications to publish and subscribe to streams of records in a fault-tolerant and scalable manner.

Role in this knowledge base

The core technology discussed in the tutorial, presented as a solution to the problems of traditional microservice architectures.

Key facts

  • Kafka persists every event or message on disk for a configurable retention period, unlike standard message queues that delete messages after consumption.

Sources