Skip to main content

Messaging

Messaging Platforms facilitate communication between distributed applications or services via queues or topics.

Broker​

A Broker is a server that handles the storage and transmission of messages in a Kafka cluster. Brokers manage message data for topics and distribute load across the cluster. They are key components for enabling fault tolerance and high availability in Kafka’s publish-subscribe model. Each broker communicates with producers and consumers, ensuring messages are persisted and delivered efficiently.

Broker Instance​

A Broker Instance refers to an individual server running a Kafka broker. Each broker instance is part of a Kafka cluster, responsible for managing a subset of partitions and ensuring data replication across the cluster. Broker instances work together to balance workloads, provide redundancy, and ensure data availability even if some instances go offline. They are critical for Kafka's ability to handle high-throughput and low-latency message processing.

Topic​

A Kafka Topic is a logical channel to which producers send messages and from which consumers retrieve messages. Topics can be partitioned to enable parallel processing and ensure scalability within a Kafka cluster. Each partition is replicated across multiple brokers for fault tolerance, ensuring data is durable and accessible even in the event of broker failures.