Apache Kafka

advanced
data
Enhanced Content

Definition

Distributed streaming platform for building real-time data pipelines and streaming applications. Like a high-speed highway system for data that can handle millions of messages per second.

Real-World Example

Financial trading platforms use Kafka to process millions of market data updates and trade orders in real-time.

Cloud Provider Equivalencies

Kafka is an open-source distributed event streaming platform. AWS offers a managed Kafka service (MSK). Azure Event Hubs, Google Cloud Pub/Sub, and OCI Streaming are Kafka-like managed event streaming services; Azure Event Hubs also supports Kafka protocol clients. Confluent Cloud is a fully managed Kafka offering available on major clouds.

AWS
Amazon Managed Streaming for Apache Kafka (Amazon MSK)
AZ
Azure Event Hubs (Kafka endpoint) / Confluent Cloud on Azure
GCP
Cloud Pub/Sub / Confluent Cloud on Google Cloud
OCI
OCI Streaming

Explore More Cloud Computing Terms