Restoring Balance to the Cluster: Self-Balancing Clusters in Confluent Platform 6.0
Apache Kafka® scales well. A Kafka cluster can grow to tens or hundreds of brokers and easily sustain tens of GB per second of read…
Read MoreRestoring Balance to the Cluster: Self-Balancing Clusters in Confluent Platform 6.0
ksqlDB Meets Java: An IoT-Inspired Demo of the Java Client for ksqlDB
Stream processing applications, including streaming ETL pipelines, materialized caches, and event-driven microservices, are made easy with ksqlDB. Until recently, your options for interacting with ksqlDB…
Introducing Confluent Platform 6.0
Each month, we’ve announced a set of Confluent features organized around what we think are the key foundational traits of cloud-native data systems as part…
Building a Machine Learning Logging Pipeline with Kafka Streams at Twitter
Twitter, one of the most popular social media platforms today, is well known for its ever-changing environment—user behaviors evolve quickly; trends are dynamic and versatile;…
Apache Kafka DevOps with Kubernetes and GitOps
Operating critical Apache Kafka® event streaming applications in production requires sound automation and engineering practices. Streaming applications are often at the center of your transaction…
Infrastructure Modernization with Google Anthos and Apache Kafka
The promise of cloud computing is simplicity, speed, and cost savings. But what about workloads that can’t move to the cloud? Are they stuck using…
Streaming Data from Apache Kafka into Azure Data Explorer with Kafka Connect
Near-real-time insights have become a de facto requirement for Azure use cases involving scalable log analytics, time series analytics, and IoT/telemetry analytics. Azure Data Explorer…
Bulletproof Kafka, and the tale of an Amazon outage
On August 25th, one of our customers, who was using Supertubes to operate Kafka clusters on Kubernetes on Amazon, began to experience a service disruption…
Benchmarking Apache Kafka, Apache Pulsar, and RabbitMQ: Which is the Fastest?
Apache Kafka is one of the most popular event streaming systems. There are many ways to compare systems in this space, but one thing everyone…
Testing Kafka Streams – A Deep Dive
Tools for automated testing of Kafka Streams applications have been available to developers ever since the technology’s genesis. Although these tools are very useful in…
Streaming Heterogeneous Databases with Kafka Connect – The Easy Way
Building a Cloud ETL Pipeline on Confluent Cloud shows you how to build and deploy a data pipeline entirely in the cloud. However, not all…
What’s New in Apache Kafka 2.6
On behalf of the Apache Kafka® community, it is my pleasure to announce the release of Apache Kafka 2.6.0. This another exciting release with many…