Lessons Learned from Running Apache Kafka at Scale at Pinterest
Apache Kafka® is at the heart of the data transportation layer at Pinterest. The amount of data that runs through Kafka has constantly grown over…
Read MoreLessons Learned from Running Apache Kafka at Scale at Pinterest
Keys in ksqlDB, Unlocked
One of the most highly requested enhancements to ksqlDB is here! Apache Kafka® messages may contain data in message keys as well as message values.…
42 Things You Can Stop Doing Once ZooKeeper Is Gone from Apache Kafka
Soon, Apache Kafka® will no longer need ZooKeeper! With KIP-500, Kafka will include its own built-in consensus layer, removing the ZooKeeper dependency altogether. The next…
Oracle CDC Source Premium Connector is Now Generally Available
One of the most common relational database systems that connects to Apache Kafka® is Oracle, which often holds highly critical enterprise transaction workloads. While Oracle…
Node.js ❤️ Apache Kafka – Getting Started with KafkaJS
One of the great things about using an Apache Kafka® based architecture is that it naturally decouples systems and allows you to use the best…
Introducing Confluent Platform 6.1
We are pleased to announce the release of Confluent Platform 6.1. With this release, we are further simplifying management tasks for Apache Kafka® operators and…
8 Years of Event Streaming with Apache Kafka
Since I first started using Apache Kafka® eight years ago, I went from being a student who had just heard about event streaming to contributing…
Putting Apache Kafka to REST: Confluent REST Proxy 6.0
Confluent Platform 6.0 was released last year bringing with it many exciting new features to Confluent REST Proxy. Before we dive into what was added,…
Implementing mTLS and Securing Apache Kafka at Zendesk
At Zendesk, Apache Kafka® is one of our foundational services for distributing events among different internal systems. We have pods, which can be thought of…
12 Days of Apache Kafka
We recently published a series of tutorial videos and tweets on the Apache Kafka® platform as we see it. After you hear that there’s a…
What’s New in Apache Kafka 2.7.0
I’m proud to announce the release of Apache Kafka 2.7.0 on behalf of the Apache Kafka® community. The 2.7.0 release contains many new features and…
Introducing the Confluent Parallel Consumer
Consuming messages in parallel is what Apache Kafka® is all about, so you may well wonder, why would we want anything else? It turns out…
Apache Kafka Lag Monitoring at AppsFlyer
This article covers one crucial piece of every distributed system: visibility. At AppsFlyer, we call ourselves metrics obsessed and truly believe that you cannot know…
IBM and Confluent Announce Strategic Partnership
I’m excited to announce a new strategic partnership with IBM. As part of this partnership, IBM will be reselling Confluent Platform, enabling its customers to…
Use Cases and Architectures for HTTP and REST APIs with Apache Kafka
The Confluent REST Proxy provides a RESTful interface to an Apache Kafka® cluster, making it easy to produce and consume messages, view the metadata of…