Sending Messages to Kafka in Kubernetes
Today I am going to show you how to do the opposite, how to produce messages into Kafka aka how to send Messages to a…
Read MoreSending Messages to Kafka in Kubernetes
Crossing the Streams: The New Streaming Foreign-Key Join Feature in Kafka Streams
Companies adopt streaming data and Apache Kafka® because it provides them with real-time information about their business and customers. In practice, the challenge is that…
How to Better Manage Apache Kafka by Creating Kafka Messages from within Control Center
Managing Apache Kafka® clusters can be tricky sometimes. To solve this problem, Confluent Control Center helps you easily manage and monitor your clusters and interact…
Error Handling Patterns for Apache Kafka Applications
Apache Kafka® applications run in a distributed manner across multiple containers or machines. And in the world of distributed systems, what can go wrong often…
Announcing ksqlDB 0.17.0
We’re excited to announce ksqlDB 0.17, a big release for 2021. This version adds support for managing the lifecycle of your queries from CI servers,…
How to Survive an Apache Kafka Outage
There is a class of applications that cannot afford to be unavailable—for example, external-facing entry points into your organization. Typically, anything your customers interact with…
What’s New in Apache Kafka 2.8
I’m proud to announce the release of Apache Kafka 2.8.0 on behalf of the Apache Kafka® community. The 2.8.0 release contains many new features and…
Building the Confluent UI with React Hooks – Benefits and Lessons Learned
Updating a fundamental paradigm in your React app can be as easy as search and replace, or at other times, as difficult as convincing your…
Debuting a Modern C++ API for Apache Kafka
Morgan Stanley uses Apache Kafka to publish market data to internal clients and to persist it for replay purposes. We started out using librdkafka’s C++…
Apache Kafka Made Simple: A First Glimpse of a Kafka Without ZooKeeper
At the heart of Apache Kafka® sits the log—a simple data structure that uses sequential operations that work symbiotically with the underlying hardware. Efficient disk…
Under the Hood of Real-Time Analytics with Apache Kafka and Pinot
Real-time analytics has become the need of the hour for modern internet companies. The ability to derive internal insights around business metrics, user growth and…
To Pull or to Push Your Data with Kafka Connect ? That Is the Question.
Today, every company is a data company. There are many different data pipeline, integration, and ingestion tools in the market, but before you can feed…
Lessons Learned from Running Apache Kafka at Scale at Pinterest
Apache Kafka® is at the heart of the data transportation layer at Pinterest. The amount of data that runs through Kafka has constantly grown over…
Keys in ksqlDB, Unlocked
One of the most highly requested enhancements to ksqlDB is here! Apache Kafka® messages may contain data in message keys as well as message values.…
42 Things You Can Stop Doing Once ZooKeeper Is Gone from Apache Kafka
Soon, Apache Kafka® will no longer need ZooKeeper! With KIP-500, Kafka will include its own built-in consensus layer, removing the ZooKeeper dependency altogether. The next…