Introducing the Confluent Parallel Consumer
Consuming messages in parallel is what Apache Kafka® is all about, so you may well wonder, why would we want anything else? It turns out…
Read More
Apache Kafka Lag Monitoring at AppsFlyer
This article covers one crucial piece of every distributed system: visibility. At AppsFlyer, we call ourselves metrics obsessed and truly believe that you cannot know…
IBM and Confluent Announce Strategic Partnership
I’m excited to announce a new strategic partnership with IBM. As part of this partnership, IBM will be reselling Confluent Platform, enabling its customers to…
Use Cases and Architectures for HTTP and REST APIs with Apache Kafka
The Confluent REST Proxy provides a RESTful interface to an Apache Kafka® cluster, making it easy to produce and consume messages, view the metadata of…
Analysing historical and live data with ksqlDB and Elastic Cloud
Building data pipelines isn’t always straightforward. The gap between the shiny “hello world” examples of demos and the gritty reality of messy data and imperfect…
Building Streaming Data Architectures with Qlik Replicate and Apache Kafka
A fundamental challenge with today’s “data explosion” is finding the best answer to the question, “So where do I put my data?” while avoiding the…
How Real-Time Materialized Views Work with ksqlDB (Animated)
All around the world, companies are asking the same question: What is happening right now? We are inundated with pieces of data that have a…
Intrusion Detection with ksqlDB
Apache Kafka® is a distributed real-time processing platform that allows for the ingestion of huge volumes of data. ksqlDB is part of the Kafka ecosystem…
Bounding ksqlDB Memory Usage
It’s important to be able to limit memory consumption of a running service. Use too much, and your application will crash and need to restart.…
Top 5 Things Every Apache Kafka Developer Should Know
Apache Kafka® is an event streaming platform used by more than 30% of the Fortune 500 today. There are numerous features of Kafka that make…
Introducing Cluster Linking in Confluent Platform 6.0
With the release of Confluent Platform 6.0 comes a preview of Confluent Cluster Linking available to self-managed customers and in Confluent Cloud for our early…
Restoring Balance to the Cluster: Self-Balancing Clusters in Confluent Platform 6.0
Apache Kafka® scales well. A Kafka cluster can grow to tens or hundreds of brokers and easily sustain tens of GB per second of read…
ksqlDB Meets Java: An IoT-Inspired Demo of the Java Client for ksqlDB
Stream processing applications, including streaming ETL pipelines, materialized caches, and event-driven microservices, are made easy with ksqlDB. Until recently, your options for interacting with ksqlDB…
Introducing Confluent Platform 6.0
Each month, we’ve announced a set of Confluent features organized around what we think are the key foundational traits of cloud-native data systems as part…
Building a Machine Learning Logging Pipeline with Kafka Streams at Twitter
Twitter, one of the most popular social media platforms today, is well known for its ever-changing environment—user behaviors evolve quickly; trends are dynamic and versatile;…