Analysing historical and live data with ksqlDB and Elastic Cloud
Building data pipelines isn’t always straightforward. The gap between the shiny “hello world” examples of demos and the gritty reality of messy data and imperfect…
Read MoreAnalysing historical and live data with ksqlDB and Elastic Cloud
Building Streaming Data Architectures with Qlik Replicate and Apache Kafka
A fundamental challenge with today’s “data explosion” is finding the best answer to the question, “So where do I put my data?” while avoiding the…
How Real-Time Materialized Views Work with ksqlDB (Animated)
All around the world, companies are asking the same question: What is happening right now? We are inundated with pieces of data that have a…
Intrusion Detection with ksqlDB
Apache Kafka® is a distributed real-time processing platform that allows for the ingestion of huge volumes of data. ksqlDB is part of the Kafka ecosystem…
Bounding ksqlDB Memory Usage
It’s important to be able to limit memory consumption of a running service. Use too much, and your application will crash and need to restart.…
Top 5 Things Every Apache Kafka Developer Should Know
Apache Kafka® is an event streaming platform used by more than 30% of the Fortune 500 today. There are numerous features of Kafka that make…
Introducing Cluster Linking in Confluent Platform 6.0
With the release of Confluent Platform 6.0 comes a preview of Confluent Cluster Linking available to self-managed customers and in Confluent Cloud for our early…
Restoring Balance to the Cluster: Self-Balancing Clusters in Confluent Platform 6.0
Apache Kafka® scales well. A Kafka cluster can grow to tens or hundreds of brokers and easily sustain tens of GB per second of read…
ksqlDB Meets Java: An IoT-Inspired Demo of the Java Client for ksqlDB
Stream processing applications, including streaming ETL pipelines, materialized caches, and event-driven microservices, are made easy with ksqlDB. Until recently, your options for interacting with ksqlDB…
Introducing Confluent Platform 6.0
Each month, we’ve announced a set of Confluent features organized around what we think are the key foundational traits of cloud-native data systems as part…
Building a Machine Learning Logging Pipeline with Kafka Streams at Twitter
Twitter, one of the most popular social media platforms today, is well known for its ever-changing environment—user behaviors evolve quickly; trends are dynamic and versatile;…
Apache Kafka DevOps with Kubernetes and GitOps
Operating critical Apache Kafka® event streaming applications in production requires sound automation and engineering practices. Streaming applications are often at the center of your transaction…
Infrastructure Modernization with Google Anthos and Apache Kafka
The promise of cloud computing is simplicity, speed, and cost savings. But what about workloads that can’t move to the cloud? Are they stuck using…
Streaming Data from Apache Kafka into Azure Data Explorer with Kafka Connect
Near-real-time insights have become a de facto requirement for Azure use cases involving scalable log analytics, time series analytics, and IoT/telemetry analytics. Azure Data Explorer…
Bulletproof Kafka, and the tale of an Amazon outage
On August 25th, one of our customers, who was using Supertubes to operate Kafka clusters on Kubernetes on Amazon, began to experience a service disruption…