Why Is My Apache Flink® Job Not Producing Results?
Learn how watermarks affect Flink jobs and common pitfalls, including idle streams/partitions, watermark strategy issues, etc., which can cause a job to not produce any…
Read MoreWhy Is My Apache Flink® Job Not Producing Results?
Beyond Boundaries: Leveraging Confluent for Secure Inter-Organizational Data Sharing
Discover how Confluent enables secure inter-organizational data sharing to maximize data value, strengthen partnerships, and meet regulatory requirements in real time. This post first appeared…
Unlocking Data Insights with Confluent Tableflow: Querying Apache Iceberg™️ Tables with Jupyter Notebooks
Learn how to integrate Confluent Tableflow with Trino to query Apache Iceberg tables, and unlock real-time and historical analytics with Jupyter Notebooks This post first…
Chopped: AI Edition – Building a Meal Planner
Learn how to build an event-driven architecture that coordinates a team of four family-meal-planning agents, and leverages LangChain, Anthropic’s Claude, Kafka, and Flink. This post…
The AI Silo Problem: How Data Streaming Can Unify Enterprise AI Agents
To solve the AI silo problem, enterprises need a shared communication layer for AI agents—a real-time, event-driven approach that lets agents share intelligence and take…
Shifting Left: How Data Contracts Underpin People, Processes, and Technology
Application engineers situated at the beginning of a data pipeline (“left side”) should apply data contracts and products as rigorously as the data engineers further…
How the Singapore Government is Building Agility to Enhance Citizen Services with IMDA’s Tech Acceleration Lab and the Government Commercial Cloud+
Singapore’s Tech Acceleration Lab helps other government agencies modernize by onboarding them to a streaming-capable government cloud, which features Confluent as a key vendor. This…
Optimizing Serverless Stream Processing with Confluent Freight Clusters and AWS Lambda
Freight Clusters are ideal for high-throughput, relaxed latency workloads like telemetry and logging. Combine them with AWS Lambda for a serverless, cost-effective, data pipeline. This…
Kora: The Cloud Native Engine for Apache Kafka
Kora is a cloud data service that serves up the Kafka protocol for our thousands of customers and their tens of thousands of clusters.
Diagnose and Debug Apache Kafka Issues: Understanding Reduced Message Throughput
When you encounter a problem with Apache Kafka®—for example, an exploding number of connections to your brokers or perhaps some wonky record batching—it’s easy to…
An Introduction to Apache Kafka Security: Securing Real-Time Data Streams
There are some basic requirements before you can get started securing your Kafka system. You first need a basic familiarity with authentication, authorization, encryption, and…
Introduction to Streaming Data Pipelines with Apache Kafka and ksqlDB
A data pipeline is a method for getting data from one system to another, whether for analytics purposes or for storage. Learning the elements that…
What’s New in Apache Kafka 3.1.0
On behalf of the Apache Kafka® community, it is my pleasure to announce the release of Apache Kafka 3.1.0. The 3.1.0 release contains many improvements…
Real-Time Log Analytics as a Service with Confluent and Elasticsearch
Collecting and indexing logs from servers, applications, and devices enables crucial visibility into running systems. A log analytics pipeline allows teams to debug and troubleshoot…
Building Real-Time Hybrid Architectures with Cluster Linking and Confluent Platform 7.0
Companies are increasingly moving to the cloud, undergoing a transition that is often a multi-year journey across incremental stages. Along this journey, many companies embrace…