Chopped: AI Edition – Building a Meal Planner
Learn how to build an event-driven architecture that coordinates a team of four family-meal-planning agents, and leverages LangChain, Anthropic’s Claude, Kafka, and Flink. This post…
Read MoreChopped: AI Edition – Building a Meal Planner
The AI Silo Problem: How Data Streaming Can Unify Enterprise AI Agents
To solve the AI silo problem, enterprises need a shared communication layer for AI agents—a real-time, event-driven approach that lets agents share intelligence and take…
Shifting Left: How Data Contracts Underpin People, Processes, and Technology
Application engineers situated at the beginning of a data pipeline (“left side”) should apply data contracts and products as rigorously as the data engineers further…
How the Singapore Government is Building Agility to Enhance Citizen Services with IMDA’s Tech Acceleration Lab and the Government Commercial Cloud+
Singapore’s Tech Acceleration Lab helps other government agencies modernize by onboarding them to a streaming-capable government cloud, which features Confluent as a key vendor. This…
Optimizing Serverless Stream Processing with Confluent Freight Clusters and AWS Lambda
Freight Clusters are ideal for high-throughput, relaxed latency workloads like telemetry and logging. Combine them with AWS Lambda for a serverless, cost-effective, data pipeline. This…
Kora: The Cloud Native Engine for Apache Kafka
Kora is a cloud data service that serves up the Kafka protocol for our thousands of customers and their tens of thousands of clusters.
Diagnose and Debug Apache Kafka Issues: Understanding Reduced Message Throughput
When you encounter a problem with Apache Kafka®—for example, an exploding number of connections to your brokers or perhaps some wonky record batching—it’s easy to…
An Introduction to Apache Kafka Security: Securing Real-Time Data Streams
There are some basic requirements before you can get started securing your Kafka system. You first need a basic familiarity with authentication, authorization, encryption, and…
Introduction to Streaming Data Pipelines with Apache Kafka and ksqlDB
A data pipeline is a method for getting data from one system to another, whether for analytics purposes or for storage. Learning the elements that…
What’s New in Apache Kafka 3.1.0
On behalf of the Apache Kafka® community, it is my pleasure to announce the release of Apache Kafka 3.1.0. The 3.1.0 release contains many improvements…
Real-Time Log Analytics as a Service with Confluent and Elasticsearch
Collecting and indexing logs from servers, applications, and devices enables crucial visibility into running systems. A log analytics pipeline allows teams to debug and troubleshoot…
Building Real-Time Hybrid Architectures with Cluster Linking and Confluent Platform 7.0
Companies are increasingly moving to the cloud, undergoing a transition that is often a multi-year journey across incremental stages. Along this journey, many companies embrace…
Getting Started with GraphQL and Apache Kafka
GraphQL and Apache Kafka are sometimes troubled with misconceptions. One of the reasons for this is that people are often familiar with one but not…
Tyrannical Data and Its Antidotes in the Microservices World
Data is the lifeblood of so much of what we build as software professionals, so it’s unsurprising that operations involving its transfer occupy the vast…
Create a Data Analysis Pipeline with Apache Kafka and RStudio
In Data Science projects, we distinguish between descriptive analytics and statistical models running in production. Overall, these can be seen as one process. You start…