A guide comparing Apache Flink SQL, Kafka Connect, and Confluent Tableflow for moving data from Apache Kafka to Apache Iceberg tables.
A technical guide on using Kafka Connect to write data from Kafka topics to Apache Iceberg tables stored on AWS S3, using the Glue Data Catalog.
A tutorial on setting up an HTTP Source connector for Kafka on Confluent Cloud using the command-line interface (CLI).
Explores challenges of running Kafka Connect on Kubernetes and proposes a vision for a more Kubernetes-native architecture.
Explores challenges of running Kafka Connect on Kubernetes and proposes a vision for a more Kubernetes-native architecture.
A guide to testing custom Kafka Connect source connectors, covering unit and integration testing strategies with code examples.
A guide to testing custom Kafka Connect source connectors, covering unit and integration testing strategies with code examples.
An analysis of key trends in the Apache Kafka ecosystem, including connector growth, self-service data pipelines, and stream processing adoption.
An analysis of current trends in the Apache Kafka ecosystem, focusing on connector growth, self-service data pipelines, and stream processing adoption.
A technical guide on using the FilePulse connector to stream CSV data into a Kafka topic on Confluent Cloud.
A technical guide on using ksqlDB to process and transform complex JSON data from ActiveMQ via Kafka Connect, including array splitting.
A technical deep-dive into how the Kafka Connect JDBC Sink connector handles primary keys for database operations like upserts and deletes.
Troubleshooting a Kafka Connect JDBC Sink error where a TEXT/BLOB column is used as a primary key in MySQL without specifying a key length.
Guide to deploying a self-managed Kafka Connect worker with Docker to integrate custom connectors with Confluent Cloud.
How to configure Kafka Connect to automatically create and customize topics for source connectors, including partition and replication settings.
A deep dive into Kafka Connect's Single Message Transforms (SMT), exploring their use for data manipulation within the pipeline.
Final part of a series exploring community-built Single Message Transformations (SMTs) for Apache Kafka Connect, highlighting useful plugins.
Explains how to use Kafka Connect predicates and the Filter SMT to conditionally transform and drop messages, with a practical example of field renaming.
Explains how to use Kafka Connect's ReplaceField Single Message Transform to include, exclude, or rename fields in data streams.
Explains how to use the Cast Single Message Transform in Kafka Connect to change data types of fields in Kafka messages.
