Explains how to use Kafka Connect's TimestampConverter SMT to transform timestamp fields between string and native types for proper data handling.
Explains how to use Kafka Connect's TimestampRouter SMT to dynamically route messages to time-partitioned topics based on message timestamps.
Day 6 of a series on Kafka Connect Single Message Transforms, focusing on using InsertField to add static values and Kafka metadata to messages.
Explains how to use Kafka Connect's MaskField Single Message Transform to mask sensitive data fields like credit card numbers during data ingestion.
Explains how to use Kafka Connect's RegExRouter SMT to rename topics for source connectors and target objects for sink connectors.
Explains how to use the Flatten Single Message Transform (SMT) in Kafka Connect to convert nested JSON data into a flat structure for database insertion.
Explains how to use Kafka Connect's ValueToKey and ExtractField Single Message Transforms to set message keys from data fields.
Explains how to use Kafka Connect's InsertField Single Message Transform (SMT) to add message timestamps to data sent to a sink.
A technical guide on using Kafka tombstone messages with Kafka Connect and ksqlDB to handle logical deletions from a PostgreSQL source to Elasticsearch.
Tutorial on streaming geolocation data from Kafka to Elasticsearch, covering mapping and data formatting using ksqlDB.
A technical guide on streaming XML data from IBM MQ to Kafka, transforming it, and then loading it into MongoDB using Kafka Connect.
Explores using the Kafka Connect FilePulse connector to ingest and process XML data into Apache Kafka, including configuration and troubleshooting.
A technical guide on using Kafka Connect with Single Message Transform to ingest and process XML data into Apache Kafka.
Introduction to ingesting XML data into Kafka, covering challenges and approaches for handling XML schemas in Kafka topics.
A curated collection of Apache Kafka and ksqlDB talks, including recordings, slides, and code examples for building streaming data pipelines.
A technical guide on setting up ksqlDB with embedded Kafka Connect to ingest CDC events from MS SQL Server using the Debezium connector via Docker Compose.
An overview of Kafka Connect, Apache Kafka's integration API, covering its features, resources, and use cases for data pipelines.
Explains the difference between JSON and JSON Schema serialization in Kafka Connect, showing the extra bytes in the wire format using hexdump.
A guide to installing connector plugins in Kafka Connect, covering manual and automated methods using Confluent Hub.
A technical guide on using Kafka Connect's SpoolDir connector to load CSV data into Apache Kafka, covering schema application and configuration.
