Robin Moffatt • 10/1/2020

Ingesting XML data into Kafka - Option 2: Kafka Connect plus Single Message Transform

This article provides a detailed tutorial on building a streaming ingestion pipeline for XML data into Apache Kafka. It explains how to use Kafka Connect with a source connector and a Single Message Transform (SMT) to parse XML using an XSD schema, and serialize the data into Avro format for storage in a Kafka topic. The guide includes a practical Docker-based example with configuration code.

0 comments

#xml #Kafka Connect #Data Ingestion