Robin Moffatt 1/6/2021

Creating topics with Kafka Connect

Read Original

This technical article explains how Kafka Connect can automatically create topics when ingesting data, a feature added in Apache Kafka 2.6. It details the necessary worker and connector configurations (like topic.creation.enable and default partition/replication settings) and covers how to customize advanced topic-level properties such as cleanup.policy and compression.type for connectors that generate dynamic topics.

Creating topics with Kafka Connect

Comments

No comments yet

Be the first to share your thoughts!

Browser Extension

Get instant access to AllDevBlogs from your browser

Top of the Week

1
The Beautiful Web
Jens Oliver Meiert 2 votes
3
LLM Use in the Python Source Code
Miguel Grinberg 1 votes
4
Wagon’s algorithm in Python
John D. Cook 1 votes