Robin Moffatt • 9/30/2020

Setting key value when piping from jq to kafkacat

This article explains a method for setting the key in Kafka messages when streaming data from jq to kafkacat. It details using a single-byte separator character (like a NULL byte) with kafkacat's -K parameter to delineate key and value, ensuring proper partitioning and data processing. The tutorial includes a practical example with JSON order data, showing commands for publishing and consuming messages with defined keys.

0 comments

#command line #Kafka #Jq