Counting the number of messages in a Kafka topic
Explores methods to count messages in a Kafka topic, comparing kafkacat commands with wc to ksqlDB for more detailed, grouped aggregations.
Robin Moffatt is a Principal DevEx Engineer and seasoned conference speaker with 15+ years of experience presenting at top events like QCon, Devoxx, Kafka Summit, and Strata. He shares insights on developer experience, distributed systems, and cloud technologies through his blog, YouTube, and public talks.
491 articles from this blog
Explores methods to count messages in a Kafka topic, comparing kafkacat commands with wc to ksqlDB for more detailed, grouped aggregations.
A technical guide on managing and cleaning up custom search engines in Google Chrome by directly manipulating its SQLite database.
Explains the BOT_COMMAND_INVALID error in Telegram bots, showing that commands must be lowercase when using the setMyCommands API.
A technical guide on processing chunked HTTP responses in Go to handle streaming JSON data from a database without waiting for EOF.
A developer shares their journey learning Go by building a utility to check Apache Kafka's advertised.listeners configuration for common issues.
A guide to organizing Go code by splitting functions into separate source files and building a standalone binary executable.
A developer's notes on learning Go by building a Kafka utility, focusing on error handling, command-line arguments, and goroutines.
Explores using the Kafka AdminClient API in Go, covering context usage for timeouts and basic cluster metadata operations.
A tutorial on implementing a function-based Kafka consumer in Go, moving from the deprecated channel-based approach.
A developer's notes on implementing a Kafka consumer in Go using the deprecated channel-based API, including code examples and termination patterns.
A technical guide on implementing error handling and type assertions for a Kafka producer written in Go.
A technical tutorial on creating a basic Kafka producer in Go, highlighting initial setup and code with minimal error handling.
A developer's journey learning to use the Go programming language with Apache Kafka, starting with the Confluent Go client.
A developer's notes on implementing a concurrent web crawler in Go, covering mutexes, wait groups, and avoiding duplicate URL fetching.
Explains the difference between JSON and JSON Schema serialization in Kafka Connect, showing the extra bytes in the wire format using hexdump.
A developer's personal notes and annotated examples while learning Go's concurrency features: channels, goroutines, and the select statement.
A technical walkthrough of implementing the image.Image interface in Go, covering ColorModel, Bounds, and At methods to generate a custom image.
A technical critique and tutorial on using Readers in Go, focusing on improving example code clarity for learners.
A developer's notes on learning error handling in Go, including code examples and explanations of common pitfalls.
A developer's personal notes and struggles while learning Go interfaces, including debugging a Stringer exercise from the official Go tour.