Creating an HTTP Source connector on Confluent Cloud from the CLI
A tutorial on setting up an HTTP Source connector for Kafka on Confluent Cloud using the command-line interface (CLI).
Robin Moffatt is a Principal DevEx Engineer and seasoned conference speaker with 15+ years of experience presenting at top events like QCon, Devoxx, Kafka Summit, and Strata. He shares insights on developer experience, distributed systems, and cloud technologies through his blog, YouTube, and public talks.
491 articles from this blog
A tutorial on setting up an HTTP Source connector for Kafka on Confluent Cloud using the command-line interface (CLI).
Explains why kcat (kafkacat) may show incorrect Kafka topics due to config file priority overriding CLI arguments.
A developer argues for writing blog posts about the messy, real-world problem-solving process, not just polished 'happy path' tutorials.
A technical tutorial on using Apache Flink SQL to explore and process real-time flood monitoring data from a government API, demonstrating data wrangling techniques.
A technical guide on joining two data streams using Apache Flink SQL, including code examples and practical considerations.
A technical tutorial on using the UNNEST operator in Flink SQL to explode nested arrays of sensor data into separate rows.
A technical walkthrough of loading and exploring UK Environment Agency flood data using DuckDB and Rill for a streaming pipeline project.
How to use DuckDB's COLUMNS expression to automatically rename fields when using SELECT * across joined tables, avoiding ambiguous column names.
A monthly roundup of interesting links and articles about data engineering, databases, streaming tech, and data infrastructure.
Monthly roundup of news and resources in data streaming, stream processing, and the Apache Kafka ecosystem, curated by industry experts.
A guide on how to selectively disable Vale prose linting for specific sections within AsciiDoc documents, explaining two methods and common pitfalls.
An overview of Apache Flink CDC, its declarative pipeline feature, and how it simplifies data integration from databases like MySQL to sinks like Elasticsearch.
Monthly roundup of news and developments in data streaming, stream processing, and the data ecosystem, featuring Apache Flink, Kafka, and open-source tools.
Explores the core reasons for using Change Data Capture (CDC) to extract data from operational databases for analytics and other applications.
A monthly roundup of news, talks, and developments in data streaming, Apache Flink, Kafka, and related technologies from September 2024.
A recap of the 2024 Current conference on data streaming, covering keynotes, product updates, and talks on Apache Flink and related technologies.
A technical guide on configuring Apache Flink to write data to Delta Lake tables stored on S3, including required JARs and configuration steps.
A technical guide on troubleshooting S3 connectivity issues in Apache Flink SQL, focusing on configuration and common pitfalls.
A technical guide on using Apache Flink SQL to stream data from Apache Kafka into Apache Iceberg tables, including code examples.
A monthly roundup of news, articles, and developments in data streaming, stream processing, and related technologies like Apache Kafka, Flink, and Paimon.