Why Do We Need Streaming ETL?
Explains the shift from traditional batch ETL to real-time streaming ETL using Apache Kafka for lower latency data integration and analytics.
Robin Moffatt is a Principal DevEx Engineer and seasoned conference speaker with 15+ years of experience presenting at top events like QCon, Devoxx, Kafka Summit, and Strata. He shares insights on developer experience, distributed systems, and cloud technologies through his blog, YouTube, and public talks.
491 articles from this blog
Explains the shift from traditional batch ETL to real-time streaming ETL using Apache Kafka for lower latency data integration and analytics.
Step-by-step guide to integrate Oracle GoldenGate with Apache Kafka and Schema Registry for real-time data streaming from an Oracle database.
Troubleshooting a Kafka AdminClient connection error due to hostname/IP mismatch in a single-node setup.
A technical guide on installing and configuring Oracle GoldenGate for Big Data with Kafka Connect and Confluent Platform.
Author's schedule and list of Apache Kafka talks at Oracle OpenWorld and Oak Table World 2017 conferences.
A list of 19 Apache Kafka-related technical sessions at Oracle OpenWorld, JavaOne, and Oak Table World 2017 conferences.
Troubleshooting guide for resolving Oracle GoldenGate Kafka Connect Handler errors, focusing on schema registry and Avro serialization issues.
An introduction to Markdown, a plain-text formatting syntax used widely in software documentation, explaining its benefits and basic usage.
Author's 2017 speaking schedule for tech conferences and meetups, focusing on Apache Kafka and real-time data streaming.
Explains a common Kafka Connect error about JsonDeserializer requiring 'schema' and 'payload' fields and provides the solution.
A technical guide for exporting and importing Grafana data sources using curl, jq, and bash scripts.
Troubleshooting a USB disk connection error in Linux, specifically the 'uas: probe failed with error -12' issue on a Proxmox server.
Guide to separating Kafka Connect REST HTTP logs from stdout into a dedicated file using log4j configuration for easier troubleshooting.
A quick troubleshooting note about a common Apache Kafka console producer error caused by a misspelled property.
A software engineer's guide to managing the overwhelming flow of technical information and staying current in the tech industry.
A technical guide detailing the steps and troubleshooting for installing QEMU from source on an AWS EC2 Amazon Linux instance.
A technical guide on mounting VMDK/OVF/OVA virtual disk images on AWS EC2, covering conversion, partition mounting, and LVM setup.
Author announces leaving Rittman Mead after 5 years to join Confluent as a Partner Technology Evangelist for Apache Kafka.
Troubleshooting HBase failures after resuming a suspended VirtualBox VM running the BigDataLite OVA, with analysis of Zookeeper session expiration errors.
A technical guide on using Kibana Timelion's holt function for anomaly detection on system CPU metrics from Metricbeat data.