Kafka Connect

69 articles

2025

18 Aug 2025 Kafka to Iceberg - Exploring the Options
Apache Iceberg
04 Jul 2025 Writing to Apache Iceberg on S3 using Kafka Connect with Glue catalog
Apache Iceberg
13 Mar 2025 Creating an HTTP Source connector on Confluent Cloud from the CLI
Confluent Cloud

2021

26 Mar 2021 Loading CSV data into Confluent Cloud using the FilePulse connector
Confluent Cloud
19 Mar 2021 Using ksqlDB to process data ingested from ActiveMQ with Kafka Connect
ActiveMQ
12 Mar 2021 Kafka Connect JDBC Sink deep-dive: Working with Primary Keys
Kafka Connect
11 Mar 2021 Kafka Connect - SQLSyntaxErrorException: BLOB/TEXT column … used in key specification without a key length
Kafka Connect
11 Jan 2021 Running a self-managed Kafka Connect worker for Confluent Cloud
Kafka Connect
06 Jan 2021 Creating topics with Kafka Connect
Kafka Connect
04 Jan 2021 Kafka Connect - Deep Dive into Single Message Transforms
Kafka Connect

2020

23 Dec 2020 🎄 Twelve Days of SMT 🎄 - Day 12: Community Transformations
Kafka Connect
22 Dec 2020 🎄 Twelve Days of SMT 🎄 - Day 11: Predicate and Filter
Kafka Connect
21 Dec 2020 🎄 Twelve Days of SMT 🎄 - Day 10: ReplaceField
Kafka Connect
18 Dec 2020 🎄 Twelve Days of SMT 🎄 - Day 9: Cast
Kafka Connect
17 Dec 2020 🎄 Twelve Days of SMT 🎄 - Day 8: TimestampConverter
Kafka Connect
16 Dec 2020 🎄 Twelve Days of SMT 🎄 - Day 7: TimestampRouter
Kafka Connect
15 Dec 2020 🎄 Twelve Days of SMT 🎄 - Day 6: InsertField II
Kafka Connect
14 Dec 2020 🎄 Twelve Days of SMT 🎄 - Day 5: MaskField
Kafka Connect
11 Dec 2020 🎄 Twelve Days of SMT 🎄 - Day 4: RegExRouter
Kafka Connect
10 Dec 2020 🎄 Twelve Days of SMT 🎄 - Day 3: Flatten
Kafka Connect
09 Dec 2020 🎄 Twelve Days of SMT 🎄 - Day 2: ValueToKey and ExtractField
Kafka Connect
08 Dec 2020 🎄 Twelve Days of SMT 🎄 - Day 1: InsertField (timestamp)
Kafka Connect
03 Nov 2020 Kafka Connect, ksqlDB, and Kafka Tombstone messages
Kafka
03 Nov 2020 Streaming Geopoint data from Kafka to Elasticsearch
Kafka Connect
05 Oct 2020 Streaming XML messages from IBM MQ into Kafka into MongoDB
XML
01 Oct 2020 Ingesting XML data into Kafka - Option 3: Kafka Connect FilePulse connector
XML
01 Oct 2020 Ingesting XML data into Kafka - Option 2: Kafka Connect plus Single Message Transform
XML
11 Sep 2020 What is Kafka Connect?
Kafka Connect
19 Jun 2020 How to install connector plugins in Kafka Connect
Kafka Connect
17 Jun 2020 Loading CSV data into Kafka
Kafka Connect
25 Feb 2020 Kafka Connect JDBC Sink - setting the key field name
Kafka Connect
07 Feb 2020 Primitive Keys in ksqlDB
ksqlDB
23 Jan 2020 Notes on getting data into InfluxDB from Kafka with Kafka Connect
Kafka Connect
22 Jan 2020 Kafka Connect and Schemas
Kafka Connect
21 Jan 2020 Monitoring Sonos with ksqlDB, InfluxDB, and Grafana
ksqlDB
16 Jan 2020 Changing the Logging Level for Kafka Connect Dynamically
Kafka Connect
08 Jan 2020 Streaming messages from RabbitMQ into Kafka with Kafka Connect
RabbitMQ

2019

20 Dec 2019 Analysing network behaviour with ksqlDB and MongoDB
Kafka
18 Dec 2019 Detecting and Analysing SSH Attacks with ksqlDB
Kafka
29 Nov 2019 Kafka Connect - Request timed out
Kafka Connect
22 Nov 2019 Common mistakes made when configuring multiple Kafka Connect workers
Kafka Connect
20 Nov 2019 Streaming data from SQL Server to Kafka to Snowflake ❄️ with Kafka Connect
Kafka Connect
12 Nov 2019 Running Dockerised Kafka Connect worker on GCP
Kafka Connect
16 Oct 2019 Using Kafka Connect and Debezium with Confluent Cloud
Kafka Connect
15 Oct 2019 Skipping bad records with the Kafka Connect JDBC sink connector
Kafka Connect
07 Oct 2019 Kafka Connect and Elasticsearch
Kafka Connect
15 Aug 2019 Reset Kafka Connect Source Connector Offsets
Kafka Connect
09 Aug 2019 Starting a Kafka Connect sink connector at the end of a topic
Kafka Connect
09 Aug 2019 Resetting a Consumer Group in Kafka
Kafka Connect
23 Jun 2019 Manually delete a connector from Kafka Connect
Kafka Connect
06 Jun 2019 Automatically restarting failed Kafka Connect tasks
Kafka Connect
24 May 2019 Putting Kafka Connect passwords in a separate file / externalising secrets
Kafka Connect
22 May 2019 Deleting a Connector in Kafka Connect without the REST API
Kafka Connect
08 May 2019 When a Kafka Connect converter is not a converter
Kafka Connect
02 May 2019 Reading Kafka Connect Offsets via the REST Proxy
Kafka Connect
29 Jan 2019 Kafka Connect Change Log Level and Write Log to File
Kafka Connect

2018

15 Dec 2018 Docker Tips and Tricks with Kafka Connect, ksqlDB, and Kafka
docker
03 Dec 2018 Kafka Connect CLI tricks
kafka connect
21 May 2018 Kafka Connect and Oracle data types
kafka connect
27 Mar 2018 Streaming Data from MongoDB into Kafka with Kafka Connect and Debezium
mongodb
24 Mar 2018 Streaming Data from MySQL into Kafka with Kafka Connect and Debezium
debezium
06 Mar 2018 Streaming data from Kafka into Elasticsearch
kafka connect

2017

12 Sep 2017 Oracle GoldenGate / Kafka Connect Handler troubleshooting
goldengate
06 Sep 2017 Kafka Connect - JsonDeserializer with schemas.enable requires “schema” and “payload” fields
kafka connect
12 Jun 2017 Configuring Kafka Connect to log REST HTTP messages to a separate file
Apache Kafka

2016

29 Nov 2016 Oracle GoldenGate -> Kafka Connect - “Failed to serialize Avro data”
ogg
24 Nov 2016 Kafka Connect - java.lang.IncompatibleClassChangeError
Apache Kafka
27 Jul 2016 Kafka Connect JDBC - Oracle - Number of groups must be positive
Apache Kafka
19 Jul 2016 Kafka Connect - HDFS with Hive Integration - SchemaProjectorException - Schema version required
Apache Kafka