rmoff's random ramblings

05 Apr 2023 · PySpark

Using Delta from pySpark - `java.lang.ClassNotFoundException: delta.DefaultSource`

No great insights in this post, just something for folk who Google this error after me and don’t want to waste three hours chasing their tails… 😄

14 Mar 2023 Quickly Convert CSV to Parquet with DuckDB
DuckDB
03 Mar 2023 Making the move from Alfred to Raycast
Alfred
03 Mar 2023 Aligning mismatched Parquet schemas in DuckDB
DuckDB
09 Dec 2022 Looking Forwards, and Looking Backwards
Career
08 Nov 2022 Data Engineering in 2022: ELT tools
ELT
24 Oct 2022 Data Engineering in 2022: Wrangling the feedback data from Current 22 with dbt
dbt
20 Oct 2022 Data Engineering in 2022: Exploring dbt with DuckDB
Data Engineering
14 Oct 2022 Current 22 - Session Analysis with DuckDB and Jupyter Notebook
DuckDB
02 Oct 2022 Data Engineering in 2022: Architectures & Terminology
Data Engineering
26 Sep 2022 Current 2022 - 5k Fun Run
Kafka Summit
16 Sep 2022 Data Engineering in 2022: Exploring LakeFS with Jupyter and PySpark
Data Engineering
14 Sep 2022 Data Engineering: Resources
Data Engineering
14 Sep 2022 Data Engineering in 2022: Storage and Access
Data Engineering
14 Sep 2022 Stretching my Legs in the Data Engineering Ecosystem in 2022
Data Engineering
12 Sep 2022 Customising the fields shown in Airtable’s Calendar .ics export
Airtable
31 Aug 2022 Inside the Sausage Factory: How we Built the Program for Current 2022
DevRel
31 Aug 2022 ⚡️ Writing an abstract for a lightning talk ⚡️
DevRel
20 Jul 2022 How to Write a Good Tech Conference Abstract - Learn from the Mistakes of Others
DevRel
07 Apr 2022 Remote-First Developer Advocacy
DevRel
07 Apr 2022 Hanging up my Boarding Passes and Jetlag…for now
DevRel
06 Apr 2022 Using GitHub Actions to build automagic Hugo previews of draft articles
Hugo
05 Apr 2022 🏃🚶 The unofficial Kafka Summit London 2022 Run/Walk 🏃🚶
Kafka Summit
29 Jul 2021 My Favourite Tools on the Mac (Setting up a new Mac)
Productivity
29 Jul 2021 Why I use Alfred App (and maybe you should too)
Productivity
01 Apr 2021 A bash script to deploy ksqlDB queries automagically
ksqlDB
26 Mar 2021 Loading CSV data into Confluent Cloud using the FilePulse connector
Confluent Cloud
24 Mar 2021 Connecting to managed ksqlDB in Confluent Cloud with REST and ksqlDB CLI
ksqlDB
19 Mar 2021 Using ksqlDB to process data ingested from ActiveMQ with Kafka Connect
ActiveMQ
12 Mar 2021 Kafka Connect JDBC Sink deep-dive: Working with Primary Keys
Kafka Connect
11 Mar 2021 Kafka Connect - SQLSyntaxErrorException: BLOB/TEXT column … used in key specification without a key length
Kafka Connect
04 Mar 2021 Quick profiling of data in Apache Kafka using kafkacat and visidata
Data
04 Mar 2021 Using Open Sea Map data in Kibana maps
Kibana
26 Feb 2021 Loading delimited data into Kafka - quick & dirty (but effective)
kcat (kafkacat)
17 Feb 2021 📼 ksqlDB HOWTO - A mini video series 📼
ksqlDB
02 Feb 2021 Performing a GROUP BY on data in bash
Data Engineering
13 Jan 2021 Running as root on Docker images that don’t use root
oracle
11 Jan 2021 Running a self-managed Kafka Connect worker for Confluent Cloud
Kafka Connect
06 Jan 2021 Creating topics with Kafka Connect
Kafka Connect
04 Jan 2021 Kafka Connect - Deep Dive into Single Message Transforms
Kafka Connect
23 Dec 2020 🎄 Twelve Days of SMT 🎄 - Day 12: Community Transformations
Kafka Connect
22 Dec 2020 🎄 Twelve Days of SMT 🎄 - Day 11: Predicate and Filter
Kafka Connect
21 Dec 2020 🎄 Twelve Days of SMT 🎄 - Day 10: ReplaceField
Kafka Connect
20 Dec 2020 Scheduling Hugo Builds on GitHub pages with GitHub Actions
Blogging
18 Dec 2020 🎄 Twelve Days of SMT 🎄 - Day 9: Cast
Kafka Connect
17 Dec 2020 🎄 Twelve Days of SMT 🎄 - Day 8: TimestampConverter
Kafka Connect
16 Dec 2020 🎄 Twelve Days of SMT 🎄 - Day 7: TimestampRouter
Kafka Connect
15 Dec 2020 🎄 Twelve Days of SMT 🎄 - Day 6: InsertField II
Kafka Connect
14 Dec 2020 🎄 Twelve Days of SMT 🎄 - Day 5: MaskField
Kafka Connect
11 Dec 2020 🎄 Twelve Days of SMT 🎄 - Day 4: RegExRouter
Kafka Connect