Running as root on Docker images that don’t use root
tl;dr: specify the --user root argument:
docker exec --interactive \
--tty \
--user root \
--workdir / \
container-name bashKafka Connect and Oracle data types
The Kafka Connect JDBC Connector by default does not cope so well with:
NUMBER columns with no defined precision/scale. You may end up with apparent junk (bytes) in the output, or just errors. TIMESTAMP WITH LOCAL TIME ZONE. Throws JDBC type -102 not currently supported warning in the log. Read more about NUMBER data type in the Oracle docs.
tl;dr : How do I make it work? There are several options:
HOWTO: Oracle GoldenGate + Apache Kafka + Schema Registry + Swingbench
This is the detailed step-by-step if you want to recreate the process I describe in the Confluent blog here
I used Oracle’s Oracle Developer Days VM, which comes preinstalled with Oracle 12cR2. You can see the notes on how to do this here. These notes take you through installing and configuring:
Swingbench, to create a sample “Order Entry” schema and simulate events on the Oracle database Oracle GoldenGate (OGG, forthwith) and Oracle GoldenGate for Big Data (OGG-BD, forthwith) I’m using Oracle GoldenGate 12.
Where will I be at OpenWorld / Oak Table World?
Here’s where I’ll be!
If you use Google Calendar you can click on individual entries above and select copy to my calendar - which of course you’ll want to do for all the ones I’ve marked as [SPEAKING] :-)
Here’s a list of all the Apache Kafka talks at OpenWorld and JavaOne, most of which I’ll be trying to get to.
Oracle GoldenGate / Kafka Connect Handler troubleshooting
The Replicat was kapput:
GGSCI (localhost.localdomain) 3> info rkconnoe REPLICAT RKCONNOE Last Started 2017-09-12 17:06 Status ABENDED Checkpoint Lag 00:00:00 (updated 00:46:34 ago) Log Read Checkpoint File /u01/app/ogg/dirdat/oe000000 First Record RBA 0 So checking the OGG error log ggserr.log showed
2017-09-12T17:06:17.572-0400 ERROR OGG-15051 Oracle GoldenGate Delivery, rkconnoe.prm: Java or JNI exception: oracle.goldengate.util.GGException: Error detected handling operation added event. 2017-09-12T17:06:17.572-0400 ERROR OGG-01668 Oracle GoldenGate Delivery, rkconnoe.prm: PROCESS ABENDING. So checking the replicat log dirrpt/RKCONNOE_info_log4j.
New version of BigDataLite VM from Oracle
Oracle’s excellent Big Data Lite VM has been updated, to version 4.5.
Download it here
Changes:
CDH 5.5 -> 5.7 Big Data Spatial and Graph 1.1 -> 1.2 Big Data Discovery 1.1 -> 1.2 Oracle Big Data Connectors 4.4 -> 4.5 Oracle NoSQL 3.5 -> 4.0 GoldenGate 12.2.0.1 -> 12.2.0.1.1