tl;dr: specify the --user root argument:

docker exec --interactive \
            --tty \
            --user root \
            --workdir / \
            container-name bash

The Kafka Connect JDBC Connector by default does not cope so well with:

• NUMBER columns with no defined precision/scale. You may end up with apparent junk (bytes) in the output, or just errors.
• TIMESTAMP WITH LOCAL TIME ZONE. Throws JDBC type -102 not currently supported warning in the log.

Read more about NUMBER data type in the Oracle docs.

tl;dr : How do I make it work?

There are several options:

New in Confluent Platform 4.1.1 : numeric.mapping

• In the connector configuration, set "numeric.mapping":"best_fit"
• New in Confluent Platform 4.1.1 (Doc)

Avoid the problem in the first place

• Change the DDL of the source object. For example:
  • refine the NUMBER ’s precision and scale
  • Use a TIMESTAMP type that is supported

CAST the datatypes in the query

• Pull from the object directly, and use query in the JDBC connector (instead of table.whitelist)—and cast the columns appropriately:

This is the detailed step-by-step if you want to recreate the process I describe in the Confluent blog here

I used Oracle’s Oracle Developer Days VM, which comes preinstalled with Oracle 12cR2. You can see the notes on how to do this here. These notes take you through installing and configuring:

• Swingbench, to create a sample “Order Entry” schema and simulate events on the Oracle database
• Oracle GoldenGate (OGG, forthwith) and Oracle GoldenGate for Big Data (OGG-BD, forthwith)
  • I’m using Oracle GoldenGate 12.3.1 which includes the Kafka Connect handler as part of its distribution. A connector for earlier versions can be found here. Some of the syntax may differ in the configuration below - if you hit problems then check out an article that I wrote with an earlier version of the tool.
• OGG extract from the Order Entry schema
• Confluent Platform
• KSQL
• Elasticsearch

From this point, I’ll now walk through configuring OGG-BD with the Kafka Connect handler

Here’s where I’ll be!

If you use Google Calendar you can click on individual entries above and select copy to my calendar - which of course you’ll want to do for all the ones I’ve marked as [SPEAKING] :-)

Here’s a list of all the Apache Kafka talks at OpenWorld and JavaOne, most of which I’ll be trying to get to.

The Replicat was kapput:

GGSCI (localhost.localdomain) 3> info rkconnoe

REPLICAT   RKCONNOE  Last Started 2017-09-12 17:06   Status ABENDED
Checkpoint Lag       00:00:00 (updated 00:46:34 ago)
Log Read Checkpoint  File /u01/app/ogg/dirdat/oe000000
                     First Record  RBA 0

So checking the OGG error log ggserr.log showed

2017-09-12T17:06:17.572-0400  ERROR   OGG-15051  Oracle GoldenGate Delivery, rkconnoe.prm:  Java or JNI exception:
                              oracle.goldengate.util.GGException: Error detected handling operation added event.
2017-09-12T17:06:17.572-0400  ERROR   OGG-01668  Oracle GoldenGate Delivery, rkconnoe.prm:  PROCESS ABENDING.

So checking the replicat log dirrpt/RKCONNOE_info_log4j.log showed:

Oracle’s excellent Big Data Lite VM has been updated, to version 4.5.

Download it here

Changes:

• CDH 5.5 -> 5.7
• Big Data Spatial and Graph 1.1 -> 1.2
• Big Data Discovery 1.1 -> 1.2
• Oracle Big Data Connectors 4.4 -> 4.5
• Oracle NoSQL 3.5 -> 4.0
• GoldenGate 12.2.0.1 -> 12.2.0.1.1