Thursday, November 30, 2017

Ingesting RDBMS Data as New Tables Arrive in Hive

DZone Database Zone
Ingesting RDBMS Data as New Tables Arrive in Hive
Ingesting RDBMS Data as New Tables Arrive in Hive

Let's say that a company wants to know when new tables are added to a JDBC source (say, an RDBMS). Using the ListDatabaseTables processor, we can get a list of TABLE s, and also views, system tables, and other database objects, but for our purposes, we want tables with data. I have used the ngdbc.jar from SAP HANA to connect and query tables with ease.

For today's example, I am connecting to MySQL, as I have a MySQL database available for use and modification.

No comments:

Fun With SQL: Functions in Postgres

DZone Database Zone Fun With SQL: Functions in Postgres In our previous  Fun with SQL  post on the  Citus Data  blog, we covered w...