Aggregate and Index Data into Elasticsearch Using Logstash and JDBC

DZone Database Zone

Aggregate and Index Data into Elasticsearch Using Logstash and JDBC

In my previous posts (here and here), I showed you how to index data into Elasticsearch from a SQL DB using JDBC and Elasticsearch JDBC importer library. In the first article, I mentioned some of the shortcomings of using the importer library, which I have copied here:

No support for ES version 5 and above. There is a possibility of duplicate objects in the array of nested objects, but de-duplication can be handled at the application layer. There can be a possibility of delay in support for latest ES versions.

All the above shortcomings can be overcome by using Logstash and its following plugins:

more info...