Saturday, September 30, 2017

Reading Nested Parquet File in Scala and Exporting to CSV

DZone Database Zone
Reading Nested Parquet File in Scala and Exporting to CSV
Reading Nested Parquet File in Scala and Exporting to CSV

Recently, we were working on a problem where a Parquet compressed file had lots of nested tables. Some of the tables had columns with an Array type. Our objective was to read the file and save it to CSV.

We wrote a script in Scala that does the following:

No comments:

Fun With SQL: Functions in Postgres

DZone Database Zone Fun With SQL: Functions in Postgres In our previous  Fun with SQL  post on the  Citus Data  blog, we covered w...