Friday, September 08, 2017

AWS Summit Series 2017 – New York: Amazon EFS Introduces Support for Encryption of Data at Rest

Data Videos
#Data -AWS Summit Series 2017 – New York: Amazon EFS Introduces Support for Encryption of Data at Rest

Apache Parquet vs. CSV Files

DZone Database Zone
Apache Parquet vs. CSV Files
Apache Parquet vs. CSV Files

You have surely read about Google Cloud (i.e. BigQuery, Dataproc), Amazon Redshift Spectrum, and Amazon Athena. Now, you are looking to take advantage of one or two. However, before you jump into the deep end, you will want to familiarize yourself with the opportunities of leveraging Apache Parquet instead of regular text, CSV, or TSV files. If you are not thinking about how to optimize for these new query service models, you are throwing money out the window.

What Is Apache Parquet?

Apache Parquet is a columnar storage format with the following characteristics:

Real Time Meets Race Time: Toyota Racing in the Cloud

Data Videos
#Data -Real Time Meets Race Time: Toyota Racing in the Cloud

NoSQL Best Practices for PostgreSQL [Q+A]

DZone Database Zone
NoSQL Best Practices for PostgreSQL [Q+A]
NoSQL Best Practices for PostgreSQL [Q+A]

Welcome to another post in our series of interview blogs for the upcoming Percona Live Europe 2017 in Dublin. This series highlights a number of talks that will be at the conference and gives a short preview of what attendees can expect to learn from the presenter.

This blog post is with Dmitry Dolgov, a software engineer at Zalando SE. His talk is titled NoSQL Best Practices for PostgreSQL. One of PostgreSQL's most attractive features is the Jsonb data type. It allows efficient work with semi-structured data without sacrificing strong consistency and the ability to use all the power of proven relational technology. In our conversation, we discussed how to use this NoSQL feature in PostgreSQL:

Why You Should Always Verify Examples When Comparing Database Products

DZone Database Zone
Why You Should Always Verify Examples When Comparing Database Products
Why You Should Always Verify Examples When Comparing Database Products

In this blog post, I'll look at a comparison of PostgreSQL and MySQL.

I came across a post from Hans-Juergen Schoenig, a Postgres consultant at Cybertec. In it, he dismissed MySQL and showed Postgres as better. While his post ignores most of the reasons why MySQL is better, I will focus on where his post is less than accurate. Testing for MySQL was done with Percona Server 5.7 defaults.

JOIN Elimination: An Essential Optimizer Feature for Advanced SQL Usage

DZone Database Zone
JOIN Elimination: An Essential Optimizer Feature for Advanced SQL Usage
JOIN Elimination: An Essential Optimizer Feature for Advanced SQL Usage

The SQL language has one great advantage over procedural, object-oriented, and "ordinary" functional programming languages. The fact that it is truly declarative (i.e. a 4GL/fourth-generation programming language) means that a sophisticated optimizer can easily transform one SQL expression into another equivalent SQL expression, which might be faster to execute.

How does this work?

What an In-Memory Database Is and How It Persists Data Efficiently

DZone Database Zone
What an In-Memory Database Is and How It Persists Data Efficiently
What an In-Memory Database Is and How It Persists Data Efficiently

You've probably heard about in-memory databases. If not, you can check out a quick overview of what they are here!

Long story short, an in-memory database is a database that keeps the whole dataset in RAM. What does that mean? It means that each time you query a database or update data in a database, you only access the main memory. There's no disk involved in these operations — and this is good because the main memory is way faster than any disk. A good example of such a database is Memcached.

Thursday, September 07, 2017

AWS Maker Studio | Enabling Robots to Hear, See & Talk

Data Videos
#Data -AWS Maker Studio | Enabling Robots to Hear, See & Talk

Opportunities in the Internet of Things (IoT)

Data Videos
#Data -Opportunities in the Internet of Things (IoT)

Database Fundamentals #9: Schemas as Containers

DZone Database Zone
Database Fundamentals #9: Schemas as Containers
Database Fundamentals #9: Schemas as Containers

Schemas are a very useful tool for managing the objects in your database. From security to process to placement, schemas provide you with another tool to control how your database behaves.

Schemas

The tables created so far in this blog series have all been attached to a schema: dbo. Depending on how you log into the server and the security settings for your user, this is usually the default schema. A schema is simply a container in which you place objects. Once placed there, a schema is a method for managing the objects it contains. Schemas give you a simple way to control placement of the objects on filegroups. Schemas are a very easy way to manage security. The use of schemas becomes extremely important as your database becomes more and more complex. Any database you create following this blog series will be fairly simple in order to focus on concepts related to the fundamentals scope of the series. For this blog, I won't spend lots of time dealing with complex business models. However, because you will have to deal with complex business models, it's best to have an understanding of the tools you have to help deal with them.

Power BI APIs, Custom Data Connectors and Timelines

Data Videos
#Data -Power BI APIs, Custom Data Connectors and Timelines

Apache Parquet vs. CSV Files

DZone Database Zone
Apache Parquet vs. CSV Files
Apache Parquet vs. CSV Files

You have surely read about Google Cloud (i.e. BigQuery, Dataproc), Amazon Redshift Spectrum, and Amazon Athena. Now, you are looking to take advantage of one or two. However, before you jump into the deep end, you will want to familiarize yourself with the opportunities of leveraging Apache Parquet instead of regular text, CSV, or TSV files. If you are not thinking about how to optimize for these new query service models, you are throwing money out the window.

What Is Apache Parquet?

Apache Parquet is a columnar storage format with the following characteristics:

3 Predictions for the Future of Data Storage

DZone Database Zone
3 Predictions for the Future of Data Storage
3 Predictions for the Future of Data Storage

An often-cited statistic is that 90 percent of world’s data was created in the past two years. With such exponential data growth, managing storage demands has become more challenging than ever — and many companies are turning to the cloud, where data can be safely stored and managed at massive scale.

Going forward, enterprises can expect to see new strategies and tactics for storing data that deliver faster access, greater protection, and significantly improved collaboration.

Introduction to GraphQL: A Query Language for APIs

DZone Database Zone
Introduction to GraphQL: A Query Language for APIs
Introduction to GraphQL: A Query Language for APIs

GraphQL is an API standard that provides a more efficient, powerful, and flexible alternative to REST. It was created by Facebook in 2012, was open-sourced in 2015, and is now maintained by a large community of companies and individuals from all over the world. GraphQL is a specification, meaning it's just a set of rules defined in a document.

GraphQL is a query language designed to build client applications by providing an intuitive and flexible syntax and system for describing their data requirements and interactions. It's been in production use in Facebook's native apps for several years.

Wednesday, September 06, 2017

Fun With SQL: Functions in Postgres

DZone Database Zone Fun With SQL: Functions in Postgres In our previous  Fun with SQL  post on the  Citus Data  blog, we covered w...