Friday, September 08, 2017
AWS Summit Series 2017 – New York: Amazon EFS Introduces Support for Encryption of Data at Rest
Apache Parquet vs. CSV Files
You have surely read about Google Cloud (i.e. BigQuery, Dataproc), Amazon Redshift Spectrum, and Amazon Athena. Now, you are looking to take advantage of one or two. However, before you jump into the deep end, you will want to familiarize yourself with the opportunities of leveraging Apache Parquet instead of regular text, CSV, or TSV files. If you are not thinking about how to optimize for these new query service models, you are throwing money out the window.
What Is Apache Parquet?Apache Parquet is a columnar storage format with the following characteristics:
NoSQL Best Practices for PostgreSQL [Q+A]
Welcome to another post in our series of interview blogs for the upcoming Percona Live Europe 2017 in Dublin. This series highlights a number of talks that will be at the conference and gives a short preview of what attendees can expect to learn from the presenter.
This blog post is with Dmitry Dolgov, a software engineer at Zalando SE. His talk is titled NoSQL Best Practices for PostgreSQL. One of PostgreSQL's most attractive features is the Jsonb data type. It allows efficient work with semi-structured data without sacrificing strong consistency and the ability to use all the power of proven relational technology. In our conversation, we discussed how to use this NoSQL feature in PostgreSQL:
Why You Should Always Verify Examples When Comparing Database Products
In this blog post, I'll look at a comparison of PostgreSQL and MySQL.
I came across a post from Hans-Juergen Schoenig, a Postgres consultant at Cybertec. In it, he dismissed MySQL and showed Postgres as better. While his post ignores most of the reasons why MySQL is better, I will focus on where his post is less than accurate. Testing for MySQL was done with Percona Server 5.7 defaults.
JOIN Elimination: An Essential Optimizer Feature for Advanced SQL Usage
The SQL language has one great advantage over procedural, object-oriented, and "ordinary" functional programming languages. The fact that it is truly declarative (i.e. a 4GL/fourth-generation programming language) means that a sophisticated optimizer can easily transform one SQL expression into another equivalent SQL expression, which might be faster to execute.
How does this work?
What an In-Memory Database Is and How It Persists Data Efficiently
You've probably heard about in-memory databases. If not, you can check out a quick overview of what they are here!
Long story short, an in-memory database is a database that keeps the whole dataset in RAM. What does that mean? It means that each time you query a database or update data in a database, you only access the main memory. There's no disk involved in these operations — and this is good because the main memory is way faster than any disk. A good example of such a database is Memcached.
Thursday, September 07, 2017
Database Fundamentals #9: Schemas as Containers
Schemas are a very useful tool for managing the objects in your database. From security to process to placement, schemas provide you with another tool to control how your database behaves.
SchemasThe tables created so far in this blog series have all been attached to a schema: dbo. Depending on how you log into the server and the security settings for your user, this is usually the default schema. A schema is simply a container in which you place objects. Once placed there, a schema is a method for managing the objects it contains. Schemas give you a simple way to control placement of the objects on filegroups. Schemas are a very easy way to manage security. The use of schemas becomes extremely important as your database becomes more and more complex. Any database you create following this blog series will be fairly simple in order to focus on concepts related to the fundamentals scope of the series. For this blog, I won't spend lots of time dealing with complex business models. However, because you will have to deal with complex business models, it's best to have an understanding of the tools you have to help deal with them.
Apache Parquet vs. CSV Files
You have surely read about Google Cloud (i.e. BigQuery, Dataproc), Amazon Redshift Spectrum, and Amazon Athena. Now, you are looking to take advantage of one or two. However, before you jump into the deep end, you will want to familiarize yourself with the opportunities of leveraging Apache Parquet instead of regular text, CSV, or TSV files. If you are not thinking about how to optimize for these new query service models, you are throwing money out the window.
What Is Apache Parquet?Apache Parquet is a columnar storage format with the following characteristics:
3 Predictions for the Future of Data Storage
An often-cited statistic is that 90 percent of world’s data was created in the past two years. With such exponential data growth, managing storage demands has become more challenging than ever — and many companies are turning to the cloud, where data can be safely stored and managed at massive scale.
Going forward, enterprises can expect to see new strategies and tactics for storing data that deliver faster access, greater protection, and significantly improved collaboration.
Introduction to GraphQL: A Query Language for APIs
GraphQL is an API standard that provides a more efficient, powerful, and flexible alternative to REST. It was created by Facebook in 2012, was open-sourced in 2015, and is now maintained by a large community of companies and individuals from all over the world. GraphQL is a specification, meaning it's just a set of rules defined in a document.
GraphQL is a query language designed to build client applications by providing an intuitive and flexible syntax and system for describing their data requirements and interactions. It's been in production use in Facebook's native apps for several years.
Wednesday, September 06, 2017
Amazon AppStream 2.0 Graphics Design, a New, Lower Cost Instance Type for Streaming Graphics Apps
Fun With SQL: Functions in Postgres
DZone Database Zone Fun With SQL: Functions in Postgres In our previous Fun with SQL post on the Citus Data blog, we covered w...
-
DZone Database Zone Fun With SQL: Functions in Postgres In our previous Fun with SQL post on the Citus Data blog, we covered w...
-
DZone Database Zone Building a Boolean Logic Rules Engine in Neo4j A boolean logic rules engine was the first project I did for N...
-
DZone Database Zone MongoDB Indexes With Spring Data When working with large amounts of data, the use of indexes will greatly impro...