AWS Improvements For Developers
Written by Kay Ewbank   
Tuesday, 06 December 2016

Amazon has announced improvements for developers at its recent Re:Invent conference. These fall into a number of areas, and here we look at those concerned with database.

The improvements for working with databases on Amazon start with a way of writing serverless SQL queries against data stored in Amazon S3 object storage. To use it you point Athena at some data stored in Amazon Simple Storage Service (S3), identify your fields, run your queries, and get the results - in seconds according to the developers. You pay only for the queries that you run. Behind the scenes, Athena parallelizes your query, and spreads it out across hundreds or thousands of cores.

athena splash

Athena is based on the  open source Presto distributed SQL engine and can query data in formats including JSON, CSV, log files, text with custom delimiters, Apache Parquet, and Apache ORC.

athena elb select 2

 

A second announcement at Re:Invent was a new version of Amazon Aurora, Amazon's high performance MySQL-compatible database. The developers at Amazon have now announced Amazon Aurora PostgreSQL-Compatible Edition. This is in preview, and will provide high durability, high availability, and the ability to quickly create and deploy read replicas while being PostgreSQL compatible. PostgreSQL has achieved great popularity over its long lifetime, and the Aurora edition will include support for PostgreSQL's geospatial objects.

aurora pick pg 2

 

Other database services previewed at the conference include an ETL (Extract, Transform and Load) service called AWS Glue that will be available for connecting to Amazon data stores and JDBC-compliant databases; and AWS Snowmobile, an exabyte-scale data transfer service used to move extremely large amounts of data.

Snowmobile is a development of Snowball. This was announced last year as a petabyte-scale data transport solution that uses secure appliances to transfer large amounts of data into and out of the AWS cloud. Snowmobile is a secure data truck that stores up to 100 PB of data and can help you to move exabytes to AWS, though the process takes weeks. Snowmobile attaches to your network and appears as a local, NFS-mounted volume..

 athena

 

Other news from re:Invent relates to serverless computing and build services, see New Amazon Build Services, and the new Amazon AI Services that we reported on last week.

 

 

More Information

Amazon Athena

Aurora Preview (USA Only)

Snowmobile

AWS Glue

Presto

Related Articles

Amazon Strengthens Data Offerings

Amazon Aurora Made Available

New Amazon Elasticsearch Service

Amazon Introduces Quicksight - Cloud BI

Amazon Launches Supercharged MySQL Alternative

New Amazon Build Services

New AWS Managed Services

 

To be informed about new articles on I Programmer, sign up for our weekly newsletter, subscribe to the RSS feed and follow us on Twitter, Facebook or Linkedin.

 

Banner


Sequin - Open Source Message Stream Built On Postgres
31/10/2024

Sequin is a tool for capturing changes and streaming data out of your Postgres database, guaranteeing exactly once processing. What does that mean?



.NET 9 Released
18/11/2024

.NET 9 has been released with a number of performance improvements and new features designed to help developers use AI.


More News

 

espbook

 

Comments




or email your comment to: comments@i-programmer.info

Last Updated ( Wednesday, 07 December 2016 )