MemSQL - 80,000 queries per second
Written by Kay Ewbank   
Friday, 22 June 2012

Two former Facebook developers have created a new database that they say is the world’s fastest and a video to demonstrate its superiority compared to MySQL.

According to former Facebook developers Eric Frenkiel and Nikita Shamgunov, MemSQL, the database they have developed over the past year, is thirty times faster than conventional disk-based databases.

The team employed techniques they had used at Facebook to create a database that would be very fast. The key ideas are that SQL code is translated into C++, so avoiding the need to use a slow SQL interpreter, and that the data is kept in memory, with disk read/writes taking place in the background.

Shamgunov has excellent credentials in the database world, having worked at Microsoft on SQL Server for six years. He also has several patents to his name, and is a world medalist in ACM programming contests.

MemSQL has put together a video showing MySQL versus MemSQL carrying out a sequence of queries, in which MySQL performs at around 3,500 queries per second, while MemSQL achieves around 80,000 queries per second.

 

 

This is, of course, impressive, but the question remains of how much of this was achieved by clever picking of the queries. What would be interesting would be to see MemSQL running some of the Transaction Processing Performance Council (TPC) tests to see how it performs against known benchmarks.

The main reason that MemSQL achieves the speed it does is because of being memory based, with all the benefits and drawbacks in terms of size limits and potential data loss that carries.

The documentation says that MemSQL writes back to disk/SSD as soon as the transaction is acknowledged in memory, and that using a combination of write-ahead logging and snapshotting ensures your data is secure.

MemSQL is fully compatible with MySQL, giving a clue as to the target audience, and the website describing the product suggests that:

“MemSQL handles terabyte-scale workloads by connecting MemSQL and MySQL nodes together, conferring real-time access for your most valuable data as well as long-term historical lookback”. 

MemSQL runs on 64-bit Linux, and is described as ideally suited for machines with multi-core processors and at least 8 GB of RAM. There’s a free developer edition that’s limited to 10 GB in capacity, and a trial edition that supports unlimited storage but is time limited to 30 days.

So far, no details of the license fee for commercial use seem to be available.

memsql

More Information

MemSQL

Related Articles

Google's F1 - Scalable Alternative to MySQL

Performance enhancements in PostgreSQL 9.2

Faster Apache CouchDB

Preview of MySQL 5.6.5

Improve SQL Performance – Know Your Statistics

 

To be informed about new articles on I Programmer, install the I Programmer Toolbar, subscribe to the RSS feed, follow us on, Twitter, Facebook, Google+ or Linkedin,  or sign up for our weekly newsletter.

Banner


IBM Updates Granite Models
28/10/2024

IBM has released new Granite models that it says provide state-of-the-art performance relative to model size. The Granite 3.0 collection includes a new, instruction-tuned, dense decoder-only LLM.



The Feds Want Us To Move On From C/C++
13/11/2024

The clamour for safe programming languages seems to be growing and becoming official. We have known for a while that C and C++ are dangerous languages so why has it become such an issue now and is it  [ ... ]


More News

 

espbook

 

Comments




or email your comment to: comments@i-programmer.info

Last Updated ( Sunday, 26 January 2014 )