Craigslist - SQL or NoSQL?
Written by Kay Ewbank   
Friday, 21 September 2012

Craigslist’s Jeremy Zawodny’s presentation on data storage technologies at Craigslist is available as a video, and gives some fascinating insights into why Craigslist has made various choices of technology.

perconalivelogo

 

Zawodny’s presentation was originally given at the 2012 Percona Live MySQL Conference in Santa Clara. The listings website uses both SQL (MySQL) and NoSQL (Redis, MongoDB and memcached), and Zawodny discusses what’s in use, where, why, and why not.

You can view the video below:

 

Zawodny says MySQL is used for a variety of reasons - it’s the devil they know, very reliable and they have a lot of admin and developer skills in using it.Other reasons for choosing MySQL are durability, replication, and the support.

Memcached makes the grade because, says Zadowny, it’s wickedly fast, stable, virtually zero admin, and easily exists with CPU-intensive services. In answer to the multi-core issue, he says run more instances!

Redis was chosen because of the performance, flexible persistence, and an excellent but simple API. The same solution is put forward for the multi- core question.

The reasons for choosing MongoDB start with the fact it’s schema free. Other reasons include the active community alongside the commercial support. The Perl client is a plus point, but Zawodny reserves his most enthusiastic praise for the ease of scaling (Yay! for built-in sharding support) and fewer single points of failure due to the ‘awesome’ replica sets.

Zadowny also goes through the reasons for choosing Sphinx and Filesystem, and concludes that in answer to the question of relational v non-relational, in practice Craigslist often just doesn’t care, adding that NoSQL is a stupid label.

More Information

Percona Live MySQL

Related Articles


blog comments powered by Disqus

 

To be informed about new articles on I Programmer, install the I Programmer Toolbar, subscribe to the RSS feed, follow us on, Twitter, Facebook, Google+ or Linkedin,  or sign up for our weekly newsletter.

 

Banner


Google's Deep Learning AI Knows Where You Live And Can Crack CAPTCHA
21/04/2014

A while back we reported on Google's attempts at creating machine vision that was good enough to read house numbers photographed in Street View. Performance has now got a whole lot better since the te [ ... ]



Microsoft Rolls Out New App Pricing
14/04/2014

Without prior notice to developers who have apps on sale there, Microsoft has introduced a new pricing structure for the Windows Store noting that this "may impact" your app pricing.


More News

Last Updated ( Friday, 21 September 2012 )
 
 

   
RSS feed of news items only
I Programmer News
Copyright © 2014 i-programmer.info. All Rights Reserved.
Joomla! is Free Software released under the GNU/GPL License.