Apache Storm On Azure
Written by Kay Ewbank   
Thursday, 26 February 2015

Apache Storm,  a distributed real-time analytics system for Hadoop that can be used for processing large volumes of rapidly changing data, has been released on Microsoft Azure HDInsight.

stormonhdi

 

General availability of Storm comes as part of the latest update to HDInsight, alongside the news that HDInsight is now available on Linux.

The release has been described by Oliver Chiu on the Azure blog as being due to:

‘a natural decision to give customers the choice of running their big data Hadoop workloads on both Windows and Linux’,

presumably partially driven by the fact that 20 percent of Azure Virtual Machines run on Linux.

Apache Storm was made available in preview last October as clusters on HDInsight, and Microsoft is now announcing the general availability of Storm as a deployment option with the aim of making Hadoop easier to use. The release also includes support for Hadoop 2.6, new Virtual Machine sizes, cluster scaling, and built-in integration to Azure DocumentDB.

 

In this Channel 9 video in the Data Exposed series Asad Khan gives the background to the Azure Storm service and its latest features:

 

The most interesting aspect for developers is the fact that Storm is now available for both .NET and Java, and integration with Visual Studio allows you to work in VS on Storm apps.

 

stormvsint

 

This includes the ability to use Storm spouts and bolts written in other languages. Details of how to do this are included in and article Develop C# topologies for Apache Storm on HDInsight using Visual Studio that is part of the Microsoft Azure documentation. 

Microsoft is making use of the Hortonworks availability of HDP 2.2 to release the next version of HDInsight built on Hadoop 2.6, Hive and Pig. This version of HDInsight includes work done on Stinger.next to speed up Hadoop queries. The new version also includes cluster scaling in Azure HDInsight, so you can change the number of nodes of a running HDInsight cluster without having to delete and recreate a new cluster.  

stormsq

More Information

HDInsight

Related Articles

Apache Storm Added To Hadoop On Azure 

New Azure Services Announced 

Machine Learning Goes Azure - Azure ML Announced 

HDInsight - Brings Apache Hadoop to Windows 

 

To be informed about new articles on I Programmer, install the I Programmer Toolbar, subscribe to the RSS feed, follow us on, Twitter, FacebookGoogle+ or Linkedin,  or sign up for our weekly newsletter.

 

Banner


AWS Introduces A New JavaScript Runtime For Lambda
19/03/2024

Amazon has announced the availability, albeit for experimental purposes, of a new JavaScript based runtime called Low Latency Runtime or LLRT for short, to bring JavaScript up to the performance throu [ ... ]



Five Tips for Managing Hybrid Development Teams
08/03/2024

Managing hybrid development teams can be challenging, but  can also be a rewarding endeavor. Here are some tips to follow to ensure success. 


More News

 

raspberry pi books

 

Comments




or email your comment to: comments@i-programmer.info

Last Updated ( Thursday, 26 February 2015 )