Apache Storm 2.6 Adds Docker Image |
Written by Kay Ewbank | |||
Thursday, 08 February 2024 | |||
Apache Storm 2.6 has been released. The updated version adds an official Docker image of Storm alongside other enhancements. Apache Storm is a distributed real-time analytics system for Hadoop that can be used for processing large volumes of rapidly changing data. It can be used for realtime analytics, online machine learning, continuous computation, distributed RPC, and ETL. One advantage of Storm is its speed - a benchmark clocked it at over a million tuples processed per second per node. Updates to the current version start with the inclusion of an official Storm image for Docker. This has been a requested feature for some time, and the team has been keen to add it since version 1 of Storm was released. Storm has also changed to use GitHub Actions rather than Travis CI. Travis CI is a hosted continuous integration service used to build and test software projects, and it used to be an Apache Software Foundation project. However, Apache as whole is moving away from Travis CI, and the Storm team has followed suit. This release has also added a RoundRobin Scheduler Strategy with node limits designed to distribute components evenly across nodes. The default behavior is to spread the load across all nodes, but developers can limit this by specifying the maximum number of nodes to use. Reporting and monitoring has been improved with the ability to customize Storm's configuration for the metric reporting interval, and the option to add dimensions for Storm metrics. Support has also been added to enable the adding of metrics reporters to all topologies. Elsewhere, the Hadoop version used has been upgraded to Hadoop 3, and the dependent frameworks for Hive and HBase have also been updated. The Thrift code within Storm has also been regenerated to use the current Thrift version used in Storm. The Apache Thrift software framework is designed for scalable cross-language services development. It combines a software stack with a code generation engine to build services that work between languages. The new release of Storm is available on the Storm project website. More InformationRelated ArticlesApache Storm Added To Hadoop On Azure To be informed about new articles on I Programmer, sign up for our weekly newsletter, subscribe to the RSS feed and follow us on Twitter, Facebook or Linkedin.
Comments
or email your comment to: comments@i-programmer.info |