Apache Bigtop has been updated with a new version of its integration test Framework, and a newly developed Smoke Test CI Matrix to guard the quality of releases. 

Bigtop is an Apache Foundation project that you can use for packaging, testing, and configuration of the big name open source big data components that make up the Hadoop infrastructure. Bigtop works with a wide range of components and projects, including Hadoop, HBase and Spark. Apache's aim for Bigtop is to build a community around the packaging, deployment and interoperability testing of Hadoop-related projects. Bigtop supports the wider selection that makes up the Hadoop-related projects, including Hbase, Pig, Hive MapReduce, Zookeeper and Avro. For virtualization, Bigtop provides vagrant recipes, raw images, and (work-in-progress) docker recipes for deploying Hadoop from zero.

The integration test framework aims to provide a one stop integrated Hadoop ecosystem build and test solutions inside Docker. You can control it using a single Gradle command.

The newly developed Smoke Test CI Matrix is gradle based, and aims to make it simple to customize and test Apache BigTop's Hadoop distribution. Using it, you can easily add new tests to Bigtop without adding new directories or xml files. The developers say it debugs tests easily makes logging transparent, and can generate easy to read test reports. You can use it to run Bigtop tests without needing a jar file, and ideally without needing gradle or maven. Is what is probably an overstatement, the developers say the framework makes testing with Apache Bigtop easy as well as fun!

The new release also updates support for Hadoop 2.8.5, Kafka 1.1.1, Spark 2.4.0, and Alluxio 1.8.1 It also includes new smoke tests for Flink and Giraph (Crunch).

The latest version is available on the Apache Bigtop website.

More Information

Apache Bigtop Site 

Related Articles

Apache Bigtop Adds OpenJDK 8 Support

Hadoop Adds Resource Estimator 

Hadoop Adds In-Memory Caching

Hadoop SQL Query Engine Launched

Hadoop 2 Introduces YARN

Spark Gets NLP Library 

To be informed about new articles on I Programmer, sign up for our weekly newsletter, subscribe to the RSS feed and follow us on Twitter, Facebook or Linkedin.

Comments

Make a Comment or View Existing Comments Using Disqus

or email your comment to: comments@i-programmer.info