Apache Bigtop 3 Improves CI Support
Written by Kay Ewbank   
Tuesday, 09 November 2021

Apache Bigtop,used for packaging, testing, and configuration of the open source components that make up the Hadoop infrastructure, has been updated with a major new version. Bigtop 3 now has support for continuous integration testing based on Jenkins. 

Bigtop works with a wide range of components and projects, including Hadoop, HBase and Spark. Apache's aim for Bigtop is to build a community around the packaging, deployment and interoperability testing of Hadoop-related projects. Bigtop supports the wider selection that makes up the Hadoop-related projects, including Hbase, Pig, Hive MapReduce, Zookeeper and Avro. For virtualization, Bigtop provides vagrant recipes, raw images, and (work-in-progress) docker recipes for deploying Hadoop from zero.


Version 3 has been updated to support up-to-date versions of major components such as Hadoop, Hive and Spark, with other components also upgraded so that they are compatible with the major ones.

Fedora 33 and Ubuntu 20.04 have been added as the supported distros. There's also new support for ppc64le, which has been added in addition to x86_64 and aarch64.

Another improvement to version 3.0 is for continuous integration (CI) testing. Apache Bigtop uses Jenkins for continuous integration testing, and there is a Jenkins server currently running for the project. Jenkins is a leading open source automation server that provides hundreds of plugins to support building, deploying and automating any project. As an extensible automation server, Jenkins can be used as a simple CI server.

Other recent improvements to Bigtop include the addition of Bigtop Mpack, meaning that users can deploy Bigtop components via Apache Ambari. The Livy and ELK stack (Elasticsearch, Logstash, Kibana) were also added as components.

The latest version is available on the Apache Bigtop website.


More Information

Apache Bigtop Site 

Bigtop Jenkins Server For CI Testing

Related Articles

Apache Bigtop 1.4 Adds Smoke Test

Apache Bigtop Adds OpenJDK 8 Support 


To be informed about new articles on I Programmer, sign up for our weekly newsletter, subscribe to the RSS feed and follow us on Twitter, Facebook or Linkedin.


Google Summer Of Code Opens Up To Non-Students

Google has decided to broaden the scope of the Google Summer of Code Program beginning in 2022. The change means that anyone aged 18 years and over who is a newcomer to open source can apply. Two othe [ ... ]

PHP 8.1 Released With Enums, Read-Only Properties and Fibers

PHP,  the server-side web language used for eight out of ten websites using server-side code, has an annual release cycle and the latest update to this venerable workhorse of the web has jus [ ... ]

More News





or email your comment to: comments@i-programmer.info

Last Updated ( Tuesday, 09 November 2021 )