Visual Spark Studio IDE For Spark Apps
Written by Kay Ewbank   
Thursday, 01 March 2018

A new free IDE has been released that lets you build, test and run Apache Spark apps on your desktop. Visual Spark Studio is a free cut-down version of the Impetus StreamAnalytix platform. It provides a lightweight development tool for data processing and analytics on Spark data.

Apache Spark is a general-purpose cluster computing framework, with native support for distributed SQL, streaming, graph processing, and machine learning.

sparkstudio

The new IDE can be used to build Spark apps for for both batch and streaming mode. It is a free, quick-start lightweight product that is a A Spark-only version of StreamAnalytix (an open-source enabled, enterprise-grade, stream processing and machine learning platform). Visual Spark Studio keeps the StreamAnalytix interface and has ready-to-use operators to select, drag-and-drop, connect, and configure connectors to create a fully functional Spark pipeline.

streamanal

The IDE can be used to receive data from a range of local data sources and data targets, and includes all the analytics and machine learning capabilities of StreamAnalytix on a single instance. There's also an option to export and scale out pipelines to a multi-node Spark cluster using the enterprise version of StreamAnalytix. 

Visual Spark Studio has drag-and-drop operators for data source, sink, transformation, and analytics, or you can use custom logic with Java and Scala operators. There's a pipeline designer for application development and built-in dashboards for real-time visualization of data. The data sources that you can write into include HDFS, Kafka, RDBMS, and Solr, and there are built in
operators for predictive models, Spark MLlib, ML and PMML for model-porting.
 

Visual Spark Studio is available for Windows, Linux and Mac, and while the aim of the developers is obviously to encourage you to move to StreamAnalytix, Spark Studio offers a useful way to get to grips with Spark and the concepts behind it.

 

sparkstudio

More Information

Visual Spark Studio Website

Related Articles

Spark Gets NLP Library

Apache Spark With Structured Streaming

Spark BI Gets Fine Grain Security

Spark 2.0 Released

Apache Spark Technical Preview

Spark Announcements

Apache Releases Spark 1.6

Spark 1.4 Released

SPARQL Moves Closer

 

To be informed about new articles on I Programmer, sign up for our weekly newsletter, subscribe to the RSS feed and follow us on Twitter, Facebook or Linkedin.

Banner


$200K Call For Code 2022 Announced
27/04/2022

Sustainability and climate change are the focus of this year's Call For Code, the annual contest for developers run by IBM, the David Clarke Cause, United Nations Human Rights, and the Linux Foundatio [ ... ]



Scratch At 15 - Worth Knowing About
18/05/2022

This week is Scratch Week, a global, virtual celebration of the block programming language for kids from MIT that this year celebrates its 15th anniversary.


More News

pythondata

 



 

Comments




or email your comment to: comments@i-programmer.info

Last Updated ( Thursday, 01 March 2018 )