Visual Spark Studio IDE For Spark Apps
Visual Spark Studio IDE For Spark Apps
Written by Kay Ewbank   
Thursday, 01 March 2018

A new free IDE has been released that lets you build, test and run Apache Spark apps on your desktop. Visual Spark Studio is a free cut-down version of the Impetus StreamAnalytix platform. It provides a lightweight development tool for data processing and analytics on Spark data.

Apache Spark is a general-purpose cluster computing framework, with native support for distributed SQL, streaming, graph processing, and machine learning.

sparkstudio

The new IDE can be used to build Spark apps for for both batch and streaming mode. It is a free, quick-start lightweight product that is a A Spark-only version of StreamAnalytix (an open-source enabled, enterprise-grade, stream processing and machine learning platform). Visual Spark Studio keeps the StreamAnalytix interface and has ready-to-use operators to select, drag-and-drop, connect, and configure connectors to create a fully functional Spark pipeline.

streamanal

The IDE can be used to receive data from a range of local data sources and data targets, and includes all the analytics and machine learning capabilities of StreamAnalytix on a single instance. There's also an option to export and scale out pipelines to a multi-node Spark cluster using the enterprise version of StreamAnalytix. 

Visual Spark Studio has drag-and-drop operators for data source, sink, transformation, and analytics, or you can use custom logic with Java and Scala operators. There's a pipeline designer for application development and built-in dashboards for real-time visualization of data. The data sources that you can write into include HDFS, Kafka, RDBMS, and Solr, and there are built in
operators for predictive models, Spark MLlib, ML and PMML for model-porting.
 

Visual Spark Studio is available for Windows, Linux and Mac, and while the aim of the developers is obviously to encourage you to move to StreamAnalytix, Spark Studio offers a useful way to get to grips with Spark and the concepts behind it.

 

sparkstudio

More Information

Visual Spark Studio Website

Related Articles

Spark Gets NLP Library

Apache Spark With Structured Streaming

Spark BI Gets Fine Grain Security

Spark 2.0 Released

Apache Spark Technical Preview

Spark Announcements

Apache Releases Spark 1.6

Spark 1.4 Released

SPARQL Moves Closer

 

To be informed about new articles on I Programmer, sign up for our weekly newsletter, subscribe to the RSS feed and follow us on, Twitter, FacebookGoogle+ or Linkedin.

Banner


Alexa In-Skill Purchasing Goes Live
14/05/2018

Amazon has announced the general availability of a way to make money from Alexa by expanding skills with premium features or content. Currently it is limited to the United States.



MySQL 8 Improves JSON
24/04/2018

MySQL 8 has been released with improvements including better mobile support, stronger support for Unicode, and schemaless JSON support.


More News

justjsquare

 



 

Comments




or email your comment to: comments@i-programmer.info

Last Updated ( Thursday, 01 March 2018 )
 
 

   
Banner
RSS feed of news items only
I Programmer News
Copyright © 2018 i-programmer.info. All Rights Reserved.
Joomla! is Free Software released under the GNU/GPL License.