Visual Spark Studio IDE For Spark Apps
Written by Kay Ewbank   
Thursday, 01 March 2018

A new free IDE has been released that lets you build, test and run Apache Spark apps on your desktop. Visual Spark Studio is a free cut-down version of the Impetus StreamAnalytix platform. It provides a lightweight development tool for data processing and analytics on Spark data.

Apache Spark is a general-purpose cluster computing framework, with native support for distributed SQL, streaming, graph processing, and machine learning.

sparkstudio

The new IDE can be used to build Spark apps for for both batch and streaming mode. It is a free, quick-start lightweight product that is a A Spark-only version of StreamAnalytix (an open-source enabled, enterprise-grade, stream processing and machine learning platform). Visual Spark Studio keeps the StreamAnalytix interface and has ready-to-use operators to select, drag-and-drop, connect, and configure connectors to create a fully functional Spark pipeline.

streamanal

The IDE can be used to receive data from a range of local data sources and data targets, and includes all the analytics and machine learning capabilities of StreamAnalytix on a single instance. There's also an option to export and scale out pipelines to a multi-node Spark cluster using the enterprise version of StreamAnalytix. 

Visual Spark Studio has drag-and-drop operators for data source, sink, transformation, and analytics, or you can use custom logic with Java and Scala operators. There's a pipeline designer for application development and built-in dashboards for real-time visualization of data. The data sources that you can write into include HDFS, Kafka, RDBMS, and Solr, and there are built in
operators for predictive models, Spark MLlib, ML and PMML for model-porting.
 

Visual Spark Studio is available for Windows, Linux and Mac, and while the aim of the developers is obviously to encourage you to move to StreamAnalytix, Spark Studio offers a useful way to get to grips with Spark and the concepts behind it.

 

sparkstudio

More Information

Visual Spark Studio Website

Related Articles

Spark Gets NLP Library

Apache Spark With Structured Streaming

Spark BI Gets Fine Grain Security

Spark 2.0 Released

Apache Spark Technical Preview

Spark Announcements

Apache Releases Spark 1.6

Spark 1.4 Released

SPARQL Moves Closer

 

To be informed about new articles on I Programmer, sign up for our weekly newsletter, subscribe to the RSS feed and follow us on Twitter, Facebook or Linkedin.

Banner


CISA Offers More Support For Open Source
22/03/2024

The Cybersecurity and Infrastructure Security Agency (CISA) has announced a number of key actions that they hope will improve the open source ecosystem.



Azure AI And Pgvector Run Generative AI Directly On Postgres
26/03/2024

It's a match made in heaven. The Azure AI extension enables the database to call into various Azure AI services like Azure OpenAI. Combined with pgvector you can go far beyond full text search. Let's  [ ... ]


More News

raspberry pi books

 

Comments




or email your comment to: comments@i-programmer.info

Last Updated ( Thursday, 01 March 2018 )