Amazon Kinesis For Real-Time Processing of Data
Amazon Kinesis For Real-Time Processing of Data
Written by Kay Ewbank   
Monday, 18 November 2013

Amazon has announced Kinesis, a fully managed service for real-time processing of high-volume, streaming data.

The new service means it should be easier to write apps that interact with real-time data feeds such as click-streams from websites, social media feeds, or financial transaction logs.

 

According to its web page, Amazon Kinesis lets you store and process terabytes of data an hour from hundreds of thousands of sources. Apps that use Kinesis will be able to show data on real-time dashboards or send data to other big data services such as Amazon Simple Storage Service (Amazon S3), Amazon Elastic Map Reduce (Amazon EMR) or Amazon Redshift. The service deals with scaling to manage and process data streams of nearly any size. It also replicates the data across multiple Amazon Availability Zones to help ensure high durability and availability.

The advantage the new service offers over systems such as Hadoop is the support for streaming feeds of real time data. If you need to manage such data, there are open-source options such as Storm and Kafka, and commercial systems including Google BigQuery. Kinesis goes further in streaming than BigQuery, and takes care of the infrastructure and provisioning which you have to manage yourself with the open-source alternatives. What you get instead is a service where you only have to specify the data you want to work with, how much data you expect, and where the data should be sent to. Kinesis comes with a client library that takes care of aspects such as load balancing, coordination and fault tolerance, and you can use AWS Auto Scaling to create elastic, high-performance Amazon Elastic Compute Cloud (Amazon EC2) processing clusters.

 

 

You can work with Kinesis either from the AWS Management Console, or by making an API call. Either way creates a data stream that captures and stores data as it is submitted. The data is then available to applications, open source streaming tools, and data stores such as Amazon S3 or DynamoDB.

As with the other two cloud-based services Amazon announced last week at its AWS re:Invent conference, Kinesis is currently only available as a limited preview and developers are with AWS accounts are invited to sign up to join a waiting list.

awskinesis

 

More Information

Amazon Kinesis

Related Articles

Amazon AppStream - Let The Cloud Do The Heavy Lifting

Elastic MapReduce Demo Shows How to Handle Large Datasets

AWS Adds Features, Cuts Prices

Amazon dumbs down AWS with appliances

Google Announces Compute Engine - At Last An Alternative to Amazon AWS

 

To be informed about new articles on I Programmer, install the I Programmer Toolbar, subscribe to the RSS feed, follow us on, Twitter, Facebook, Google+ or Linkedin,  or sign up for our weekly newsletter.

 

justjsquare

 



 

Comments




or email your comment to: comments@i-programmer.info

 

Banner


Udacity Launches Data Scientist Nanodegree
24/05/2018

Udacity has launched a new Data Scientist Nanodegree program. At an advanced level it has projects designed by Bertelsmann, Figure Eight, IBM Watson, Insight, Kaggle and Starbucks which map to the ski [ ... ]



Supreme Court To Rule On Apple App Store Monopoly
20/06/2018

There's another strange twist in the story of the modern app store - the Supreme Court has decided that it will rule on whether or not the Apple App Store is a monopoly or not. The strange part is tha [ ... ]


More News

As

Last Updated ( Wednesday, 20 November 2013 )
 
 

   
Banner
Banner
RSS feed of news items only
I Programmer News
Copyright © 2018 i-programmer.info. All Rights Reserved.
Joomla! is Free Software released under the GNU/GPL License.