NVIDA Updates Free Deep Learning Software
Written by Mike James   
Monday, 15 May 2017

There was a time when NVIDA was thought of as a maker of hardware for high end games machines, but the need for powerful number crunching has propelled the GPU maker into new areas and now it is one of the leaders in AI. 

NVIDA has some help for you if parallel computation on a GPU is your concern. Of course it has to be an NVIDA GPU card you are targeting, but you wouldn't expect them to promote someone else's hardware, would you?

The first piece of news, however, is that the number of people interested in using the GPU for computation is growing very fast:

 

gpu

 

This is an indication of just how useful GPU approaches to general computation are. NVIDIA has been helping the interest along with its free SDK and it has just announced a new version with these improvements:

 

  • New CUDA 9 speeds up HPC and deep learning applications with support for Volta GPUs, up to 5x faster performance for libraries, a new programming model for thread management, and updates to debugging and profiling tools.

  • Developers of end-user applications such as AI-powered web services and embedded edge devices benefit from 3.5x faster deep learning inference with the new TensorRT 3. With built-in support for optimizing both Caffe and TensorFlow models, developers can take trained neural networks to production faster than ever.

  • Engineers and data scientists can benefit from 2.5x faster deep learning training using Volta optimizations for frameworks such as Caffe2, Microsoft Cognitive Toolkit, MXNet, PyTorch and TensorFlow.

Notice that most of these speed ups are credited to the latest Volta GPU architecture from NVIDA. Volta is designed specifically for data processing and AI in particular. With 640 Tensor cores it is claimed to offer 100 Teraflops per second. Google recently published some benchmarks which show that Tensorflow almost scales linearly with the number of Volta P100 GPUs actually used:

gputensor

You can't help but think "this would be good for graphics!"

Silly idea! Why waste computing power on graphics?

Can anyone remember what the G in GPU stands for these days?

gpulogo

More Information

NVIDIA Delivers New Deep Learning Software Tools for Developers

TensorFlow Benchmarks and a New High-Performance Guide

Related Articles

TPU Better Than GPU 

TensorFlow Reaches Version 1 

//No Comment - BB8 autonomous car 

NVIDIA's Neural Network Drives A Car 

A Billion Neuronal Connections On The Cheap 

To be informed about new articles on I Programmer, sign up for our weekly newsletter, subscribe to the RSS feed and follow us on Twitter, Facebook or Linkedin.

 

Banner


AWS Introduces A New JavaScript Runtime For Lambda
19/03/2024

Amazon has announced the availability, albeit for experimental purposes, of a new JavaScript based runtime called Low Latency Runtime or LLRT for short, to bring JavaScript up to the performance throu [ ... ]



AWS Lambda Upgraded To .NET8 Runtime
25/03/2024

An upgrade of AWS Lambda to the .NET version 8 runtime
brings major improvements to the platform.


More News

raspberry pi books

 

Comments




or email your comment to: comments@i-programmer.info

 

Last Updated ( Monday, 15 May 2017 )