There was a time when NVIDA was thought of as a maker of hardware for high end games machines, but the need for powerful number crunching has propelled the GPU maker into new areas and now it is one of the leaders in AI.

NVIDA has some help for you if parallel computation on a GPU is your concern. Of course it has to be an NVIDA GPU card you are targeting, but you wouldn't expect them to promote someone else's hardware, would you?

The first piece of news, however, is that the number of people interested in using the GPU for computation is growing very fast:

This is an indication of just how useful GPU approaches to general computation are. NVIDIA has been helping the interest along with its free SDK and it has just announced a new version with these improvements:

New CUDA 9 speeds up HPC and deep learning applications with support for Volta GPUs, up to 5x faster performance for libraries, a new programming model for thread management, and updates to debugging and profiling tools.

Developers of end-user applications such as AI-powered web services and embedded edge devices benefit from 3.5x faster deep learning inference with the new TensorRT 3. With built-in support for optimizing both Caffe and TensorFlow models, developers can take trained neural networks to production faster than ever.

Notice that most of these speed ups are credited to the latest Volta GPU architecture from NVIDA. Volta is designed specifically for data processing and AI in particular. With 640 Tensor cores it is claimed to offer 100 Teraflops per second. Google recently published some benchmarks which show that Tensorflow almost scales linearly with the number of Volta P100 GPUs actually used:

This sounds like another thing to be worried about, if that is, you are worried about AI taking over the world. We might be getting used to AI learning to beat humans at arcade games and even Chess an [ ... ]

Apologies for the over-the-top headline. The technique works with any voice-driven assistant and, yes I know, Alexa doesn't have ears. The idea is simple and it seems fairly effective. It allows you t [ ... ]