Tag: AI

Nvidia has been in the machine learning and AI game for a number of years now. The company launched the Jetson TX1 “Supercomputer-on-Module” back in 2015 as an embedded solution for robots, drones, and self-driving vehicles that need to do a lot of visual computing. It was the start of a whole range of “AI” products from Nvidia that has proved to be successful. Nvidia says there are hundreds of thousands of Jetson developers today. While it was a workable solution for commercial enterprises, its $599 price tag meant it was often too costly for makers, hobbyists, and amateur enthusiasts.

Related

Artificial Intelligence vs Machine Learning: what’s the difference?

Artificial intelligence and machine learning are terms which have been thrown around a lot in the tech industry over the last few years, but what exactly do they mean? Anyone vaguely familiar with sci-fi tropes will probably …

Today that has all changed with the launch of the Jetson Nano, a $99 AI computing development kit that opens the way to a Raspberry Pi-like revolution — this time for machine learning.

The secret sauce in Nvidia’s AI products is, of course, its GPUs. The Jetson TX1 used a 1024-GFLOP Maxwell GPU with 256 CUDA cores. The TX2 offers 1.3 TFLOPs using a 256-core Pascal GPU, and the top-of-the-range Jetson AGX Xavier breaks 10 TFLOPs with its 512-core Nvidia Volta GPU. But the Jetson AGX Xavier also breaks the $1,000 barrier as well! For the $99 Jetson Nano, Nvidia has opted for a 128 CUDA core GPU, based on the Maxwell architecture. It offers 472 GFLOPs.

Supporting the GPU is a 64-bit quad-core Arm Cortex-A57-based CPU, 4GB of RAM, a video processor — which can handle up to 4K 30fps encode or 4K 60fps decode — and support for PCIE and USB 3.0.

The video capabilities of the Jetson Nano are impressive. The idea isn’t that you can watch 4K video, but rather that the unit can process multiple video streams (think about drones with multiple cameras) for object detection, tracking, and obstacle avoidance. While 4K 60fps sounds nice, the Jetson Nano is capable of decoding eight video/camera feeds at Full HD at 30 frames per second! Once decoded the streams can be processed simultaneously by the machine learning algorithms for object tracking etc.

The Jetson Nano comes in two forms. A module — which measures just 70 x 45mm — for use in final production ready designs, and a development kit that resembles a Raspberry Pi and offers a turnkey solution for developers and enthusiasts. The former comes with 16GB of eMMC on-board storage while the latter uses a microSD card.

Unlike previous iterations of the Jetson platform, Nvidia foresees two distinct (but related) uses of the Jetson Nano. On one hand, the development kit will be useful for commercial organizations that want to build products with machine learning capabilities. The product can be designed using the development kit and then for the final product the modules is used. This is how the other Jetson boards and modules are used. The second use case is for enthusiasts and hobbyists who may never use the module version but are happy to create projects based around the development kit, much like the Raspberry Pi.

To that end, Nvidia is ready to sell both the modules and the development kits, not just via wholesale distributors, but to a wider market via more conventional outlets.

Raspberry Pi killer?

The Raspberry Pi uses a quad-core Cortex-A53 based processor and comes with a maximum of 1GB of RAM. While it can be fun for running simple Python scripts and other basic tasks, it can be painful to use as a desktop environment. The Jetson Nano has a quad-core Cortex-A57 based CPU and 4GB of RAM. That should mean it should be at least twice as fast a the Raspberry Pi for non-machine learning tasks. Plus, the extra RAM should allow it to run a desktop environment more smoothly.

On top of that, the Jetson Nano comes with 40 GPIO pins, just like the Raspberry Pi. While Nvidia doesn’t specifically specify Raspberry Pi compatibility, it does say that the Jetson Nano is “compatible out of the box with many peripherals and other add-ons.” There is also support for the Adafruit Blinka library and the Raspberry Pi Camera V2. The board boots to a full Linux desktop environment via Linux4Tegra, which is derived from Ubuntu 18.04

In other words, the Jetson Nano is just like a Raspberry Pi, but better, stronger, faster! Add all the ML goodness on top and you have a potential game changer.

JetBot

To demonstrate the board’s capabilities Nvidia is launching the JetBot, an open-source AI project based on Jetson Nano. It comes complete with a bill of materials, hardware setup guide, and tutorials. The idea is that anyone with some basic Python skills should be able to build the small robot and learn all about motor control, camera image acquisition, and and AI training by teaching JetBot to follow objects, avoid collisions, etc.

Multiple devices, same software

One reason why the Raspberry Pi has been so successful, compared to other Arm based Single Board Computers, is that the software is always been updated. There are way too many boards which offer initial support for a version of Linux and then the distribution is never updated or upgraded. No security fixes, no new packages, and certainly no new versions of the kernel.

Nvidia understands this and is doing a good job of keeping it software current and relevant. The Jetson TX1 supported Linux 3.10 and used Ubuntu 14.04. Over time, support fort kernel 4.4 was added followed by kernel 4.9. Likewise, the base Ubuntu distribution has been upgraded from 14.04 to 16.04 and now 18.04.

This means Nvidia is offering a unified development environment across all of its Jetson boards. You could start developing a project on the Jetson Nano, but then if you need more GPU power then an upgrade to a more advanced Jetson board will incur little or no penalty from a software perspective.

It looks like the Jetson Nano could be a fantastic board. The price is good, the general computing performance is significantly better than Raspberry Pi, the machine learning features (both software and hardware) are excellent, and the the potential compatibility with existing hats and sensors means hobbyists can use (and improve) existing projects. I should be getting my hands on a board very soon, so watch out for a full review here and on the Gary Explains YouTube channel.

Affiliate disclosure: We may receive compensation in connection with your purchase of products via links on this page. The compensation received will never influence the content, topics or posts made in this blog. See our disclosure policy for more details.

If you’ve found Google’s Gboard voice dictation frustrating to use, we have good news — Google has just updated Gboard with AI-powered offline dictation that should be a big improvement from before.

As Google details in its blog post, the voice dictation improvements were made possible with accuracy improvements through deep learning. The “prime focus” of several architectures was to reduce the amount of time it takes for your speech to be transcribed.

The result is an end-to-end, all-neural speech recognizer that lives in Gboard and on your device. The good news is that the speech recognizer doesn’t need an internet connection to work and is 80MB in size. That’s compared to past models that were 2GB in size and later went down to 450MB.

Editor’s Pick

10 best Android keyboards for all kinds of typists

For many people, the default keyboard that comes on their devices is passable. It is usually either the stock Android keyboard or the OEM keyboard from Samsung, LG, etc. However, those are not your only options. …

Even better, the new speech recognizer outputs character-by-character instead of word-by-word as you speak. That’s made possible through “a feedback loop that feeds symbols predicted by the model back into it to predict the next symbols.”

Putting all of this together, Gboard’s voice dictation feature should work more reliably, more quickly, and more accurately than before.

Gboard’s upgraded speech recognizer is rolling out now to Pixel smartphones and is limited to American English dictation. You can enable it if you go to Gboard settings > Voice typing > Faster voice typing. We could see Gboard’s upgraded speech recognizer in additional languages and devices in the near future.