Nvidia inside: Hands on with Audi, Lamborghini, and Tesla

Nvidia now has partnerships with 14 car makers—we took three examples for a spin.

Come, explore the depths of the Lamborghini Aventador's infotainment system! Ha ha, just kidding. You'll be too focused on trying to leave the speed limit far behind without a cop noticing.

Megan Geuss

SANTA CLARA, CA—Outside of the visitor check-in on Nvidia's campus, three gorgeous cars—the Audi RS7, the Lamborghini Aventador, and the Tesla Model S—are parked, attracting the occasional gawking employee. Although Nvidia's partnership with the three car makers isn't anything new, we welcomed the chance to see just what the tech in these high-end cars is really like.

We also wanted to see what Nvidia hopes to offer car makers who are designing systems that will need to be cutting edge when their vehicles hit the market—a difficult task given the length of the automotive development cycle.

The car maker's challenge to stay ahead in tech is a topic that Ars is going to be revisiting over the next several months, so what better way to get our feet wet than to talk with the chip maker that has become synonymous with high-performance GPUs? Over the past five years, Nvidia has been making a big push into automotive technology, hoping to power not only the graphic information displays and entertainment systems that have become increasingly popular in cars, but also to get in on the ground floor of the self-driving systems of the future.

Currently, the chipmaker has partnerships with 14 car makers, from Volkswagen Group subsidiaries like Audi and Porsche, to BMW and Mini, to Peugeot and Tesla.

Connected in the driver’s seat

We hopped into the Audi RS7 first, taking a moment to go through the paces on the car's dashboard navigation and information display. The RS7 relies on Audi's Multi-Media Interface (MMI), in which the driver uses a control dial and a handful of side buttons to navigate through the display screen, rather than use a touch screen like many cars today do.

The RS7's system relies on a pre-Tegra automotive-grade processor to run Audi Connect, the company's proprietary companion software. This is hardly Nvidia's most powerful chip in the RS7, but the new Audi A3 does ship with Tegra 2 processors. The company hopes to sell more and more car makers on adopting its Visual Computing Module (VCM), which is a more powerful System on Chip (SoC) that's modular, so it can be easily upgraded to Nvidia's latest processor to keep up with increases in computing power. (Keep in mind, however, that this is designed for a car maker to keep ahead of the competition, not really for a customer to upgrade the processor in his or her car like one would upgrade an old CPU.)

In the car, Danny Shapiro, Nvidia's senior director of automotive, showed off the speed with which Audi Connect can call up cloud-stored information, particularly with respect to navigation. He pulled up directions to a restaurant and jazz club in Oakland called Yoshi's, and the display impressively rendered the map layout, responding to our dial turns as we zoomed in right up to street view.

Shapiro also noted that Audi contracts with numerous data aggregation companies to provide geographically aware information about the price of gas at refueling stations nearby, and even to show you whether there's still parking available in structures and lots in your area, and how much that parking costs. Suddenly, my decade-old Toyota Matrix started looking like a covered wagon.

Megan Geuss

You could zoom down into a map by turning the Audi's MMI dial.

Megan Geuss

You could zoom down into a map by turning the Audi's MMI dial.

Megan Geuss

What shall we search for today?

Megan Geuss

Need gas? Don't pick the nearest station like a sucker.

I got in the driver's seat at that point and drove the RS7 down to the 101 freeway for a little test drive. I always find it a bit difficult to process new in-dash layouts the first couple of times I drive a car, so although I found it distracting, getting from Google Maps to, say, music controls was easier for me to navigate with the MMI layout than in cars with touch-screen displays or with displays whose buttons are right next to the screen. (In particular, I recently spent a weekend driving a rental Chevy Cruze, and I've been in Priuses with the side-button layout. Leaning forward and making sure your finger makes contact with the correct button or screen space is an incredible distraction, in my opinion.) In the RS7, there seemed to be little or no lag between my inputs through the MMI system to the display on the center console.

The car felt premium in every way when it came to add-on features, despite it running old hardware. In the driver's seat, I noticed that Audi Connect lists not only navigation instructions in the center console, but also the speed limit in the area, so there's no more hunting for a sign while keeping your eyes peeled for cops.

The car also comes equipped with a heads up display that projects your current speed as well as turn-by-turn navigation at the bottom of your windshield. Ars has played with these types of devices before and had mixed feelings, but the displayed instructions were bright and unobtrusive in my opinion.

I should mention, the RS7 I was sitting in had 3G connectivity, but Shapiro assured me that newer models will be shipping with 4G. Our car was connected via Verizon, and apparently Audi will give you a free data plan for six months when you buy the car; after that you have to fend for yourself.

The console also has a row of two SD card readers and one SIM card reader beneath the display so you can play media (like music playlists, or, when the car isn’t in motion, movies) off external memory.

I parked the Audi because it was time for the Lamborghini. When it comes to computing, the Aventador runs what is basically the same kind of hardware that's in the RS7; Lamborghini is owed by Audi AG, so the MMI dial layout is largely the same, and the display is powered by—you guessed it—Nvidia.

The Aventador also has an identical row of ports for two SD cards as the RS7 does, but these ports are placed down by the driver’s right leg. Hopefully you’ll plan rest stops accordingly so that you won’t need a passenger to change the cards too often.

To be honest, after driving around in the RS7 I took a couple of swipes at the Aventador's system and realized I had seen all this before. But then I realized I was riding in a half-million-dollar car and sort of forgot my feature-focused line of inquiry and just let myself feel the ride. Unfortunately, if you only have five minutes to drive down route 101 and back, many of the mysteries of the 700-horsepower engine will remain unrevealed to you. Alas.

Enlarge/ The Aventador's instrument clusters show that it was hot as all heck outside in Santa Clara earlier this week.

Megan Geuss

While we were driving, a Lamborghini product specialist said that consumers of such a car are increasingly interested in the kind of computing power that their prospective vehicle runs, but he assured me that it's far from the first thing that a person thinking about buying an Aventador is looking for. That makes sense, as the sports car basically runs a previous-generation version of Audi Connect, without many of the bells and whistles that we experienced in the first test drive.

After a jaunt in that machine, Ars hopped in the Tesla Model S. We’ve already reviewed the Model S extensively, so there’s no need to go into it in too much detail, but we will note that the interior of the car eschews a center console for a giant 17" touch-screen display, which you can use to bring up driving directions, navigate the Web, and play music and radio. The display is capable of split-screen view, and certain functions (like turn-by-turn driving directions) can be called up and will appear both on the center display and the instrument cluster, which are powered by a Tegra 3 and Tegra 2 processor, respectively.

In our hands-on, the two processors talked to each other quickly, without much lag. Scrolling through Ars in full screen mode on the center display, however, did suffer from jerky scrolling and failed to register some touches.

Enlarge/ The digital instrument cluster can show all kinds of information.

Megan Geuss

Tesla’s Model S uses Nvidia’s VCM, so the electric car maker has the ability to upgrade the SoC on the module without changing the car’s design. Newer Model S’ may well contain more recent SoCs if Tesla so chooses.

On the road to compute power

Although the cars we tested were using older technology, Nvidia stressed that it was in the best position to provide all of a car’s graphics needs in the coming decade. The company has competition from the likes of Qualcomm and ARM, which are also developing power-sipping chips that can still do on-the-spot navigation, stream radio, post locations to Facebook, and could eventually detect other cars, and even people, in the car’s driving space.

Danny Shapiro and Alan Hall, Nvidia's Senior Communications Manager for Automotive, told Ars that the move for Nvidia into the automotive space was a natural one, as car developers have long used the company’s GPUs to design cars and to do fluid dynamic and aerodynamic modeling. Now Nvidia wants auto manufacturers to rely on it for all aspects of the business, from powering consoles in showrooms that allow prospective buyers to build customized cars, to allowing drivers to pick their own skin on digital instrument clusters above the steering wheel.

Enlarge/ In the future, you can make the tachometer purple and the fuel gauge green something!

Megan Geuss

The company also talked up its Jetson Development Kit, which is currently shipping to a select group of developers, suppliers, and automakers. The kit was made to help car manufacturers go from prototype to product faster when it comes to in-car information systems, and the kit, like the VCMs that Nvidia is selling, has a modular design that allows for the VCM to be broken out and replaced as computing power evolves. This, Nvidia reasons, will allow cars that usually have a long development cycle to keep up with quickly improving hardware.

The Jetson Pro main board supports Linux and Android as well, and it comes with a touchscreen display and an optional digital instrument cluster display.

Enlarge/ Developers will get to check their systems on something that looks like this Jetson Development Kit.

Megan Geuss

While this may not seem like much to the average consumer, who will likely never interact with an automotive development kit, Nvidia had two demonstrations of the types of programs that can be modeled for potential use in a car on such a kit.

In the first, a loop of video taken from a car on the highway was processed to show the speed and distance of other cars in the vicinity. Shapiro said that someday soon, a car will be able to process such visual information in real time and, say, beep an alert at the driver if they’re getting too close to a car, or if they're coming in too fast on a slowing car.

Nvidia's second demonstration showed a car that can detect when you’ve hit traffic. When it does so, it will go into a sort of “stop-and-go cruise control,” so the driver no longer has to be hitting the brake all the time. (As someone who grew up in Los Angeles and returns to that city frequently, I resisted the urge to shout "Shut up and take my money!")

Shapiro assured me that this feature only works in a single lane of traffic—it won’t move you over to the next lane if those cars appear to be speeding by (although that’s only ever an illusion anyway), nor can it be used to maneuver non-highway driving. But still, it’s easy to imagine that for all of the flashy press that Google’s self-driving cars have received, this is the way self-driving cars will become a reality: piece by piece, until consumers trust the machines enough to let them do most of the driving.

Which brings us to the more-distant future. In Nvidia’s showroom, the company had an Advanced Driver Assistance System (ADAS) on display, which will in fact detect humans and other obstacles that pass in front of the car’s field of vision, using a constantly spinning laser sensor to assess the surrounding area. Such a system would naturally take an awful lot of computing power, and the as-yet-unreleased Tegra K1 SoC is the cutting edge system that the company says will be able to navigate such a car autonomously.

Announced this January at CES, the 64-bit Tegra K1 will have 192 CUDA cores and should have computing power comparable to Nvidia’s GeForce GT 630 or 635 dedicated GPUs.

Although a car with Tegra K1 in it is a long way off, it's nice to dream, and if the present informs the future, I'm looking forward to buying a "gently used," decade-old, self-driving car with 100,000 miles on it in a decade or two (or three). You have to have dreams, after all.

61 Reader Comments

"In the first, a loop of video taken from a car on the highway was processed to show the speed and distance of other cars in the vicinity. Shapiro said that someday soon, a car will be able to process such visual information in real time and, say, beep an alert at the driver if they’re getting too close to a car, or if they're coming in too fast on a slowing car."

Not sure how this is going to be new. My 2013 Honda has a camera above the rear view mirror that already feeds this into the car's computer, and based on the fact mine doesn't do Nav or any of the other above functions it is marginally less powerful than a Tegra 3.

Curious that the Aventador's center console has a button to switch it into two of Europe's most mundane cars, the Strada and Corsa.Pictured: Ritmo (aka Strada) & Corsa. Two cars voted mostly likely to sport the "My other car is a Lamborghini" sticker.

To me this is such a bad idea. Spend a fortune on a car, yet in 2-3 years those entertainment units will be obsolete. People are still going to want them to integrate with their smartphones. With such a low volume of units, are they really going to be able to support the units as smartphone technology evolves every year? Past experience has been "no".

I'd rather have a general-purpose CPU and head-unit that can be replaced if desired by the owner after the stock unit becomes obsolete.

In the last picture is that blue unit a modified Rotoscan? Our printing presses have those things minus the camera mounted to the top to prevent people from walking into the moving equipment. SICK manufactures ours as well, but they are yellow.

"In the first, a loop of video taken from a car on the highway was processed to show the speed and distance of other cars in the vicinity. Shapiro said that someday soon, a car will be able to process such visual information in real time and, say, beep an alert at the driver if they’re getting too close to a car, or if they're coming in too fast on a slowing car."

Not sure how this is going to be new. My 2013 Honda has a camera above the rear view mirror that already feeds this into the car's computer, and based on the fact mine doesn't do Nav or any of the other above functions it is marginally less powerful than a Tegra 3.

My Nissan Qashqai (2014) also has a front camera, and beeps when I get too close too fast to the vehicle in front of me. It will even apply the breaks if I don't react at all to the front collision alert. And it keeps an eye on the traffic lanes, and beeps when I cross a line without using a turn signal.

Looking forward to being killed while crossing the street by some tool surfing the net while driving.

And you'll never hear it coming because electric cars are silent stalkers.

Tyre/tire noise is the loudest part of a car in the 21st century.You probably know that, but just want to say something bad about electric cars.

If you think that, I'd like to introduce you to my diesel rig...

Quote:

the as-yet-unreleased Tegra K1 SoC

Also, as a side note, the Tegra K1 SoC is ALREADY shipping, in the form of the Jetson. If the above quote from the article pertains to production stock or the 64 bit Denver based version, then fine, but otherwise it's a factually incorrect statement.

Buying an expensive car that still has a Tegra 2 in 2014 is one reason why this solution verses a dumb display connected to your smartphone isn't that great of an option.

+1 billion. Add the way Apple, Google, MS seem to all be hell bent on locking your entertainment system into their world and there's an even more compelling reason to just want a dumb screen with apps on your device of choice that interact with it. That, or let the automakers offer you a choice, you can get you car in Apple, Google, or MS options...

Add the way Apple, Google, MS seem to all be hell bent on locking your entertainment system into their world and there's an even more compelling reason to just want a dumb screen with apps on your device of choice that interact with it. That, or let the automakers offer you a choice, you can get you car in Apple, Google, or MS options...

The car makers should come up with a bluetooth profile to connect your device with the car.

They did after all define a common connector for car stereo's. This should be the same, but updated for 2014.

A car that costs in the mid six figures in euros dollars or pounds is not representative of the typical road vehicle. If you can only hear a car as loud as a Lamborghini then you need hearing aids, and will be run over by anything that has an exhaust silencer on it.

Tyre/tire noise is the loudest part of a car in the 21st century.You probably know that, but just want to say something bad about electric cars.

If you think that, I'd like to introduce you to my diesel rig...

Is your diesel rig a car?I thought rig was usually used to mean trucks.If you do mean a car with a diesel engine, you will find that most modern cars, petrol or diesel, are very quiet indeed. The busy road outside where I live is a source of tyre noise, not vroom!vroom! noises.

A car that costs in the mid six figures in euros dollars or pounds is not representative of the typical road vehicle. If you can only hear a car as loud as a Lamborghini then you need hearing aids, and will be run over by anything that has an exhaust silencer on it.

Tyre/tire noise is the loudest part of a car in the 21st century.You probably know that, but just want to say something bad about electric cars.

If you think that, I'd like to introduce you to my diesel rig...

Is your diesel rig a car?I thought rig was usually used to mean trucks.If you do mean a car with a diesel engine, you will find that most modern cars, petrol or diesel, are very quiet indeed. The busy road outside where I live is a source of tyre noise, not vroom!vroom! noises.

You made an unqualified statement. And insurance in fact classifies it as a car, yes.

And I'm guessing based on your spelling you aren't from the US. We have...very different tuning and types of vehicles over here. Bigger is still better, and all that.

You expect statements about cars to be made based on unrepresentative examples of a car. Ones that, by your own admission, are called rigs by their owners and cars only by inusrance co.s?Feel free to expect it, it won't get you far.

"Car" to most people means an automobile, a small vehicle for transporting people rather than for haulage.Given that the tyre noise comment was in response to some "electric cars are silent killers" nonsense. It is unreasonable to compare such vehicles to anything but typical cars. Comparing the noise generated by an electric VW golf, or a hybrid lexus to that generated by a Ford F150 is not valid in any way at all.

You expect statements about cars to be made based on unrepresentative examples of a car. Ones that, by your own admission, are called rigs by their owners and cars only by inusrance co.s?Feel free to expect it, it won't get you far.

"Car" to most people means an automobile, a small vehicle for transporting people rather than for haulage.Given that the tyre noise comment was in response to some "electric cars are silent killers" nonsense. It is unreasonable to compare such vehicles to anything but typical cars. Comparing the noise generated by an electric VW golf, or a hybrid lexus to that generated by a Ford F150 is not valid in any way at all.

No-one replaces a "diesel rig" (your words) with an electric car.

Speaking of silent killers, I've seen multiple people in DC coming dumb close to getting hit by Prius getting out of parking spots and not paying attention. I've been caught off-guard a few times by a few of them myself (and a Leaf that belongs to a guy in my office). Surely that won't be "killer" but could land someone in the hospital for mild injuries at least.

So tire noise my buttcheeks, these cars are pretty darn silent especially if you happen to have any background noise (cities or just mid-size towns) or some other vehicle is also on the road. There's a reason that there is much debate about requiring these cars to make some sort of (artificial) noise. It's not just an academic debate.

Plus, and this is where my subjectivity comes into play for sure, most drivers of these cars are atrocious. I'm not using this word lightly, and this will only compound the problem in my mind.

Dumb terminals => ain't gonna happen. Tesla's center-console OS defines the car. It's more than just nav or browsing, it controls all aspects of the car. Controlling and defining the experience is key for UI and safety reasons.

Really doesn't matter. If automated cars work out, you'll just be a passenger in a pod fooling around with your own devices while the car goes about its business.