Hands Off with Google Goggles

For what I (and Google) can see, Google Goggles might be one of the next evolutionary steps of mobile search. It was originally announced at Google's search announcement on Monday, but Google representatives gave a more detailed demonstration outside the main conference room.

Basically, think of Goggles as object recognition, but with your phone's camera serving as your eye. How might you identify an unfamiliar object? Perhaps by shape or by context. Does it have text printed on it? That's also helpful. And it might also help if you had millions of photographs in your memory to compare objects to, as Goggles does.

How is this useful? Well, for shopping, perhaps. Identifying an object that isn't properly labeled is certainly useful, especially if you're overseas. There's tourism, too: Goggles was smart enough to identify a painting in a demonstration, which linked, of course, to a variety of supplemental information. And some noteworthy objects can be found outside of a museum: the Transamerica Pyramid, for example, or the Golden Gate Bridge. Even home repair might be assisted by a computer-generated search for an otherwise unidentifiable widget.

Goggles can perform facial recognition, but it hasn't yet found a business case that would justify it, according to a product demonstrator who didn't identify himself. Although an obvious solution would be tagging, Google is still wrestling with how permissions would work and who would be allowed to tag photos, he said.

Google Goggles works with the Android operating system, and representatives demonstrated the technology working on new Droids at the event. Using the camera, the demonstrator snapped an image of a book cover, with some cartoonish text on the front.

In this case, Goggles has a couple of options: to try and "read" the text and compare it against a text database, or to try and match the image or a portion of it against its own database. Keep in mind that Google can crawl a variety of online bookstores, pulling in content from there. In separate instances, Google identified the image against an image database, identifying the book and offering a link to an online bookseller. In another instance, scanning the book's bar code would have provided a link to Hong Kong, where the demonstrator purchased the book, he said.

In another demonstration, Goggles correctly identified an American Express card from an ad. This unwittingly pointed out a limitation of the technology. For now, Goggles transfers and analyzes data in black and white, so the card was identified as a gold American Express card, not as the green card that appeared in the ad—obviously, a key identifying characteristic.

Goggles can also identify landmarks, although how it can do that isn't exactly clear. What it can do, however, is match the item against its photographic database, so an obvious landmark such as twe Arc de Triomphe in Paris, can be clearly identified. In the future, Google plans to use information gathered from some other sources to add more context: for example, to use a café located in the background of the picture to add location information.

If an object can be found in Google's database, chances are that it can be identified. But it's less clear how Goggles will fare with familiar objects from unfamiliar perspectives: WBill the Statue of Liberty be identifiable, for example, in a photo taken from the statue's base? Or behind it? Time will tell, I suppose.

At this point, Goggles appears somewhat rudimentary. But it represents what Vic Gundotra, vice president of engineering for Google, called "an eye to the cloud": By combining the camera of a smartphone with the vast cloud-based search, recognition, and contextual databases available to Google, Google has added another dimension to its search inputs.

Potentially, what you can see can be searched. And that's the significance of Goggles in a nutshell. Will it be a success? Well, Google sees quite a bit these days. And what Google sees, Google seems to know.

Automatic Renewal Program: Your subscription will continue without interruption for as long as you wish, unless
you instruct us otherwise. Your subscription will automatically renew at the end of the term unless you authorize
cancellation. Each year, you'll receive a notice and you authorize that your credit/debit card will be charged the
annual subscription rate(s). You may cancel at any time during your subscription and receive a full refund on all
unsent issues. If your credit/debit card or other billing method can not be charged, we will bill you directly instead. Contact Customer Service

//Stay Connected

Get Product Reviews, Deals, & the Latest News from PCMag

sign up

Plus, get a free copy of PCMag for your iPhone or iPad today.

Offer valid for new PCMag app downloads only. Subscribing to a newsletter indicates your consent to our Terms of Use and Privacy Policy.

THANK YOU FOR SUBSCRIBING!

Please follow this link (or search for the PC Magazine app on your iPad or iPhone) to get your free issue. Offer valid for new app downloads.

//our current issue

Select Term:

24 issues for $29.99 ONLY $1.25 an issue! Lock in Your Savings!

12 issues for $19.99ONLY $1.67 an issue!

State

Country

This transaction is secure

Automatic Renewal Program: Your subscription will continue without interruption for as long as you wish, unless
you instruct us otherwise. Your subscription will automatically renew at the end of the term unless you authorize
cancellation. Each year, you'll receive a notice and you authorize that your credit/debit card will be charged the
annual subscription rate(s). You may cancel at any time during your subscription and receive a full refund on all
unsent issues. If your credit/debit card or other billing method can not be charged, we will bill you directly instead. Contact Customer Service