Posted
by
CmdrTacoon Thursday August 27, 2009 @12:02PM
from the evolve-no-neck dept.

blackbearnh writes "With the release of the 3.1 iPhone OS, application developers will finally be able to develop augmented reality (AR) apps. In other words, Terminator Vision is right around the corner. O'Reilly Media recently talked to Chetan Damani, one of the founders of Acrossair, about how they developed their new AR application, Nearest Tube, which displays the closest London Tube stations over a live video overlay on an iPhone 3GS. According to Damani, developing AR applications on the 3GS is dead easy, and the real trick will be developing good augmented reality apps. 'It's all about who's going to have the most amount of data and the most valid data. So there's the obvious types of apps which you're going to launch and those are the find me my nearest bar, find me my nearest event, find me the nearest tube stop, find me the nearest ATM. And those sorts of apps are all going to be around. But they're only going to be useful for when you're trying to look for things. So if we want to get users to use augmented reality a little bit more, we have to start introducing other bits of functionality, things like show me the offers available in a particular high street. Show me when I'm walking down a high street if there's a table available at a particular restaurant. And it's that sort of interactivity and providing that real-time data in this augmented reality view which is going to start getting people to use it a lot more rather than just for show me where the nearest area is.'"

Actually, Slashdot is on the verge of releasing their own augmented-reality iPhone app.
It will use the camera to visually assess the person you're talking to. Using various AI and fuzzy-logic techniques, it will assess the things the person most likely feels self-conscious about that day.
It will then use the 3g to access a database of previous slashdot comments, and suggest 10 appropriately snarky things to say.

It will then use the 3g to access a database of previous slashdot comments, and suggest 10 appropriately snarky things to say.

I'd be happy if it would just keep track of their (personally tailored) karma status. If a Jehova's Witness shows up at my door and my head's-up display says DFTT, it would save me about an hour a month. (Not that I don't enjoy feeding the trolls, it's just not productive).

Additionally, if I'm looking at some building/statue/whatever and somebody walks up with a comment that I interpret as 50% BS/50% Insightful and has 'Super-kadooper-excellent-karma' floating above his head, I may actually listen to what he has to say.

Great! Just what we need! More ways people can walk around staring at a device in their hands while being utterly oblivious to their surroundings. And yet this is all about informing them of their surroundings. Oh, the irony...

Great! Just what we need! More ways people can walk around staring at a device in their hands while being utterly oblivious to their surroundings. And yet this is all about informing them of their surroundings. Oh, the irony...

I enjoy driving while looking through Terminator Vision on my iPhone. I have an app that tells me the year, make and model of the vehicle I'm about to make contact with. Then I use my iGun application [youtube.com] to finish them off.

Great! Just what we need! More ways people can walk around staring at a device in their hands while being utterly oblivious to their surroundings. And yet this is all about informing them of their surroundings. Oh, the irony...

Sounds to me like a great AR app. You walk around with your iPhone in front of you, and periodically, a message flashes up that says something like, "Move, dumbass, you're about to hit something."

I'd be more apt to have the app recognize the face of the people around and discretely let me know what i am not perceiving already with my uber-human sensory organs. Like understand the turkey quotient of someone's flatulence, or the true emotion - as opposed to the deceiving portrayal of one - sneaking around in the salesmen inflections of speech that can not be perceived by the human ear.

I'm pretty sure that tube means subway station, thats what they call it in england. They also make sure to tell you to "MIND THE GAP", which means to look out for the space inbetween the train and the station, but for some reason people have started putting it on underwear.

People holding up their iPhone's looking for a subway or resturant.
People staring down at their phone texting somebody.
People lying on the ground trying to get upskirt photos.
People flailing their arms around in circles, hitting anyone in reach, trying to use body language whilst talking through a bluetooth headset.

The rest of the world trying to take videos of all that and uploading them to YouTube.

I use my Iphone-like device to "augment" my reality with auditory information received as if by magic from someone not in the same room for me, which is then transmitted directly into my ear. The device features voice-control, to allow me to respond to the other person merely by speaking.

I haven't seen this on Slashdot yet - maybe we'll get a story when it's On Your Iphone.

If this is what they mean by "augmented reality" then I must confess I am singularly unimpressed. Every single use case discussed in the summary is done better and much quicker with a simple top down map/gps interface like Google Maps.

But it's not On Your Iphone! That's what makes it augmented reality - because a feature that's been commonly available for years is "augmented" with the reality distortion field. TFS must have missed a bit off - it's "Augmented Reality Distortion Field", something that no othe

With Apple's current attitude acting as a moderator for all apps and trying best not to anger anybody, I wonder how any of the above dreams will be realized. So someone makes an app for showing which restaurant has available seating. Next day restaurant sues apple for some privacy invasion crap. Next thing apple pulls app down.

One word helped me understand:
Fanboys
Especially with the app store, the idea had already existed for a long time, but pretty much wasn't used. Somehow, when apple comes out with something innovative, all previous existences of the same idea are wiped from the collective puiblic's mind, much like 1984, but controlled by a corporation and not the government. Nokia had an app store for a long time, t-mobile had T-zones, and there were probably others that i dont know about, including nintendo's online store

It seems that Android already got something from the next generation of AR applications (multi-topic, interactive). They hope to port it to iPhone soon. It looks to be considerably more advanced compared to what is given in original story.

I just whip out my phone and BAM! There's the nearest drug dealer. BAM! There's the nearest hooker! BAM! There's the cops, with a red outline so you know they are baddies. I think I could get used to this...

Actually, even though you might be a way from finding hookers and blow (I assume those apps would be invite only), there are already apps for identifying speed traps and DUI check-points. The cops (for some reason) have been whining about them.

I think they may be complaining more about the DUI ones than the speed trap ones. I'm sure it depends on locale, though.

They post them in NL as well - mostly - and there's services on radio and on the web where you can get the locations that are spotted by other drivers, load them onto your TomTom, etc. etc. the cops don't really care much as it means that people -will- slow down in those areas... which would have been the general point anyway (not to make more moneys; if they wanted that, I can point the

Given the rigors of the App Store approval process, there would have to be some kind of pretext to the app, like a "social AR friend locator." Perhaps then, from within the app's network, invite-only social networks could be built and expand, with users "recommending" other users to each other, then seeking them out. Users could post statuses, used in this case to say what they have in stock... Hey, real-life AR Dope Wars!

This would be pretty cool if it generated a wire frame box that changed in size in relation to how far away it was from you. The next step with this sort of software is to have it find 10 distinct points on the video feed, and keep the (whats the noun here? "targeted location"?) tube station, pizza shop or whatever in direct relation to the video, rather than having the lag of constantly polling the GPS + magnetic compass, leaving the targeted location lagging badly behind the video on a seperate layer whic

This would be pretty cool... find 10 distinct points on the video feed, and keep the (whats the noun here? "targeted location"?) tube station, pizza shop or whatever in direct relation to the video, rather than having the lag of constantly polling the GPS + magnetic compass, leaving the targeted location lagging badly behind the video

Microsoft demonstrated a similar application at CES 2008, although they called it "software camera recognition" (Bill Gates in fact did the demo at the keynote). There are pictures at Engadget [engadget.com]

Looks like Apple and the iPhone are beating them to the punch for RTM!

Frankly could we stop with this stupid "Terminator Vision" meme? I understand it's an easy simile to make for the masses but until we have our phone chips embedded in the brain, just looking at the stuff makes it clear as day that it's nowhere near as advanced as it sounds, it's just a stupid way to advertise the stuff...

What if we could bluetooth it to a display on the inside of your glasses? I know people that have the bluetooth aware sunglasses for audio, why not video as well? That might get me interested enough in the phone to buy one.

Frankly could we stop with this stupid "Terminator Vision" meme? I understand it's an easy simile to make for the masses but until we have our phone chips embedded in the brain, just looking at the stuff makes it clear as day that it's nowhere near as advanced as it sounds, it's just a stupid way to advertise the stuff...

I agree somewhat, but it's not going to be long before you can get essentially an iPhone in a pair of sunglasses or a device that does this sort of information overlaying. Of course the fi

I want an app that tells me in real time, how long the line is at the closes In n Out Burger, knows all the archane jargon to help me order my Double-Double(s) with grilled onions, and tells me exactly WHEN I should drive over to collect it. I want it smart enough to send me video of the hot, big chested chick with the clipboard, for when the line gets too long, and NOT send video when the ugly fat chick is out there sweating in the sun, baby!

Actually, a double-double is just a double burger with 2 slices of cheese. You're describing the "Monster" which is 4x4. Not on the menu but they'll know what you mean. Oh, and grilled onions are a must.

For those of you who dont know what an In n Out Burger Double-Double is, it is simply the most delicious cheeseburger you can find for the money. I realize that 99 percent of the world does not live or work near an In n Out Burger location, but that is your unfortunate problem.

What Apple and the new iPhone lets you do is to augmented reality what jumping from a high place is to flying.

Apple still completely locks access to the video. So basically, it allows you to display something over the video, yay! But there is absoolutely no tracking possible, the information most of those AR applications use tends to mostly be limited to compass or GPS. The nearest subway application fore example just uses GPS and gyroscope information to print an arrow over your video, but it is as much AR as what the google maps application already provided. The video is just a ice animated background, but provides zero information, the application works EXACTLY the same way with your finger on the camera lens.

More interesting tracking or "Terminator Vision" would require Apple to allow you to actually access the video data for any kind of post-processing treatment to occur, which they're still blocking so far. So if you want to see some augmented reality, i'd watch towards Android rather than Apple, whose SDK and appstore policies are starting to become more than a little tiresome.

You can't have non-trivial mobile video tracking in java - I mean anything more than unstable tracking of single rectangle. Android native code kit - NDK have some promise, but camera class access still not officially supported in NDK. As I understand you can still use it, unofficially, but you can have unofficial access to camera API in iPhone as well.

It's not possible with J2ME (I've tried last summer with N82 and failed exactly as you've described.
But Android is different story. Now I can do complex tracker-less recognition once every second while simultaneously rendering 3D scene on top of camera output and processing user input with 20FPS. All in Android Java. Should be even better with NDK.
P.S. Your tower defence game is great, I have it on my cell since it was released first:)
http://vivifypicture.com/ [vivifypicture.com]

There are several APIs that I can't see any reason for Apple not to make public apart from simply wanting to get them right on the first try. Along with real-time bitmap data from the camera is the calendar. It's kind of silly that apps can't add an entry to your schedule right now, but I think it's only a matter of time until Apple has this stuff stable and ready to set loose with developers.

Apple still completely locks access to the video. So basically, it allows you to display something over the video, yay! But there is absoolutely no tracking possible, the information most of those AR applications use tends to mostly be limited to compass or GPS.

ARtoolkit on iPhone. Still unreleased I think, but it's starting to look good. IDK about the whole locked video stream deal... this seems to contradict your statement. Jailbreak?http://www.youtube.com/watch?v=5M-oAmBDcZk [youtube.com]

Apple announced that they have patented a fully integrated Augmented Reality device for 2009, SiGNS.

"SiGNS will revolutionize the way we live by displaying pertinent information to the use about a local area." claims technological wizzkids at Apple.

SiGNS can be made from almost anything, opening potential for new and old businesses. Apple claims that creative individuals will be able to make their own SiGNS for free to advertise their own services, or to simple shout out to the world.

Need money for drugs or hookers? A SiGN can tell the world.

Businesses will be able to directly advertise to people in the local area. Users can see if stores are offering sales, look at local restaurants, even find bathrooms, tube stations, or police and medical help.

SiGNS can easily be made multilingual. In fact, some signs can be made in such a way to be universal among users.

Computing power is not a problem anymore , what we need is an unobtrusive and decent resolution head mounted display.
Until we have that these applications are nice and fun , no-matter the platform they run on , but they're really not all that useful.
Maybe adapt one for a car windshield HUD. It's already possible to apply a semi reflecting foil to the windshield and have a screen beneath it project real time data on it.

"The BBC is reporting that so-called augmented reality has arrived -- in the UK at least. From the article: 'Via the video function of a mobile phone's camera it is now possible to combine a regular pictorial view with added data from the internet just as the fictional Terminator was able to overlay its view of the world with vital information about its surroundings. For example, UK-firm Acrossair has launched an application for the iPhone which allows Londoners to find their nearest tube station using their iPhone.' The page features an impressive video demonstrating AR in action."

People on phones are bad enough, but I've noticed that a significant fraction of young kids, mostly boys, seem to have zero situational awareness outside of a wedge about 90 degrees wide in front of them.

I notice this because I have horses. Parents are always bringing kids to horse barns. Usually, the girls are interested in the horses, and the boys would rather be playing a video game. Some have portable games with them. In a busy, working stable, there are people leading and riding horses all over the place. Occasionally there's a loose horse (not a big deal; they'll head for their friends or food). Some awareness of large, moving, three quarter ton animals is needed to survive, or at least not to tie up traffic. I've had kids not notice when a horse came up behind them, clicking steel shoes on cement. I've seen horses, being careful of the kids, trying to get them to move out of the way. Some kids don't notice a horse breathing down their neck, literally. (To a horse, breathing down your neck is a polite hello. A nudge with the nose from behind is a demand for attention comparable to yelling at someone. People who still don't get it will usually be shouldered aside if the horse really wants to get through.)

How will these kids ever survive a bad neighborhood or heavy traffic? Will they need a heads-up display with a tail warning system, like fighter aircraft?

I've seen adults with the same problem. I think you mean "People" from planet oblivious. I ride my bike in the park for exercise. I had one guy that was walking toward me, facing me turn right into my bike. Then there are the crowds that take up the entire 12 foot wide path walking side by side towards you, and can't give you 2 feet to get by. Then at the last second they are surprised and jump out of the way.

Based on personal experience, at least 30% of people are dangerously oblivious.

I am a reasonably solid 6 feet 210 pounds. It is a regular feature of crowds that I have to adjust to avoid knocking puny people around. It has nothing to do with them being kids or playing video games, not paying attention is simply a feature of many people.

I've had an app for a while that I use sometimes that provides an augmented reality experience; it's called "RJDJ Album" and it's pretty cool in that you fire it up and put on your headphones, and it's got several different "tracks" which are actually different audio filters and effects set up in a way to provide extremely cool, rhythmic and interesting "music" out of whatever the microphone picks up.

It may sound like something only a stoner would love, and it's definitely got that going for it - but it act

Imagine all the possibilities for hacking this AR system can provide!!
How about sending everyone in the area to the same restaurant by showing them empty seats ?
How about sending people in the wrong buses ?what about leading people to a dark corner of the street so they can be mugged ?
The security questions that this can raise are enormous !

You know what would be a cool? An augmented reality iPhone app for snipers that detects the source of gunfires (possibly from the data given from an already existing such system) and overlays them.

This being said, it now seems obvious that this augmented reality thing is going to get big within the next few years. Regular GPS on your phone is nice, but sometimes when you reach your destination you can't actually see where you're supposed to go. Things like AR would make it more obvious. I also can't wait

This reminds me of the VR stuff that Gibson was talking about in Spook Country. Basically, combining GPS and VR, "artists" are able to create "channels" that "augment reality" so that you can see something interesting, depending on where you were. For example, one "artist" created a work that showed River Phoenix face down where he died that you could only see standing in front of the door to that club. It seems kind of cool to me, though obviously fraught with problems.