Sony shows off markerless AR technology

by Griffin McElroy on May 21st 2011 5:00PM

Sony Computer Entertainment's dabbled in the Augmented Reality space with titles like Invizimals and Eyepet, but if a recent Sony press release is any indication, its parent company is investing a bit more into AR technology. The release explains the company's in-development "Smart AR" application, which can superimpose a 3D model on a real-life object without the use of special markers -- rather, the technology can recognize entire objects, such as menus and posters.

In addition to eschewing the usual AR codes required to recognize objects, Smart AR can recognize compatible objects moving at extremely high speeds. Check out the press release for a brief outline of the tech's capabilities, as well as an impressive video demonstration. Man, we want that pink bear to walk on everything we own.

Via: Andriasang
Source: Sony

Tags: ar, augmented-reality, playstation, ps3, psp, smart-ar, sony

Reader Comments (45)

AR technology is serious business.

Sony already showed this exact technology on PSP2 months ago!

Eye of Judgement II, here we come! XD

I can't say I care. It was fun on the 3DS for a bit but I don't really see the point any more. Until AR is comprised of real holograms, it's not that exciting.

I guess the Playstation Eye and Kinect are better because you don't have to hold some device whilst you use the AR.

Still, I suppose it introduces unique ways to play games. I just hope they don't ruin it as the silly gimmick it is and insead use it well.

@TCJJ
It would've been cooler if the 3DS didn't need the cards. Like when I'm playing Nintendogs I don't bring my AR cards with me so I can't do the obedience training where ever I want.Plus then you could've done way more for the archery if the Ar cards weren't needed.

@TCJJ
I think the fun of AR comes from just being able to move the screen around and aim at the graphics like you're using a view finder. It's not so much about the the graphics being superimposed over your real world view through the camera. Its more about the control you get than the actual "reality" part.

It would really be cooler if they could just generate an entire environment that responds to whatever you're doing. You only see the graphics with no actual camera feed, and you're still able to move things around.

@Jovrick

They made that, it's called Galaga Dimensions. Thanks, Namco!

This makes me wonder how far AR will go. Or if it will end as a fad.
Truthfully, I am hoping this goes far. Because I want AR to be the new QR codes.

@BlackLuigi7
The way AR is now, I personally could care less. It'll keep your attention for ten minutes before you move on to something else. Now, if someone were to project AR models to the naked eye, THAT would be interesting.

I'm ready for shenanigans with holograms anytime.

@The Only Girl
How much less could you care?

/end me+asshat

Anyways, I totally agree. This WILL be an absolute fad. A scourge if it actually starts to ruin perfectly good games.

It's a novelty thing. Eye of Judgement was about the only thing that made sense with this AR crap. Yet, no other card games followed.

It's basically going to be an accessory that never takes off except for a select few games. In the end, it's unlikely to be worth all the fuss and millions wasted into its "development" from a game perspective.

@The Only Girl

*couldn't care less

I personally think it's cool and would love to see it go far too. Imagine in the future with HD video and realistic looking models and super high speed rendering. I think some real cool things could come from this.

@The Only Girl

I tend to agree, AR ruins its own emersivenessnessness because your not directly interacting with it. Well in a way you are but its disjointed.

If they actually had an AR headset, then AR would be freakin' awesome.

Its still cool as it stands now but ~.~ It could be so much better.

@Mmmmz
Well if I cared any less I wouldn't be at this article, huh?

@BlackLuigi7

Go watch Dennou Coil. That's the ultimate example of this technology in action.

@BlackLuigi7 I like how people constantly demand new innovation yet the second anyone tries anything new, people start hurling the 'gimmick' word around.

inb4 OMG SONY RIPPED OFF NINTENDO

@supersonic124
http://www.youtube.com/watch?v=Lfp8id6bpDU

@supersonic124 Actualy there have been AR games on iOS and certain other smartphones for a while.

@supersonic124

lolwat?

Gizmondo, many smartphones, and even the PSP had AR waay before the 3DS.

@supersonic124
Who cares who started it, it's all in how you use it.

Like nuclear fusion!

*looks around for Sony's 3D slider*

I can think of lots of existing applications that do AR without markers.

@Raffi256

Maybe I'm just not getting it, but from the video I watched, it doesn't seem to be actual "markerless" AR as you still need a marker object to create and represent the AR object. The AR object just isn't confined to the borders of the marker. So basically, it's a program that analyzes the environment in 3D, and then adds the AR object based on whatever marker you load into the environment. I would imagine you could do (and probably have done) the same thing with the Kinect, as it actually captures 3D data from the environment. All you need now is a pull down menu to select what object you would want to add into your environment, or create some card or magazine sized card to load a specific object.

@Morisato13 I think this tech infers depth from movement of the camera. Kind of like how 3DTVs are sometimes able to run 2D content in "3D." Notice the part of the demo where the balls are bouncing on different parts of the environment, at different elevations. The marker doesn't need to be in the image for it to simulate and interact with the environment.

Didn't invizimals already do this?

I actually have no idea how invizimals works. But I really want to try it.

@Acosta02
"Sony Computer Entertainment's dabbled in the Augmented Reality space with titles like Invizimals and Eyepet"
Uhh, yeah...that was actually the very first line of the article.

@Dukk420

Yeah, but I thought that game didn't have markers.

@Acosta02 IIRC invizimals uses marked AR technology.

AR is about as interesting as Silly Bands.

@The Only Girl

OMG SILLY BANDS!!!!! I'M GONNA GET SO MANY OF THEM I CAN WEAR THEM UP MY WHOLE ARM LIKE THEY'RE SLEEVES!!!!!

@Ospov
So you want to look like the Michelin man?
http://i55.tinypic.com/dcto91.jpg

The only problem with the 3DS cards are, you need the card always within camera view, which limits the size of environment that can be created.

Can't wait to see a Mario mini-level created at some stage.

Anyway, on to the Sony part of the post: Interesting, wonder if they plan to do anything different to differentiate from 3DS.

@mrmobius "The only problem with the 3DS cards are, you need the card always within camera view"

And....

-The camera's ISO is too low, making it require specifically lit environments
-The camera's resolution is too low, making it easy to get too far away from the card for it to be made out
-It's processor is not powerful enough to keep tracking it smoothly enough
-The camera's field of vision is too narrow, making it too easy to point too far away from the card to track it
-you're moving the system around, which throws off the 3D effect
ironically, the 3D effect exacerbates that problem by making you think you can turn the system to look around things. Though you can learn to stop this after a while.

And the worst issue: The purpose of the 3D slider is to adjust the distance between the in-game virtual cameras to match the distance between your eyes, to calibrate the 3D effect to you. The cameras are a fixed distance apart, and are not affected by the slider. Meaning they do not match the distance you'd have it set at (except for the exact position they are at, of completely disabled)

Interesting technology, but wouldn't this need PS Eye to be upgraded first? Did they use PS Eye or another cam for the demonstration?

@Lava Pretty sure this is is for the NGP.

@mmmfishtacos

You probably right. From the link, it seems it is suited portable devices (NGP, Xperia Play, smartphones)

"Man, we want that pink bear to walk on everything we own."

Really?... I kinda wanted it to break out the Running Man so i can play "U Can't Touch This" in the background and make a machinima of him dancing in random locations with uneccisary close-up fast zoom-in + zoom-out sections just showcasing the mad skills going on with his feet.

But if just 'walking' is what does it for you then...

Sure, AR is a little cumbersome now, but just imagine when we can fit this technology into a pair of glasses and amp it up by 100.

You could play a whole video game in your backyard.

@EliminatorZigma
And then hackers can rewrite reality in real time.

'No sir, that is indeed a bridge at thhe the end of the cliff leading into the sun, whoops, guess it wasnt'

Also it brings imaginary friends/girlfriends to ne levels.

@Nofriendo
Cute. I bet you think Nintendo "invented" it.

It was touched upon earlier, but really the 'projecting images' thing is secondary to the potential AR holds.
The image recognition ITSELF is where the real importance is, though honestly I see a lot more 'serious' applications for it than 'gaming' ones.
And of course random miscellany like being able to look at a restaurant and get a detailed ZAGAT review.

Sadly, until we go virtual-reality, the only thing we'll be able to do with those girlfriends is masturbate to them.

wow that looks awesome.i hope they have that on NGP.
I will make some crazy shit with that

@K3ViNPwNz They already showed it on PSP2 MONTHS ago.

They should make an AR pokemon game...

Sony shows off markerless AR technology

Reader Comments (45)

Posted: May 21st 2011 5:04PM Qehb said

Posted: May 22nd 2011 4:49AM Extinction said

Posted: May 21st 2011 5:11PM DarkTetsuya said

Posted: May 21st 2011 5:14PM TCJJ said

Posted: May 21st 2011 5:48PM The Aquacharger said

Posted: May 21st 2011 6:00PM Jovrick said

Posted: May 21st 2011 6:17PM Bighouse said

Posted: May 21st 2011 5:18PM BlackLuigi7 said

Posted: May 21st 2011 5:51PM The Only Girl said

Posted: May 21st 2011 6:58PM Mmmmz said

Posted: May 21st 2011 7:03PM superfrog96 said

Posted: May 21st 2011 8:25PM Scuffles said

Posted: May 21st 2011 9:11PM The Only Girl said

Posted: May 21st 2011 9:32PM mrantimatter said

Posted: May 21st 2011 10:28PM wcarnation said

Posted: May 21st 2011 5:19PM supersonic124 said

Posted: May 21st 2011 5:34PM Jovrick said

Posted: May 21st 2011 5:51PM Dukk420 said

Posted: May 21st 2011 6:23PM DjiegoMoz said

Posted: May 21st 2011 9:14PM The Only Girl said

Posted: May 21st 2011 5:21PM Bladex206 said

Posted: May 21st 2011 5:29PM Raffi256 said

Posted: May 21st 2011 6:25PM Morisato13 said

Posted: May 21st 2011 9:57PM Mike Sylvester said

Posted: May 21st 2011 5:40PM Acosta02 said

Posted: May 21st 2011 5:48PM Dukk420 said

Posted: May 21st 2011 5:53PM Acosta02 said

Posted: May 21st 2011 6:10PM Hank Hill said

Posted: May 21st 2011 5:45PM The Only Girl said

Posted: May 21st 2011 6:18PM Ospov said

Posted: May 21st 2011 9:13PM The Only Girl said

Posted: May 21st 2011 6:15PM mrmobius said

Posted: May 22nd 2011 4:52AM Extinction said

Posted: May 21st 2011 6:17PM Lava said

Posted: May 21st 2011 6:21PM mmmfishtacos said

Posted: May 21st 2011 6:34PM Lava said

Posted: May 21st 2011 6:49PM Red Deer said

Posted: May 21st 2011 7:36PM EliminatorZigma said

Posted: May 21st 2011 9:26PM Einlander said

Posted: May 21st 2011 7:39PM PointlessPuppies said

Posted: May 21st 2011 9:23PM Desraedos said

Posted: May 21st 2011 9:51PM EliminatorZigma said

Posted: May 21st 2011 10:14PM K3ViNPwNz said

Posted: May 22nd 2011 4:51AM Extinction said

Posted: May 23rd 2011 4:39AM ASlamd said

Info

Description

MSRP

Release Date

Genre

Developer

Publisher

Rating

Breaking News

WB conjures up Harry Potter for Kinect this fall

Featured Stories

Weekly Webcomic Wrapup is a stranger in a strange land

Silver Lining: I Am Alive's unfeeling world

Game Of Thrones and the paradoxes of adaptation

Engadget

TUAW

Massively

WoW