PS3 head tracking only needs camera
by Ross Miller 
{ Feb 27th 2008 at 8:30PM }
Last week, Sony showed off head tracking software for the PlayStation 3 using just the PS Eye camera (via MTV Multiplayer). That's right, no crazy hardware configurations devised by third parties (e.g. Johnny Lee, Electronic Arts), just software that identifies your head and its movement.A representative said the head tracking software has not been announced for any titles, but we'd love to see it show up soon for pretty much any genre of game. Video embedded after the break. (Note: It doesn't work for users with Canada, Japan or U.K. IPs.) While you're at it, (re)watch Lee's video to get a better idea of the potential of head tracking software (also embedded after the break).
Reader Comments (Page 1 of 2)
horngreen @ Feb 27th 2008 8:36PM
I like the idea but wonder about how it can truly be applied. I mean if you turn your head 90 degrees in an FPS your character will presumably do the same, you however will be looking at the wall.
TruPhan @ Feb 27th 2008 9:50PM
It doesn't really work like that. Watch the second video to get a better idea of how head tracking works. Basically, head tracking makes your television appear as though it is a "window" into the game, allowing for you to see more up close, and for objects in the realm of the game to reposition themselves with your perception.
Seriously, just watch the video and you'll figure it out.
cduran01 @ Feb 27th 2008 8:51PM
This tech is like the user was looking out a window, so it wouldn't be ideal for an FPS. It would be great for something like being in a vehicle like a tank or something.
Gaddes @ Feb 27th 2008 8:51PM
Hm, I keep thinking the most popular way to use it might be for FPS games in the style of Police 911, if you've ever played that at the arcades. I think in Police 911, it actually utilized sensors to gauge your movement so you could see around tables or change viewing angles, but it looks like they could use this technology instead of the sensors.
cduran01 @ Feb 27th 2008 8:44PM
Needs more polish, but has definite potential for a lot of games.
playwhutyalike @ Feb 27th 2008 8:47PM
Interesting, indeed.....
Bluebrake @ Feb 27th 2008 8:47PM
Where was this shown, and why didn't we hear about it earlier if it was last week? A company officially demoing this technology is big news.
(Sorry if this stuff is answered in the video, I can't watch it)
jonondaspot @ Feb 27th 2008 11:15PM
You know people do not want to show positive PS3 news...
Z @ Feb 28th 2008 9:04AM
Joystiq was too busy documenting what food they ate last week at GDC to be bothered with reporting video game news.
ErbilT @ Feb 28th 2008 2:29PM
Maybe they didn't report on it until now because:
1. It currently does not track if your head turns or not "or it did, it didn't track it well".
2. The framerate was jittery, breaking the illusion at times.
3. There was another headtracking booth for PC based games that used glasses, but was equally as unimpressive.
It was a very early version of their head tracking software that has a lot of kinks to work out. I checked it out while I was there and honestly, it wasn't that impressive (at this time anyway). Maybe when it's a more refined a little down the road, Sony will display it again when it is deserving of more coverage.
PSN: KillaKornbread (the shirt is a lie!) @ Feb 27th 2008 8:57PM
i dont know about this. the thing kept loosing him. if they can tune it better then this is certainly the best way to do it but right now the infared is better cause i dont think it would loose you as easily.
n3rrd @ Feb 27th 2008 10:15PM
It's pretty pathetic that they essentially ripped off Lee's demonstration and actually made it look worse...
unboring @ Feb 27th 2008 10:45PM
ofthestorm- You only need a camera for this to work. Unfortunately with the Wii you need a computer. As the video demonstration of this tech working with the Wii was infact only using the Wii remote and sensorbar. The tracking software was running on his laptop. Do some research.
Exo- Sony didn't copy this from Johnny Lee, it was developed along time ago, even the targets he used were developed and referenced in his development log as shareware stuff. Its used across the board.
Zeus God- Of course this is running on the PS3 OS , if you watch the video of this running on the ps3 by thomas miller , which was shown on here and everywhere else and s on youtube right now. He is a SCEA developer and released all the code and developed it in SKD. Why would sony be running it in Linux? commmmmon people.
Blind Fking Fanboyism
ITS cool, sure Microsoftdick could have done this. But they didnt. The Wii has not been demonstrated to do this (Johnny Lee's Laptop has been though) And its really cool that Sony is working on this.
The tech could really be a wonderful step towards living room immersion and VR. Lets all give codus where it is due.
N33rd
guess what buddy, the Wii doesnt run this software, the remote and sensor bar are used by Johnny L but the tracking software ran on a laptop. This is far superior in that it is ACTUALLY running on the console, and NOT in linux as a previous god had said. And it only requires the camera, and not an elaborate arrangement of googles and moded controllers. I personally would rather use this, without havin anything on my face. Running on the most powerful console.
acknowledge the coolness of this and walk away.
Raikage (Ludwig Defense Force) @ Feb 28th 2008 6:09AM
How come this isn't labeled a "gimmick"? It's even more of a "gimmick" than the Wii, at least the Wii was designed with the Wiimote in mind.
This is just like the Wii board, but cooler, and not stupid... and dumb... and stuff...
n3rrd @ Feb 28th 2008 6:42AM
Unboring, there are very few words in my original post. Not one of them is "Wii". What is your point? I acknowledged the "cool factor" the first time I saw this, and no newer implementations have improved upon the previous versions in my opinion.
Colin @ Feb 27th 2008 9:06PM
I have serious doubts about how well this would work in "normal" households. Like what if I want to play a game with the lights off? With IR, that would be fine. It would have been awesome, although a bit too late, if Sony had put an IR camera in the PS3 Eye, and maybe an IR emitter in the Sixaxis/DS3, so you dont necessarily need some IR emitter attached to your head. That said, if this proves to be a successful method of head tracking, then I'm sold on one PS3Eye!
cduran01 @ Feb 27th 2008 9:16PM
The PS Eye, like almost every digital camera out there, can pick up IR light without a problem. If you want to see, just take your camera phone, webcam, or any digital camera and point a TV (or any IR) remote at the camera lens and hit any button, you'll clearly see the IR LED light up.
Bluebrake @ Feb 27th 2008 9:16PM
The PS Eye is an IR camera, as well as a visible light camera. For the demo that another guy did, he just put an IR filter over the lens of the camera to create a display basically the same as the Wii's. It still didn't work 100% though.
Colin @ Feb 27th 2008 9:39PM
Touche. I obviously didnt think that through very well, as I had seen that other video where the guy makes the PS3 Eye track IR. The real question is, how many points can it track at once for "multi-touch"? Also, someone could easily create a super cheap IR emitter that could plug into the USB port on the controller to accomplish tracking via controller movement, while still retaining the sixaxis accelerometers control for game mechanics. Although, obviously, head tracking would be way better. Some company should put a IR emitter in a wireless headset...
Colin @ Feb 27th 2008 9:54PM
It looks like this company has come up with an awesome solution for accurate motion tracking, sans any extra gear, or any controllers at all really!
http://media.gear.ign.com/articles/855/855511/vids_1.html
samfish @ Feb 27th 2008 9:08PM
"That's right, no crazy hardware configurations devised by third parties"
Yeah, just crazy hardware devised by first parties.
iofthestorm @ Feb 27th 2008 9:11PM
Seriously, both solutions require something extra, and at least the Wii version doesn't require anything that doesn't come with the Wii (well, you can make your own LED goggles thing but taping the sensor bar to your head works too ;)). Also, dunno how good this is but I tried the wiimote version and it wasn't as good in person as in the video, but maybe because I was using a sensor bar held under my face rather than the goggles, and the wii remote wasn't positioned well, and some I was near some lights.
ob1979 @ Feb 27th 2008 10:07PM
@iofthestorm
You do need an extra wiimote, unless all you want to do is do simulated VR.
Mr Khan @ Feb 27th 2008 9:13PM
This could potentially be very useful. Needs a lot of fine-tuning, but they could use the Eye for something more forward than Eye Toy. Something that does for the Eye which Metroid Prime 3 did for the Wiimote IR
Kspraydad @ Feb 27th 2008 9:20PM
You can get a bit of a NON IP BLOCKED view in the top video at this page...also from GDC:
http://www.dagbladet.no/kultur/2008/02/27/528208.html
The BPM Scrolls IV: Knights of the Nine @ Feb 27th 2008 9:27PM
That's pretty cool. I'd love to see a game or two utilize this in a unique way.
Exo @ Feb 27th 2008 9:42PM
love how sony copied the guys demo exactly with teh targets.
Zorink @ Feb 27th 2008 9:47PM
I hope Johnny at least gets some credit.
Zoesch @ Feb 27th 2008 10:14PM
Funny those targets with lines inside a wireframe mesh have been used to show tracking spaces since the 80's
unboring @ Feb 27th 2008 10:36PM
iofthestorm- You only need a camera for this to work. Unfortunately with the Wii you need a computer. As the video demonstration of this tech working with the Wii was infact only using the Wii remote and sensorbar. The tracking software was running on his laptop. Do some research.
Exo- Sony didn't copy this from Johnny Lee, it was developed along time ago, even the targets he used were developed and referenced in his development log as shareware stuff. Its used across the board.
Zeus God- Of course this is running on the PS3 OS , if you watch the video of this running on the ps3 by thomas miller , which was shown on here and everywhere else and s on youtube right now. He is a SCEA developer and released all the code and developed it in SKD. Why would sony be running it in Linux? commmmmon people.
Blind Fking Fanboyism
ITS cool, sure Microsoftdick could have done this. But they didnt. The Wii has not been demonstrated to do this (Johnny Lee's Laptop has been though) And its really cool that Sony is working on this.
The tech could really be a wonderful step towards living room immersion and VR. Lets all give codus where it is due.
Feigr @ Feb 27th 2008 9:52PM
"Shoot from behind my shoulder" was apparently way too complicated of an instruction for that camera man since he just stood beside the dude and didn't get a good shot from in front of the screen.
Looks like it has lots of potential though.
SabreCat @ Feb 27th 2008 11:28PM
I was thinking the same thing. Not only did he not get the over-the-shoulder bit, but for some reason he thought zooming in would make the effect more evident. xD
Zeus.:God @ Feb 27th 2008 9:57PM
The fact that this is on the PS3 isn't anything special. Any of the current consoles can do it.
This is being done on the PS3 because the PS3 is able to use an alternate operating system (which this is, no doubt, being run on).
Kspraydad @ Feb 27th 2008 10:12PM
So then..it can't be done on the other consoles.
Vidikron (FU) @ Feb 27th 2008 10:40PM
pwned
Zeus.:God @ Feb 27th 2008 10:40PM
No, it could be, provided they were able to load other operating systems.
I should have been more clear about that.
unboring @ Feb 27th 2008 10:57PM
LOLz at the blind and ignorant hexboxWii64 fanboys. Read the writting on the wall. This is Cool.
Pwned God
Devin @ Feb 27th 2008 9:58PM
wait i dunno if this has already been said...but didnt i see a video of a guy ON joystiq doing this exact thing i hope he is getting right??
colin @ Feb 27th 2008 10:01PM
"PS3 head tracking only needs camera"
this is false advertisement. consumer must also have a head.
finnith @ Feb 27th 2008 10:08PM
You can go ahead and sue them for that.
Lekko @ Feb 28th 2008 3:35AM
...not to mention an actual PS3.
Organic_Shadow @ Feb 27th 2008 11:02PM
I'd like to see it used to manipulate security cameras that have the ability to pan and tilt.
I also like the Eye solution better, as you don't need any trickery like aiming a controller at yourself and putting on the sensor bar.
As far as night play is concerned though I think glasses would be okay. No lenses, just the frames with the IR emitters.
unboring @ Feb 27th 2008 11:08PM
yeah man, it would not be difficult to use glasses in the dark or no glasses when its well lit. Both have been demonstrated running on the PS3. This tech has not however been demonstrated running on the Wii. Just the Wii mote and a laptop.
Looks wicked. Walking up to the tv. it looks like a window. the Perspective is a sort of Pseudo 3d. Looks like fun. Eyetoy games that are being made currently and sold for very cheap (like 2 dollars cheap) would really benifit from this as in that market niche gimmicks and immersion sell very well. I can't wait to see sony impliment, 100% that sony will attempt to.
Luke Wallace @ Feb 27th 2008 11:14PM
My college roommate went to grad school and created a virtual window using a webcam. I still have the video he sent me showing the technology, and the paper he wrote up and submitted to various groups. All the same movement and zooming you've seen before, and this was 3 or 4 years ago.
I'm surprised the idea is taking off, the technology has been around for a while.
CJLopez @ Feb 27th 2008 11:29PM
Ya know, I think I saw this like a month ago or so, yes, using the PS3 camera. It was someone who proved that there was a way to do this with something else.
To those who are asking to give credit to Jhonny, he released the code as Open Source, meaning, they can do with it wathever they want to do with it and not give any credit to the creator, but in the end, he doesn't care much, it's not like he is looking to be famous or something
Still, this is amazing, but I like more the wii version, xD
unboring @ Feb 27th 2008 11:39PM
dude there is no Wii version. Watch the wii video posted above byjohnny. Its running on a laptop. Read the bloody title of it. Headtracking with Wii mote. Not Wii. Watch his video again. And secondly, he didnt not develope this technology (Johnny L) he gives credit to alot of other people. Its been around for several years. If Wii could even run this software how would you like that version better , you have to wear dorky glasses? With the PS3s version your free of glasses completely? Would you seriously wear IR glasses? Or do you just like mariokart?
Lame, do some research
CJLopez @ Feb 27th 2008 11:56PM
It's just a perception thing
For me, the Wiimote and the sensor bar are members of the same group of the Wii, so, using the the wiimote and the sensor bar makes it thew wii version, cuz you are using things from the wii group.... it's, kinda hard explaining this group thing withouth beign able to use a ven diagram (or was it a vern???? been years since i saw it on school)
So yeah, he may be using his lap, thats cuz Wii homebrew is just starting, when the PS3 homebrew has a lot of time on the zone, give it some time and there 'll be a version of this withouth not having to use a lap and deploy the whole thing on the Wii, and maybe then you can call it the wii version
Well, i didn't found em bad, i mean, there was a time when gamers would put a glove and use it to control the game, and didn't even worked that well, i wouldn't mind using this, actually, i find kinda silly the ps3 version, cuz you are only moving the head, and people that don't know would be like "what's he doing?, he crazy?, moving his head for what?" while when using the glasses give a reason for the head movement.
It's his version now, i mean, yeah, he find the core and he modified to make it work with the wiimote, the sensor bar and stuff, modifing something o the Open Source communitty means that the modified version is now your code. Also, Jhonny did the c# version, yeah, the java and c++ version been around for a while, but jhonny and his people did the c#, so it's their version
Also, mariokart??? now i'm lost, didn't catch what ya mean with this one, was some sort of sarcastic commentary??? You say it bcuz of the wii wheel??? Hey, it's fun, i do like fun stuff, people like fun stuff, chill, it's not like the world will end becuz we don't have the same POV as you
Once again, is just a question of perception
unboring @ Feb 28th 2008 12:09AM
dude the point is there is no wii version. Its the controller plugged into a laptop. Watch the video. It doesnt matter if it "could" potentially run on wii. It hasnt been shown too.
By your logic I like the PS3 version of crysis. Because I can play crysis on my computer by using my PS3 controller plugged in via usb.
And PLEASE explain this comment of yours
"Well, i didn't found em bad, i mean, there was a time when gamers would put a glove and use it to control the game, and didn't even worked that well, i wouldn't mid using this, actually, i find kinda silly the ps3 version, cuz you are only moving the head, and people that don't know would be like "what's he doing?, he crazy?, moving his head for what?" while when using the glasses give a reason for the head movement."
Your grammar, writting style, and logic are confusing.
You have to move your head equally for both of them. Does that help you? Its called head tracking. The thing is, with the PS3 you do not need to wear ridiculous glasses. Oh and it actually works on the PS3.
And are you telling me you think you would feel wierd moving your head around on the PS3, but you like the Wii?
dude, do you know what you look like playing wii games? Headtracking is awesome tech. And its good that you agree that its cool, awesome that sony is working on it first party. And has it actually running on the console, without the use of janky IR glasses right and modded controllers.
anyways.... do you get it?
CJLopez @ Feb 28th 2008 12:16AM
xDDDDDD, it's so funny to see how you get so worked up trying to understand such simple logic, ROFL
And i can see I made my point clear.
I also like my Wii Version of Halo 3, even though it's not my 360 neither my halo 3, but it's my computer, my bluethoot adapter and my wiimote+nunchuk, xDDDDDD
Cuja @ Feb 28th 2008 12:15AM
First video is more like the guy is looking into a mirror because his movements are mirrored on the monitor, as compared to the second video's looking thru a window. This might be great for shaving or primping, but very expensive mirror. Hit pause and do your thing.