Have you ever wondered what Project Natal actually sees through its beady, robotic eyes? A direct feed of the Natal's point-of-view was recently revealed to the audience of Microsoft Israel R&D's "Think Next" convention yesterday afternoon. Just past the jump, you can check out NextGen-News' video of a live demonstration from Microsoft VP of Hardware and Technology Dr. Ilan Spillinger and a female participant, both of whose genders and movements were successfully identified and Avatar-ified by Natal.
Watch the video after the jump to see Spillinger get more excited by this technology than anyone has ever been excited for anything else on the planet, ever.
[Via Engadget]
Reader Comments (90)
Posted: Apr 15th 2010 6:31PM stoneNboneCDXX said
Wolf, It was HP laptops.
"HP has been informed of a potential issue with the facial-tracking software included on some of its systems, which appears to occur when insufficient foreground lighting is available," an HP spokesman told BBC News.
Reply
"HP has been informed of a potential issue with the facial-tracking software included on some of its systems, which appears to occur when insufficient foreground lighting is available," an HP spokesman told BBC News.
Posted: Apr 15th 2010 7:26PM Shiaoran said
Did I say anything about MTF or FTM people? No.
This shouldn't be a problem for those people. If I were a MTF, I'd be happy if Natal though I was a woman.
Not only HP laptops can't see black people, but Apple ones make fun of asians:
http://www.youtube.com/watch?v=vy5saRyMymM
(I know it's a parody, but I'm not sure if there really is such a feature in those video apps)
Reply
This shouldn't be a problem for those people. If I were a MTF, I'd be happy if Natal though I was a woman.
Not only HP laptops can't see black people, but Apple ones make fun of asians:
http://www.youtube.com/watch?v=vy5saRyMymM
(I know it's a parody, but I'm not sure if there really is such a feature in those video apps)
Posted: Apr 15th 2010 6:06PM (Unverified) said
I remember one time working the register at a bookstore I worked at long ago, when I was ringing a customer up and I misjudged her gender. To be fair, when you're really busting out a lot of sales and trying to get people through the line as fast as possible, you don't pay as much attention to what they look like, but rather more a peripheral sense of shape, sound and color they give off. I finished her purchase, handed her stuff over and said, "Here you go sir, thanks for shopping with us," or some similarly banal pleasantry. She got this really hurt look on her face and said, "You think I'm a man?" I was completely embarrassed and apologized profusely, but come on, she looked, dressed and sounded male to my inattentive eyes.
My point is yeah, this is probably going to make a lot of people sad.
My point is yeah, this is probably going to make a lot of people sad.
Posted: Apr 15th 2010 6:11PM Spike Spiegel Humble Bounty Hun said
The DMV put F on my driver's license when I was a teenager =\
Reply
Posted: Apr 15th 2010 6:10PM Spunky Monkey 190906 said
Does it recognise transexuals? Or people who prefer to bat for the other team but haven't gotten around to it yet?
Oh, and will it recognise race, religeon and political values? Now that would be original :)
Oh, and will it recognise race, religeon and political values? Now that would be original :)
Posted: Apr 15th 2010 8:44PM TheGrandHero said
That could make for an interesting Christmas when the family gives Natal a spin and finds out little Johnny is a Libertarian.
Reply
Posted: Apr 15th 2010 6:13PM Mister Darcy said
I kind of figured that it would be able to tell it's my girlfriend because she'd be the one yelling at me to "turn the stupid XBox off." I guess I was waaaaayyyy off.
Posted: Apr 15th 2010 6:15PM Alex R said
I don't know if I like it being able to recognise me. That means that its constantly eyeballing everything, or if you want to say this, it's LOOKING for you.
I'll enter a room and it will say 'Hello, Alex. Do you want to play?' in that cute-but-sinister Portal Turret voice.
'There you are! ^_^'
http://www.youtube.com/watch?v=CKVuPUY9D-A
I'll enter a room and it will say 'Hello, Alex. Do you want to play?' in that cute-but-sinister Portal Turret voice.
'There you are! ^_^'
http://www.youtube.com/watch?v=CKVuPUY9D-A
Posted: Apr 15th 2010 6:20PM (Unverified) said
cool stuff
Posted: Apr 15th 2010 6:21PM Laivindil said
This is the racist laptop (Camera) for people that don't know:
http://www.youtube.com/watch?v=t4DT3tQqgRM
Basically it only works for white people moving where they move, it wont track anyone whose darker.
As for this video, anyone put off by how little those two moved? I mean... maybe they fit into the white people cant jump stereotype but jeez, she takes on step in each direction? Is Natal really that stingy with where you need to be located for its tracking? I guess you wont have to move around all that much for games, but I feel like this might be one of its limits, that it needs a very good eye on you to get all the data it needs (correctly). With the move, all it needs to find is a colored ball, so it may be able to work well in a greater variety of conditions?
http://www.youtube.com/watch?v=t4DT3tQqgRM
Basically it only works for white people moving where they move, it wont track anyone whose darker.
As for this video, anyone put off by how little those two moved? I mean... maybe they fit into the white people cant jump stereotype but jeez, she takes on step in each direction? Is Natal really that stingy with where you need to be located for its tracking? I guess you wont have to move around all that much for games, but I feel like this might be one of its limits, that it needs a very good eye on you to get all the data it needs (correctly). With the move, all it needs to find is a colored ball, so it may be able to work well in a greater variety of conditions?
Posted: Apr 15th 2010 7:50PM (Unverified) said
Well you're going to use it in the living room not a gymnasium.
Reply
Posted: Apr 15th 2010 6:21PM CougRon said
This is pretty impressive
Posted: Apr 15th 2010 6:25PM Whoppinberg said
Is it just me or do i only here "durka durka druka durka avatar durka durka" in the beginning?
Posted: Apr 15th 2010 6:53PM Roenik said
Not sure if the demo was on older hardware, but that lag bothers me to all hell.
Having the on screen avatar lower his/her arms 1/2 second after the user actually does it...that's a no-no.
Peter Molyneux did say that most demos were still using the tech that was months old....I'm sceptical.
Having the on screen avatar lower his/her arms 1/2 second after the user actually does it...that's a no-no.
Peter Molyneux did say that most demos were still using the tech that was months old....I'm sceptical.
Posted: Apr 15th 2010 7:26PM Roenik said
Not projector lag, it wouldn't be *that* noticeable.
Posted: Apr 15th 2010 7:25PM JUNG GUNS said
I'm sorry y'all but that's pretty bad-ass.
Posted: Apr 15th 2010 11:38PM Korova Pamplona said
At the risk of sounding like a total MS fanboy, I am beginning to think that Natal could really ROCK, especially with good software. No wand and it can tell if I have a fat ass.
Reply
Posted: Apr 15th 2010 7:35PM (Unverified) said
Do NOT click on the NextGen News video link, I tried to go there and was shown scareware (fake antivirus pop-up).
Posted: Apr 15th 2010 8:13PM beefbearsupreme said
Well, this whole showcase of what Natal can do is nice and all, but the only thing that really matters is what the bottom of an Avatar's shoe looks like.
Posted: Apr 15th 2010 8:38PM (Unverified) said
I want to see how games play darn it!
Posted: Apr 15th 2010 8:27PM Laivindil said
Well duh... thanks, But they were barely moving, like I said she only took one step in any direction. What if I wanna play from my couch 10+ feet away, or want to stand up and be just a few feet away from the camera? Can I do both?
Posted: Apr 15th 2010 8:36PM (Unverified) said
it scans for boobs and your penis.
Posted: Apr 15th 2010 8:46PM TheGrandHero said
Will it lock up in an infinite loop if you have both?
Reply
Posted: Apr 15th 2010 8:40PM TheGrandHero said
If Natal shows me as a girl, does that make me gender confused?
Posted: Apr 15th 2010 10:32PM AxelFury said
Hmm, interesting.
Posted: Apr 15th 2010 11:41PM Korova Pamplona said
But what about babies? Can it tell gender through diapers?
Posted: Apr 16th 2010 2:11AM McDuckScrooged said
Absolutely brilliant it detects a persons gender, very impressive it can clearly detect male and female as demonstrated in that demo, massive props for them working out how to do that.
Now please watch this:
http://www.engadget.com/2009/09/10/video-sonys-vision-library-for-playstation-eye-recognizes-face/
"It's called the Vision Library and, once a face has been analyzed, the machine can tell it apart from others, determine orientation, identify gender, tell what expression that face is... expressing, and then superimpose some big-eyed anime head right on top of it real-time"
In 2009 Sony already demonstrated the technology by analysing a persons face.. It may not do full body tracking but it certainly can detect your gender :) Low and behold it can track more than 1 person at a time and can correctly identify a man and woman on screen at the same time.
Chris. D is right, Sony has already demonstrated this technology using the playstation eye.
Do you see any depth from that video ? What does depth have to do with determining a persons gender ? That video appears to be an overlay of the camera output in this case it has to be the IR Camera within natal hence why the heat trail
Others above claim this is all Microsoft tech. Microsoft bought 3DV Systems and have licensed technology from Prime Sense..
Watch this :
http://www.engadget.com/2010/03/11/primesense-talks-full-body-motion-control-at-gdc-the-possibilit/ -- Does that not look remarkably similar to the Natal product demo ? I am not sure how 3DV fits into all of this but 3DV also had a 3D camera system and had built its own processor and did all of the skeletal modeling directly on the camera..
http://www.vccafe.com/2009/06/23/3dv-systems-and-primesense-are-the-israeli-firms-behind-microsofts-project-natal/
Now please watch this:
http://www.engadget.com/2009/09/10/video-sonys-vision-library-for-playstation-eye-recognizes-face/
"It's called the Vision Library and, once a face has been analyzed, the machine can tell it apart from others, determine orientation, identify gender, tell what expression that face is... expressing, and then superimpose some big-eyed anime head right on top of it real-time"
In 2009 Sony already demonstrated the technology by analysing a persons face.. It may not do full body tracking but it certainly can detect your gender :) Low and behold it can track more than 1 person at a time and can correctly identify a man and woman on screen at the same time.
Chris. D is right, Sony has already demonstrated this technology using the playstation eye.
Do you see any depth from that video ? What does depth have to do with determining a persons gender ? That video appears to be an overlay of the camera output in this case it has to be the IR Camera within natal hence why the heat trail
Others above claim this is all Microsoft tech. Microsoft bought 3DV Systems and have licensed technology from Prime Sense..
Watch this :
http://www.engadget.com/2010/03/11/primesense-talks-full-body-motion-control-at-gdc-the-possibilit/ -- Does that not look remarkably similar to the Natal product demo ? I am not sure how 3DV fits into all of this but 3DV also had a 3D camera system and had built its own processor and did all of the skeletal modeling directly on the camera..
http://www.vccafe.com/2009/06/23/3dv-systems-and-primesense-are-the-israeli-firms-behind-microsofts-project-natal/
Posted: Apr 16th 2010 4:58AM (Unverified) said
Will Natal recognize your gender if you're the elephant boy?
Posted: Apr 16th 2010 9:35AM ChomskyKnows said
tits
Posted: Apr 16th 2010 11:17AM Gemini Ace said
That video didn't explain how it can tell the difference. Is it scanning my junk or what?
Posted: Apr 16th 2010 4:04PM Vandell said
So will men with moobs be recognized as women?
Posted: Apr 17th 2010 6:29AM (Unverified) said
Bones, people. The same way someone can look at a skeleton and tell if it's from a male or female, Natal can tell by comparing the ratio of lengths of bones. It knows where the joints are that connect the bones, so it knows the lengths of the bones.
Featured Stories
Super Joystiq Podcast 004: 38 Studios meltdown, Gravity Rush, Civilization 5: Gods & Kings, Dragon's Dogma
Posted on May 25th 2012 3:30PM






