A peek (and head tilt) into the future: head-tracking in FPS games

by Christopher Grant { Jul 1st 2009 at 6:29PM }

Move over Johnny Lee. Now that you've gone corporate, there's a new student researcher in town ready to take up your mantle. What mantle is that, you ask? The "show us cool tech that can be used in video games via YouTube" mantle, of course. Introducing Torben Sko, a PhD candidate at Australian National University. He's currently "studying the idea of augmenting traditional forms of computer game interaction using unconventional, but commercially viable approaches." Translation: head- and face-tracking in video games using a traditional webcam.

The video after the break shows off several very impressive demonstrations of this technology using none other than Half-Life 2's Source engine: 1) VR Desktop is a "replication of the [technique] made popular by Johnny Lee"; 2) Zoom in by moving your head closer to the screen; 3) Peering allows you to look around the corners by tilting your head; 4) Camera rotation/spinning allows you to look around, "more like a Handycam"; 5) Ironsighting "allows the player to aim down the barrel of their weapon by tilting their head to the side."

If you're anything like us, you're already imagining this functionality in games using both the Xbox Project Natal camera and the PlayStation Eye. Afraid that new camera-based interfaces herald the death of traditional gameplay? ("I don't want to play Halo Reach by jumping up and down!") Fear not! This video is whispering in your ear, Core Gamer, and saying, "Don't be afraid. Everything is going to be alright."

[Via PushingPlay]

Tags: face-tracking, head-tracking, Torben-Sko

Reader Comments (Page 1 of 2)

Marty @ Jul 1st 2009 6:31PM

The screaming head is not funny anymore.

Captain Planet @ Jul 1st 2009 6:33PM

Shutup McFly.

The Dark Wayne @ Jul 1st 2009 6:34PM

yeah what are ya, chicken?

Manly Mcbeefington (Mr. ESC) @ Jul 1st 2009 6:39PM

Hello? Hello? Anybody home? Huh? Think, McFly. Think!

MystileArmor @ Jul 1st 2009 6:46PM

Since you're new here, I'm gonna cut you a break... today. So, why don't you make like a tree and get outta here?

Rich @ Jul 1st 2009 6:47PM

yea really, espiecally lazy edits like these

PR0F3TA @ Jul 1st 2009 6:48PM

1.21 GIGAWATTS!!

MystileArmor @ Jul 1st 2009 6:51PM

Roads? Where we're going we don't need roads

Marty @ Jul 1st 2009 6:53PM

Hehe, I knew I was going to get voted down for that one... but hey, I'm sick of it now, and just being honest about it.

zkey14 @ Jul 1st 2009 6:55PM

Yeah, it's getting kinda dumb.

Eh @ Jul 1st 2009 6:56PM

its only funny when the quotes are relevant to the comment...

MystileArmor @ Jul 1st 2009 6:59PM

I only ordered the medium relevancy for the day. You only get free refills with the king size.

Manly Mcbeefington (Mr. ESC) @ Jul 1st 2009 7:02PM

Well look at it this way,Joystiq only do this once every full moon and this is way better than patcher "crwwazy" guess taking all the front page space.

Desert Eagle @ Jul 1st 2009 8:38PM

MANURE! I HATE MANURE!!!

ill trooper @ Jul 2nd 2009 2:36PM

I have to agree with Marty... It's not even the head in the photos, but rather the annoying clogs of comments that TALK about the screaming head that need to stop. The 'bow to the new overlord...", "Full of WIN!!1!" comments, the "I heart DSG" comments... Just roll with the joke, people! You don't need to "Laugh Out Loud" and type about it every time.

Flo @ Jul 1st 2009 6:32PM

It's almost like he knows DSG is in his presence.

C.A. @ Jul 1st 2009 6:33PM

Yep it's like being stalked in The Ring. You know you're going to die and you know that screaming face will be the last thing you see.

Afterburner @ Jul 1st 2009 6:32PM

I still think it's hilarious.

Marty @ Jul 1st 2009 6:52PM

In your elation, did you forget how to use the reply button?

Ghen @ Jul 2nd 2009 8:28AM

no, its probably just a comment system error.

UberNeuman @ Jul 1st 2009 6:33PM

More head please....

:D

dTondro @ Jul 1st 2009 11:26PM

Can you get carpal tunnel in your neck? hmmm.... I smell some future lawsuits brewing... damn American legal system. Maybe the EU will require that it be sold separately after imposing a huge fine.

DaRabidDuckie @ Jul 1st 2009 6:33PM

I love Dead Space Girl.

charlie b. @ Jul 1st 2009 6:34PM

i also welcome our new digital overlord.

Sly (of the Dead Space Face Promotion Squad) @ Jul 1st 2009 6:37PM

we must promote her.

David @ Jul 2nd 2009 12:35PM

Mom? Is that you?

born2expire @ Jul 1st 2009 6:33PM

sounds terrible, stop making gaming more casual and accessible, your ruining it.

The Dark Wayne @ Jul 1st 2009 6:39PM

wat? This just sounds awesome, and he did it with Hl2. Not Stylz: Half Life edition

Amrosorma @ Jul 1st 2009 6:49PM

This isn't just for easy or casual games; ArmA 2 (and a whole boatload of other sims) supports stuff like this:

http://www.youtube.com/watch?v=9wXx3vMy_AQ

The Dark Wayne @ Jul 1st 2009 6:33PM

this dude and mysterious mullet man need to team up

The Dark Wang(Ohyeahcola in disguise) @ Jul 1st 2009 6:35PM

hehe

Sly (of the Dead Space Face Promotion Squad) @ Jul 1st 2009 6:38PM

the mullet man came to me in a dream. he is the future of gaming.

Shadsy @ Jul 1st 2009 6:34PM

The last time they tried face-tracking, it was a disaster. If we try something like this, couldn't it at least be with a cool peripheral like the Novint Falcon?

Flo @ Jul 1st 2009 6:34PM

By the time I get off joystiq her face will be burnt into my monitor

Leroy_Octopus @ Jul 1st 2009 6:47PM

Her face is already burned into my heart.

kill_strike @ Jul 1st 2009 7:44PM

awwwwwwwwwwwwwwww

MystileArmor @ Jul 1st 2009 6:38PM

Someone learned alot from John Lee and wants a job at Microsoft...

Diskoboy7 @ Jul 1st 2009 6:40PM

Ok. That joke got old real quick.

Leroy_Octopus @ Jul 1st 2009 6:44PM

Why don't you go dance over to Kotaku then, Diskoboy?

Manly Mcbeefington (Mr. ESC) @ Jul 1st 2009 6:40PM

I ignore why but this time the head made me LOL.

You guys should do this every week.

Next week could be Optimus Prime.

Sly (of the Dead Space Face Promotion Squad) @ Jul 1st 2009 6:57PM

this reminds me of the jason photoshops that engadget does to every post on every friday the 13th. i pretty much stopped reading engadget, but i go back on friday the 13th just to get in on the jason action.

SithLibrarian @ Jul 1st 2009 6:44PM

Thanks, Joystiq, for making my day!

Aivskar @ Jul 1st 2009 6:44PM

Time to invest in the whiplash medical supply industry.

Lov3 @ Jul 1st 2009 10:26PM

Yeah man, imagine the neck strain of cocking your head to the right real fast to try and get into iron sight before you're shot. 5 hours of that and your webcam will be out the window.

Odog4ever @ Jul 2nd 2009 12:23PM

@ Lov3

My guess is that if you are moving you neck muscles intermittently during you game play sessions you neck will eventually get stronger and won't get tired as quickly. I know some "gamers" are allergic to physical activity and don't understand the concept of muscle breakdown and recovery.
So basically what I'm saying is that at first it may be annoying but your body will adapt and get used to it. I'm sure the GOOD developers will find a nice balance of controller and motion input to give games a new level of immersion. (Valve, Bioware, Bethesda, Epic, etc.)