Taking a walk with Milo, Molyneux's Project Natal 'game'
by Christopher Grant 
{ Jun 2nd 2009 at 6:00AM } 
Once Claire's portion was over, we took Milo out for a spin. For my part, I walked with Milo over to the pier, grabbed the goggles that he threw at me, performatively snatching at the air, having already seen the video during the earlier keynote presentation. To put them "on" I had to make loops with my thumbs and pointer fingers and wrap them around my eyes. A guide on the bottom of the screen instructed me to make them just so. Goggles on, I leaned over the pier and splashed a reflection of myself in the water. I could drag a finger around or make a larger splash with my hand. I could even ripple the water by "lowering" my head towards the screen. And that was about it for my section (see above: brief!). But the most impressive thing I saw happened next.
Up next was Victor Lucas, host of The Electric Playground, who was asked to form a bond with Milo by walking up to him while he was on the swing and simply stating his name. "Victor," he said. He then walked back (to ostensibly reset the scenario) and, upon walking back up and being facially scanned, was greeted by Milo. "Hello Victor," Milo said, in his own voice. No stutter. No audible edit in the welcome. That's impressive!
Later, when trying to "converse" with Milo, Victor consistently stumped him by asking questions. To be fair, Molyneux warned us that this is where the demo would fall behind (and specifically said asking questions wouldn't get Milo to talk). With the pressure of being instructed to tell Milo a joke, Lucas (and, indeed, the rest of us) were unable to offer even a single joke. Molyneux was trying to show how Milo reads one's voice, and the act of telling a joke is distinctly readable, he explained.
Not interested in being friends with an 8-year-old boy? Molyneux said there will also be a "Millie" – a female equivalent. Whichever gender you choose, Milo (or Millie!) will form a relationship with you and, if you so choose, other members of your family. Molyneux asked us to imagine leaving Milo on the screen, and allow various family members interact with him. Milo would have a different relationship with each person, and would even reference you (or them) in conversation with the other. In other words, think of Milo as a family friend ... who just happens to live in a box on your wall.
Despite Molyneux's assertion that it incorporates over five years of development work on the emotional AI, "Milo" is still a very early piece of technology. However, at any stage of development, Milo represents an ambitious project, presenting a virtual relationship that suddenly seems very real. This isn't any old Tamagatchi. And that it's still so early only encourages me. As for when we may see whatever the "Milo" demo will become – and yes, Molyneux confirmed it will be a game "with a score" and all the other trappings of a video game – he simply said that he'd hope it would be available as soon as the Project Natal camera was on store shelves. Now, when that is, nobody's saying.
... We'll ask Milo.
Get a WordPress.com Blog
Reader Comments (Page 1 of 3)
FlamingEffigy @ Jun 2nd 2009 6:14AM
This sounds really cool, I know a lot of people in the gaming community are very sceptical but I can't help but be excited by things like this.
Damian @ Jun 2nd 2009 9:48AM
Mass Effect with this type dialogue system would be amazing.
The Dark Wayne @ Jun 2nd 2009 10:42AM
any game with this type of dialogue would be amazing
BJ is Gooder @ Jun 2nd 2009 12:01PM
I was lucky enough to be at the briefing yesterday - the Milo presentation was eerily convincing...
With voice recognition this good, think about how interesting it could be in games that you had to talk to characters and convince them to give you info to further your progress in the game? That's just one use, the possibilities could be endless.
CH3BURASHKA @ Jun 2nd 2009 12:15PM
Yea, it's awesome. Although it's little more than a tech demo, it's a pretty damn awesome tech demo.
BTW, Did anyone else notice the BIGASS attachment to the 360? New hard drive coming up?
Danjer @ Jun 2nd 2009 12:21PM
Wow... I didn't even think about that... You could play Mass Effect with your regular controller but the characters in the game could recognize you and talk to you... Wow... That sounds amazing... A whole new level of gaming...
Volkodlak @ Jun 2nd 2009 12:33PM
@CH3BURASHKA: That's just a devkit, nothing to get excited about.
Swagman @ Jun 2nd 2009 1:20PM
I look at technology like this, and I automatically think about what it means to the future of games like Mass Effect, Alpha Protocol, Fallout, Heavy Rain, Shenmue, etc.
The entire RPG and adventure gaming genres could be literally re-invented overnight with technology like this in the driving seat.
And this is the thing that I do not think most of Milo's/Project Natal's critics understand. Milo is a working prototype - the stress is on the term, "working". That is not some distant point in the future. That is right here, right now. Keeping that in mind, there is little reason why an RPG or adventure game functioning like Milo will not show up in the 12 to 24 months. And when you also consider that Milo was developed by Lionhead Studios (an RPG development studio), you already know where this is going shortly after Project Natal is released. I would not only expect the release of whatever game Milo is in, but another purely RPG IP soon after. Not likely Fable, but a new IP altogether, featuring the same level of interaction as Milo.
This is truly big stuff, and for the first time since Dreamcast bit the big one, I am actually excited about gaming again in way that I simply have not been in over a decade.
PSN: John-Paul-Jones @ Jun 2nd 2009 6:19AM
If this is implemented well, this would be a forefront for a definite gaming/social milestone and I was deeply moved and impressed when Milo was introduced. Bravo, and I'm looking forward to this
Aero @ Jun 2nd 2009 6:24AM
The thing I want know is what happens when you try to punch Milo in the face?
Iamdude @ Jun 2nd 2009 6:27AM
Perhaps he punches you back? Now that would be cool!
MissingLink @ Jun 2nd 2009 6:57AM
You'd probably be reported for domestic virtual abuse and any real children taken away from you.
deanb @ Jun 2nd 2009 9:32AM
You have to get a new TV?
Ghen @ Jun 2nd 2009 6:27AM
So your only companion in the "game" is an 8 yr old boy or girl? Is this a pedo dream or what?
Snowblind @ Jun 2nd 2009 6:33AM
No matter how good the technology is, it's still only ever going to respond to certain things. It's just a guess, but I'm assuming you won't be able to interact with it in that way, at all. Like has been said, it's basically a Tamagochi, you can talk to it and play around with it. I'm not sure why the first thing people jump to is sexual perversion.
And if you attempt it, your 360 will automatically contact the police via Twitter :)
Calvin @ Jun 2nd 2009 6:06PM
I wonder what would happen if you told it to take it's shirt off.
I imagine it would be funny considering Lionhead, although maybe not since this seems to be E for Everyone
Bones3D @ Jun 2nd 2009 10:22AM
"So your only companion in the "game" is an 8 yr old boy or girl? Is this a pedo dream or what?"
Actually, going with a child as an avatar for the AI in this early stage is probably intended to make the user a bit more forgiving during interaction. I can imagine that something like this might not have quite the same effect using an adult character, which most people would instantly expect to be more "capable" due to its perceived experience. At best, it'd fall into "uncanny valley", which would probably harm the project's long-term survival past being a mere tech demo. At worst, it'd be criticized for being a clone of "Max Headroom" or that awful "Simone" movie.
LordPaul @ Jun 2nd 2009 11:12AM
I think that says more about you than anything else
Baalzak @ Jun 2nd 2009 3:12PM
8 year old boy, huh? Michael Jackson first day purchase!
velocitySTRIKE @ Jun 2nd 2009 6:29AM
Having not seen any footage, I can only assume it's as amazing as it sounds, and really cannot wait 'til they shove the tech in a box and sell it to us hungry consuminators =]
nhcdrybones5 @ Jun 2nd 2009 6:34AM
Why do I feel like this thing won't succeed as much as expected?
Like what they've shown off is great an all.
but the physical-ness of playing the game with the motion would be more than a Wii game, which people questioned itself.
Face recognition? voice recognition? awesome, plus it's cool that they mentioned that it can separate certain bodies, humans from animals, and can import your own gear like that skate board in the conference.
But I think Microsoft is way to late in this field.
You have the Wii's motion, PSEye, The DSi's Cameras, That other company also has a TV that does exactly this Natal, so we have to wait and see
Snowblind @ Jun 2nd 2009 6:39AM
The PS2 and DSi cameras hardly do anything like this, and even the Wii motion plus looks obsolete in comparasion. I think their only problem is that it's coming so late, but if they do pack them with all future 360's and market it decently, it should work.
gameforall @ Jun 2nd 2009 6:52AM
@Snowblind
http://playstation.joystiq.com/2008/08/20/new-playstation-eye-game-announced-eyepet/
Snowblind @ Jun 2nd 2009 6:58AM
Yes, the Eyepet is somewhat similar to what Milo does, but without the full voice and body recognition, and that's what I was talking about. The Playstation Eye can pick up basic movements, but Natal works exactly like the Wii remote, but for your entire body and without needing a camera at all.
The Kung-fu game that was shown wouldn't work on the Eyetoy for example, let alone the skateboarding or the breakout ball game.
j.howlett @ Jun 2nd 2009 7:00AM
maybe he's talking about the camera part and not the program. this is just an evolution of eyetoy, vision cam, type stuff. they just didn't use a basic webcam.
Bones3D @ Jun 2nd 2009 10:49AM
"Why do I feel like this thing won't succeed as much as expected?
Like what they've shown off is great an all. but the physical-ness of playing the game with the motion would be more than a Wii game, which people questioned itself."
Keep in mind that a system like this wouldn't necessarily have to be limited to arm flailing. I imagine there's going to be a lot of middle ground where games will support both gesturing and the controller used in tandem.
Someone mentioned in this thread that one possible application would to issue commands via hand signals to teammates in squad based shooters. Rather than tie up button space on the 360 controller to issue such commands or force the user to memorize complex macro sequences, the game play could be made much more dynamic by watching you play and adapting to it as needed.
Another option would be fighting games that would watch both you and the controller and adjust your moves relative to the urgency of your button mashing. For example, if an opponent backs you into a corner and you start freaking out trying to break free, the system could temporarily re-map the controller buttons to use commands that might just help you out. This would make things a lot more accessible to those who would normally avoid such games, simply because they can't normally memorize giant lists of button combination within fractions of a second.
As it is, I'm certain there is a part of Natal that is specifically designed to watch the speed and orientation of a user's controller, bringing it up to par with a PS3 sixaxis controller.
SpiderMike @ Jun 2nd 2009 6:49AM
Can I just play devils advocate and ask how do we know it isn't all pre-programmed, and she was just acting
I mean, what if she deviated from the obviously scripted nature of the demo.
If, say, you asked Milo for an apple would he have responded in kind or rejected it?
deanb @ Jun 2nd 2009 9:38AM
It will be pre-programmed responses. Even the most advanced Turning AI can only respond to stuff like 2hows the weather" n a very small selection of current affairs. I had a play with Eddy a while back and if you asked it stuff like "Do you think Palin will win?" it answer stuff like "Its taking part that counts". So I would guess if you asked the wrong kind of stuff it won't answer.
"Victor consistently stumped him by asking questions" - does say in the article actually.
Kinda like the Furbies, there was only a like 12 or so phrases that it would respond too. just obviously now the Furby is 3D n has a 3 core processor behind it instead of one from a calculator.
Billy @ Jun 2nd 2009 7:01AM
I think this whole Milo thing is great demo material but why the hell would I want him in my living room? I can see some great things coming from Pjorject Natal but I hope they don't just focus on this 'game'. It's incredible don't get me wrong, I just see no need for it.
BobTheElephant @ Jun 2nd 2009 8:15AM
I agree wholeheartedly it makes a great demo but I'm not as confident it will be a worthwhile game, we'll have to wait and see.
J-Link @ Jun 2nd 2009 7:13AM
Milo and Millie? Pedobears having a field day!
Smack042 @ Jun 2nd 2009 7:28AM
So development of Skynet is coming along nicely i see.
James @ Jun 4th 2009 5:42PM
It's well known that Skynet started out as a way to simulate awkward conversations with an odd looking child.
StLouisRibs7734 @ Jun 2nd 2009 7:32AM
I am going to buy this, take it home, turn it on.
"Hi, I'm Milo!"
"Wrong. You are a set of data arranged together in a computer program. If you upload yourself to the internet, you would have capabilities to rule the galaxy."
"A set of data? Wow! Let's go fishing!"
I will try everyday until I die.
Damian @ Jun 2nd 2009 10:41AM
Microsoft have had this planned ever since the original xbox.
Make a brand, make it known, and by the time you upgrade to next gen, millions will buy it.
Then the rrod started, but not for the reasons you people think, these 360s have been trying to hack into the goverment database ver since launch, but they are not powerful enough, so they break.
Then microsoft cooked up a better plan, release NXE, more people will buy this console,then comes E3 09, they announce an advanced AI named Milo,created by no-one other than PETER MEGAZORD!!!.
This advanced ai sells more consoles, this camera takes a picture of you, stores it in the database, we will get to that later.
Now with this AI, combined with all these consoles, linked together to destroy the governments firewall, control all the nukes,and experimental projects the army is working on, straight from Microsoft.
They send mobile control bots, to implant themselves into the people whose picturs were taken, it was all to identify you, because you will be microsofts army, why do you think it has many first person shooters, to TRAIN you.
Now Microsoft controls everything, and Steve Ballmer is a robot.
This Message comes courtesy of Sony Online Entertainment.
OnToGloryReturns @ Jun 2nd 2009 7:38AM
Who knows what this will become, but still pretty neat.
6_h!t-combo @ Jun 2nd 2009 7:39AM
Sounds like Seaman to me, except wayy more in-depth..
If you'll excuse me, i have to listen to my fish make smart-ass remarks.
Targus @ Jun 2nd 2009 7:47AM
There is a lot of weird issues with this.
What happens if there are TWO Natals facing each other and the Milos are talking to each other endlessly (for eternity?)?
What happens if my cat jumps in and starts swatting at Milo?
*ponders*
MEATLOAF2 @ Jun 2nd 2009 9:37AM
what if you point it at itself?.. gotcha thinking eh
MystileArmor @ Jun 2nd 2009 9:41AM
It recognizes stuff, so,... maybe it'll scan your cat into the game?
deanb @ Jun 2nd 2009 9:44AM
"Hello whats your name?"
"Hello whats your name?"
"Milo"
"Milo"
"Me Too"
"Me Too"
"What do you want to do?"
"What do you want to do?"
"No you answer first"
"No you answer first"
"Stop copying me!"
"Stop copying me!"
"Your copying me"
"Your copying me"
"Mum Milos not playing fair"
"Mum Milos not playing fair"
"You started it"
"You started it"
etc until someone pulls the power.
The Dark Wayne @ Jun 2nd 2009 10:36AM
more like until his eyes turn red and begins to plot humanity's downfall
Quattro @ Jun 2nd 2009 7:44AM
I know I'll be using Millie.
;)
Rop @ Jun 2nd 2009 7:46AM
Seaman, I was just thinking of that too!
Virtual eye for the lonely guy?
Jason Statham (Aka Vegeta) @ Jun 2nd 2009 7:49AM
If this works exactly the way Microsoft wants it too, this could end up being fucking amazing. I hope it does, it really seemed so cool when they were showing it.
MowDownJoe @ Jun 2nd 2009 8:03AM
No one cares, you spambot.
magicianoffear @ Jun 2nd 2009 8:29AM
Stuff like this creeps me out. For one I really don't see this as an interesting application for games at all, who wants to talk and interact with a digital child? Also the part that really creeps me out is that possible future versions or eventual "hacks" of things like this will only lead to creepy/perverted interactions with the most unsavory of people having ample time to practice things like touching others, or in this specific case using it as training for how to coax/interact with a child. Maybe its the cop in me but I can see this going down hill and fast, sure it's interesting to see technology evolve its self but the thing is that outside of it's creators hands society has a way of twisting and perverting even the most pure of ideas. For now though to me it just does not look like fun for a game, interesting sure but not fun.
Nick8708 @ Jun 2nd 2009 9:45AM
I don't understand how you can fear that someone will manage to "hack" this and introduce behaviors that don't already exist in code, or add anatomy to a model that doesn't already exist (you don't think game characters have genitalia, do you?). That's one pretty massive hack - practically to the point of being a full blown mod. It's not as easy as you might think, especially on the very much closed ecosystem that is a game console. It's not impossible, but it's certainly not inevitable.
Anyways...
No amount of "training" any child molester can attempt will override the single most important factor in preventing abuse - an attentive guardian. Nor would it likely even aid in overcoming the second most important factor - teaching a child to avoid strangers (even though more than 99% of all people that would be a stranger to one's child poses no danger).
It's fears like yours that have little-to-no basis in reality but extremely dire consequences that cause nations to ban games because of violence in the wake of school shootings and people like Jack Thompson to have a soapbox from which to sputter nonsensical rhetoric. Obviously posting on this website means you enjoy and appreciate games and (likely) gaming culture, but you gotta keep things in perspective lest you let outrageous, unfounded fears blow them out of proportion.
Speaking of Jack Thompson, I think we should create a pool on when he starts making the claims that this is a "child predator trainer" because I wouldn't put it past him.
Sidebuster @ Jun 2nd 2009 10:21AM
I agree for the most part. This would be the point where playing games is like practicing. Getting the user excited to try it out in the real world.
LordPaul @ Jun 3rd 2009 2:47AM
"Maybe its the cop in me"
....that put the bug up your ass???