KinectFusion HQ creates 3D models from your surroundings
35
We've seen people do some pretty awesome stuff with the Kinect that expands the peripheral's applications beyond the realm of controlling games, but we've yet to see anything that matches the wide-reaching implications of Microsoft Research's KinectFusion HQ concept.
Using the Kinect's dual cameras, KinectFusion HQ can construct an accurate, high-quality 3D representation of an entire room in a matter of seconds. The longer the Kinect has to look at a specific object, the more detailed that object then becomes; able to accurately scan and render millimeter differences in texture.
Once the room is rendered, the model can then be interacted with in real time, which the above (oddly silent) tech demo demonstrates in increasingly wild and mind-blowing ways. Since the Kinect is typically thought of as a stationary object, it will be interesting to see how this technology may eventually be implemented into gaming, since its primary functionality relies on moving the unit around the space you're scanning.
Reader Comments (35)
Posted: Aug 15th 2011 8:11PM PR0F3TA said
@Aguiluz
hope you don't get downvoted... for what? stating the truth. Kinect proved to be innovating for everything but actual games. Remember how you play Ghost Recon lol... Who knows how you play Ryse.
http://www.youtube.com/watch?v=2adTBhU5VhI
BBBLLUUUUUUEEEE!!!
hope you don't get downvoted... for what? stating the truth. Kinect proved to be innovating for everything but actual games. Remember how you play Ghost Recon lol... Who knows how you play Ryse.
http://www.youtube.com/watch?v=2adTBhU5VhI
BBBLLUUUUUUEEEE!!!
Posted: Aug 15th 2011 8:12PM Raffi256 said
Here's the original video without ads:
http://msrvideo.vo.msecnd.net/rmcvideos/152815/dl/152815.wmv
http://msrvideo.vo.msecnd.net/rmcvideos/152815/dl/152815.mp4
http://msrvideo.vo.msecnd.net/rmcvideos/152815/dl/152815.wmv
http://msrvideo.vo.msecnd.net/rmcvideos/152815/dl/152815.mp4
Posted: Aug 15th 2011 8:19PM Shadowbender said
Posted: Aug 15th 2011 8:37PM Shadowbender said
@Shadowbender
Did I mention that this KinectFusion HQ represents something very, very cool, and opens up flat-out amazing opportunities? Because it does.
Reply
Did I mention that this KinectFusion HQ represents something very, very cool, and opens up flat-out amazing opportunities? Because it does.
Posted: Aug 15th 2011 8:23PM stickguy259 said
Can I just say that that's pretty damn incredible? For anyone who doesn't want to watch the whole thing,, I recommend skipping to about 3:50 and watching them throw particles around the room. Awesome. And when the guy flicks his shirt near the end and the particles fly off? Awesome. It wouldn't really work for a game NOW, but I can't wait for what happens with this in the future.
Posted: Aug 15th 2011 8:26PM Robborboy said
Think of the number of things you could draw a penis on and no one would ever know!
Posted: Aug 15th 2011 8:30PM nibbon said
The best application I can think of is for game designers. Imagine programming a counter-strike level to be an exact replica of your office in the matter of a few minutes of walking around and pointing a kinect camera everywhere.
For gaming, the application may be next generation ...
I wish there was a higher end wireless kinect with an 8mp camera - not that everyone could afford it but I would gladly pay $300 for it. I realize why they don't - they need to upgrade the xbox before they do - but it would still be really neat (if not just for the computer applications).
For gaming, the application may be next generation ...
I wish there was a higher end wireless kinect with an 8mp camera - not that everyone could afford it but I would gladly pay $300 for it. I realize why they don't - they need to upgrade the xbox before they do - but it would still be really neat (if not just for the computer applications).
Posted: Oct 22nd 2011 8:28PM Polymorphic Ninja said
@nibbon
Agreed. The role of 3D artists changes pretty significantly with this tool. You can hire workers with no computer knowledge at all to make sets, models, etc, just like they do in Hollywood, and then just scan the final models in for post production.
Reply
Agreed. The role of 3D artists changes pretty significantly with this tool. You can hire workers with no computer knowledge at all to make sets, models, etc, just like they do in Hollywood, and then just scan the final models in for post production.
Posted: Aug 15th 2011 8:31PM BFBeast666 said
From the time they unveiled "Project Natal" for the first time I knew that it would be awesome tech. Too bad everything they do with it is the n-th iteration of full body waggle games. Talk about wasted potential.
Posted: Aug 15th 2011 8:36PM DURDADUR said
I can see this being amazing for CAD work! Here's to hoping for a SolidWorks plugin...
Keep up the awesome ideas all you kinect hackers!
And hey, x360 game devs...maybe hit some of these guys up for ideas on how to use the kinect, cool thanks, bye
Keep up the awesome ideas all you kinect hackers!
And hey, x360 game devs...maybe hit some of these guys up for ideas on how to use the kinect, cool thanks, bye
Posted: Aug 15th 2011 8:50PM A Sandwich said
@Aguiluz
I know what you mean. Every time I hear "Move" I automatically think "Wiimote".
I know what you mean. Every time I hear "Move" I automatically think "Wiimote".
Posted: Aug 15th 2011 8:50PM kidquest said
The augmented reality portions of this demo are like a more accurate version of Sony's SmartAR:
http://www.youtube.com/watch?v=QkMboeHJQoY
http://www.youtube.com/watch?v=qsYkzoa7McA
http://www.youtube.com/watch?v=QkMboeHJQoY
http://www.youtube.com/watch?v=qsYkzoa7McA
Posted: Aug 15th 2011 8:57PM Seven Hour War said
Amazing! Imagine the possibilities.
Now all we need is for games to take advantage of this and not just the usual wave your arms like a maniac mechanic.
Now all we need is for games to take advantage of this and not just the usual wave your arms like a maniac mechanic.
Posted: Aug 15th 2011 9:01PM CaptainProtonX said
So many penis potential, so little time.
Posted: Aug 16th 2011 1:16AM FancyCat2008 said
@SpecBlank
Okay okay, we can also do boobs.
But only because you asked nicely.
Reply
Okay okay, we can also do boobs.
But only because you asked nicely.
Posted: Aug 15th 2011 9:05PM RedgeHammer said
Incredible.
Posted: Aug 15th 2011 9:56PM Chichok said
I love the Kinect hacks, I really do. I just wish we can see the same innovation being used in actual games and making them work.
Posted: Aug 15th 2011 11:13PM tendoboy1984 said
@Chichok
They aren't hacks. People are creating specific programming for the Kinect that allows it to do these things, and Microsoft is supporting these developments.
Reply
They aren't hacks. People are creating specific programming for the Kinect that allows it to do these things, and Microsoft is supporting these developments.
Posted: Aug 15th 2011 10:12PM killploki said
this would be a cool way to whip up some cg environments, although i'm sure the meshes created would be pretty ugly and be a lot more dense than needed, but maybe useful for normal or displacement maps
Posted: Aug 15th 2011 10:17PM A Sandwich said
@Lucky48
I thought we were just talking about word and object associations.
I thought we were just talking about word and object associations.
Posted: Aug 15th 2011 11:12PM tendoboy1984 said
Let's see Sony get this ambitious with the PlayStation Move...
My god the stuff Microsoft and it's partners have come up with is amazing. Microsoft truly has a hit on their hands.
As Mario would say: "CONGRATULATIONS!"
My god the stuff Microsoft and it's partners have come up with is amazing. Microsoft truly has a hit on their hands.
As Mario would say: "CONGRATULATIONS!"
Posted: Aug 16th 2011 12:32AM shadonic said
I really don’t understand the people who come in here saying stuff like I don’t remember the last time I read an article about a kinect game for 360. Microsoft has not only released a list of like what 20 or so kinect games that are coming out soon and there have been articles on most of them already there's a lot of information out there and I don't understand how they’re not finding it. Also these things take time I haven't seen an article on a PS move game in a long time either and I check like 4-5 gaming sites a day. Also just because there are more articles on hacks than games does not make that a bad thing these hacks could be put into future gaming projects for the kinect and hey if you want more articles on kinect games speak to some of the hackers learn something and you try it out and try and get in contact with Microsoft and if your too lazy to do that stuff than be patient and wait until the games are at least close to their release dates or just search for some.
Just look at some of this hacks that can easily be implemented into future kinect games.
http://www.youtube.com/user/garethop#p/a/u/2/t2y49c1Fr6w
http://www.youtube.com/user/Activate3D#p/u/1/KZe7vmO0ygk
Just look at some of this hacks that can easily be implemented into future kinect games.
http://www.youtube.com/user/garethop#p/a/u/2/t2y49c1Fr6w
http://www.youtube.com/user/Activate3D#p/u/1/KZe7vmO0ygk
Posted: Aug 16th 2011 12:46AM Starcade said
Wow, this is pretty cool. I only see this technology getting better. Imagine years from now what we'll be able to do with the 360, or a PC for that matter with this type of technology.
Posted: Aug 16th 2011 1:46AM eNriqeu said
@A Sandwich
Yep, I think o it too, but a bit more like motion+ plus a camera, and GAMES!!!
Games that I actually would like to play with a wiimote but, on my PS3.
Sooooo, it's great.
Kinect hacks?
...
Not so much.
Yep, I think o it too, but a bit more like motion+ plus a camera, and GAMES!!!
Games that I actually would like to play with a wiimote but, on my PS3.
Sooooo, it's great.
Kinect hacks?
...
Not so much.
Posted: Aug 16th 2011 5:49AM Design by Adrian said
So close to being able to play Unreal in my office without having to know how to build a map with textures.
Posted: Aug 16th 2011 8:38AM Fire Walk With Me said
@Aguiluz Since everyone else is trying to one up the previous with shit jokes or snark I'll answer.
E3, Double Fine's Seaseme (sic) Street and when Twisted Pixel talks about the puppet game.
E3, Double Fine's Seaseme (sic) Street and when Twisted Pixel talks about the puppet game.
Posted: Aug 16th 2011 11:18AM shadonic said
imagine them importing this to 360 and you could make your own arena with anything in your house on a table or the ground and all you have to do is move your kinect around it and add small stuff in a map editor. That would be like having forge in real life. They could also do like a character creation thing with this you could have scan your self in then add the smaller details in on the game and play as yourself. Groundbreaking ideas here * pats self on back*
Posted: Aug 16th 2011 1:30PM Machiavellian79 said
"I love the Kinect hacks, I really do. I just wish we can see the same innovation being used in actual games and making them work."
I think what people for get that proof of concept is much different from creating a game. Think how long it takes to make your average game today about 24 months. Now think about creating a game from scratch, not knowing if the mechanic works as a game or trying to build a game around a proof of concept. These things take time and resources.
On another note, there are no more hacks to Kinect. MS and their partner company have released official drivers and an SDK for Kinect so now these are just normal projects people are using Kinect with.
I think what people for get that proof of concept is much different from creating a game. Think how long it takes to make your average game today about 24 months. Now think about creating a game from scratch, not knowing if the mechanic works as a game or trying to build a game around a proof of concept. These things take time and resources.
On another note, there are no more hacks to Kinect. MS and their partner company have released official drivers and an SDK for Kinect so now these are just normal projects people are using Kinect with.
Posted: Aug 16th 2011 3:16PM xxxsam said
@Machiavellian79
This is pretty much the definition of a 'hack' - doing something really cool with technology that goes beyond what it was actually intended for.
There is virtually no chance this will ever be used in a game (because of having to move the sensor around) but it is pretty damn incredible and definitely shows the implications of this technology (possibly a higher-resolution 'professional' version - but might the existing one be good enough for a low-cost option?) for a 3D scanning type application.
Reply
This is pretty much the definition of a 'hack' - doing something really cool with technology that goes beyond what it was actually intended for.
There is virtually no chance this will ever be used in a game (because of having to move the sensor around) but it is pretty damn incredible and definitely shows the implications of this technology (possibly a higher-resolution 'professional' version - but might the existing one be good enough for a low-cost option?) for a 3D scanning type application.
Posted: Aug 16th 2011 6:38PM Abob Lyndsae said
At 3:50 - World's first vomiting pea soup in your own living room simulator.
Posted: Nov 7th 2011 3:14AM 3dsmodel said
hi, please visit the http://www.3dsmodel.eu/, for more low price 3d models







