Virtual recipe stirs in Apple iPad, Microsoft Kinect

Who says Apple and Microsoft can’t work together?  They certainly do, at least when it involves the ingenuity of their users, the more inventive of whom use technologies from both companies (and others).

Here’s a neat example, “a just-for-fun experiment from the guys at Laan Labs” where they whip up a neat Augmented Reality recipe: take one iPad, one Kinect, and stir:

Some technical detail from the Brothers Laan, the engineers who did the work:

We used the String Augmented Reality SDK to display real-time 3d video+audio recorded from the Kinect. Libfreenect from http://openkinect.org/ project was used for recording the data coming from the Kinect. A textured mesh was created from the calibrated depth+rgb data for each frame and played back in real-time. A simple depth cutoff allowed us isolate the person in the video from the walls and other objects. Using the String SDK, we projected it back onto a printed image marker in the real world.” – source, Laan Labs blog.

As always, check out http://www.kinecthacks.com/ for the latest and greatest Kinect hacks – or more accurately now, the latest cool uses of the openly released free Kinect SDK, available here.

There are several quiet projects underway around the DC Beltway to make use of the SDK, testing non-commercial but government-relevant deployments – more detail and examples at the appropriate time. We will eventually release a commercial SDK with even more functionality and higher-level programming controls, which will directly benefit government early adopters.

In the meantime, I may report on some of the new advances being made by our research group on Computational User Experiences, who “apply expertise in machine learning, visualization, mobile computing, sensors and devices, and quantitative and qualitative evaluation techniques to improve the state of the art in physiological computing, healthcare, home technologies, computer-assisted creativity, and entertainment.” That’s a rich agenda, and the group is in the very forefront of defining how Natural User Interaction (NUI) will enhance our personal and professional lives….

Share this post on Twitter

Email this post to a friend

The promise of mobile augmented reality

Robotvision appMy intention with this blog is always to write medium-length “think-pieces,” about technology, government, or preferably both. I’m working on several (the Jefferson Gov 2.0 piece, the Evil Twin 2.0 piece, and one on “whither the multilingual web”), but they do truly require thought and some free time, so they percolate a bit.

In the meantime, readers like the latest cool demo videos, so for Friday fun here’s another one (watch below or on youTube), which was featured on TechCrunch last night (“Bing comes to the iPhone via Robotvision”), with an augmented reality app for the iPhone which uses Bing Maps and Bing’s real-time data (website here). The company describes itself this way:

Continue reading

Stop being so touchy

Remember Tom Cruise’s virtual 3D in Minority Report? Wouldn’t it be cool if, instead of an iPhone-like touch screen, we could manipulate data and 3D images on screens by simply moving our hands – interacting virtually without touching a keyboard or screen?

Continue reading

%d bloggers like this: