Virtual recipe stirs in Apple iPad, Microsoft Kinect

Who says Apple and Microsoft can’t work together?  They certainly do, at least when it involves the ingenuity of their users, the more inventive of whom use technologies from both companies (and others).

Here’s a neat example, “a just-for-fun experiment from the guys at Laan Labs” where they whip up a neat Augmented Reality recipe: take one iPad, one Kinect, and stir:

Some technical detail from the Brothers Laan, the engineers who did the work:

We used the String Augmented Reality SDK to display real-time 3d video+audio recorded from the Kinect. Libfreenect from http://openkinect.org/ project was used for recording the data coming from the Kinect. A textured mesh was created from the calibrated depth+rgb data for each frame and played back in real-time. A simple depth cutoff allowed us isolate the person in the video from the walls and other objects. Using the String SDK, we projected it back onto a printed image marker in the real world.” - source, Laan Labs blog.

As always, check out http://www.kinecthacks.com/ for the latest and greatest Kinect hacks – or more accurately now, the latest cool uses of the openly released free Kinect SDK, available here.

There are several quiet projects underway around the DC Beltway to make use of the SDK, testing non-commercial but government-relevant deployments – more detail and examples at the appropriate time. We will eventually release a commercial SDK with even more functionality and higher-level programming controls, which will directly benefit government early adopters.

In the meantime, I may report on some of the new advances being made by our research group on Computational User Experiences, who “apply expertise in machine learning, visualization, mobile computing, sensors and devices, and quantitative and qualitative evaluation techniques to improve the state of the art in physiological computing, healthcare, home technologies, computer-assisted creativity, and entertainment.” That’s a rich agenda, and the group is in the very forefront of defining how Natural User Interaction (NUI) will enhance our personal and professional lives….

Share this post on Twitter

Email this post to a friend

Air Everything

Like many people, I was very impressed by a video over the weekend of the Word Lens real-time translation app for iPhone.  It struck with a viral bang, and within a few days racked up over 2 million YouTube views. What particularly made me smile was digging backwards through the twitter stream of a key Word Lens developer whom I follow, John DeWeese, and finding this pearl of a tweet (right) from several months ago, as he was banging out the app out in my old stomping grounds of the San Francisco Bay Area. That’s a hacker mentality for you :)

But one thought I had in watching the video was, why do I need to be holding the little device in front of me, to get the benefit of its computational resources and display? I’ve seen the studies and predictions that “everything’s going mobile,” but I believe that’s taking too literally the device itself, the form-factor of a little handheld box of magic.

Continue reading

Pre-release hands-on look at WP7

I try to avoid straight-up promotion for my employer on my blog too often (if you didn’t know, it’s that scrappy West-Coast-based startup Microsoft). I like sharing R&D projects, but for consumer products I leave that stuff to others or third-parties.

But with the Apple iPhone 4 controversy going on, and Google’s Droid platform chugging away, frankly I was surprised to see a long story on übergeek tech blog Engadget today about our Windows Phone 7, with a great video of a hands-on demo:

I’m sharing it because I eagerly await the launch for my own use. The review itself is worth a read – it has in-depth looks at the UI and UX, social-networking aspects, music integration (full-on Zune experience), app marketplace, search, maps, innovative photos, wireless cloud syncing, high-def video, elegant online/offline email innovation, Office integration, Xbox Live, and other facets. Some features are good, some missing, some are awesome. Launch coming this fall…

Share this post on Twitter

Email this post to a friend

AddThis Social Bookmark Button

Bing vs Google, the quiet semantic war

On Wednesday night I had dinner at a burger joint with four old friends; two work in the intelligence community today on top-secret programs, and two others are technologists in the private sector who have done IC work for years. The five of us share a particular interest besides good burgers: semantic technology.

Oh, we talked about mobile phones (iPhones were whipped out as was my Windows Phone, and apps debated) and cloud storage (they were stunned that Microsoft gives 25 gigabytes of free cloud storage with free Skydrive accounts, compared to the puny 2 gig they’d been using on DropBox).

But we kept returning to semantic web discussions, semantic approaches, semantic software. One of these guys goes back to the DAML days of DARPA fame, the guys on the government side are using semantic software operationally, and we all are firm believers in Our Glorious Semantic Future.

Continue reading

Slate of the Union Day

Today is “Slate of the Union” day, when the two most charismatic individuals in recent American history go on stage and attempt to reclaim mantles as innovators. I’ll leave aside the fellow with lower poll numbers for now (President Obama). More eyes in the tech world will be watching as Steve Jobs makes his newest product announcement, the Apple tablet/Tabloid/iSlate thing iPad (it’s official).

Back in the late 1980s I worked for the legendary “Mayor of Silicon Valley” Tom McEnery (he was actually the mayor of San Jose), and we did many joint projects with Apple, particularly with CEO John Sculley, a great guy.

Continue reading

Para Bellum Web

Tim O'Reilly, Ray Ozzie

Tim O’Reilly created a bit of a stir last night in the tech world by writing a thoughtful essay entitled “The War for the Web.” He’ll be expanding on his thoughts in his keynote address today at the Web 2.0 Expo in New York. From the essay, here’s the core argument:

“[W]e’ve grown used to a world with one dominant search engine, one dominant online encyclopedia, one dominant online retailer, one dominant auction site, one dominant online classified site, and we’ve been readying ourselves for one dominant social network. But what happens when a company with one of these natural monopolies uses it to gain dominance in other, adjacent areas? I’ve been watching with a mixture of admiration and alarm as Google has taken their dominance in search and used it to take control of other, adjacent data-driven applications.

It could be that everyone will figure out how to play nicely with each other, and we’ll see a continuation of the interoperable web model we’ve enjoyed for the past two decades. But I’m betting that things are going to get ugly. We’re heading into a war for control of the web. And in the end, it’s more than that, it’s a war against the web as an interoperable platform. [emphasis added] Instead, we’re facing the prospect of Facebook as the platform, Apple as the platform, Google as the platform, Amazon as the platform, where big companies slug it out until one is king of the hill.

… P.S. One prediction: Microsoft will emerge as a champion of the open web platform, supporting interoperable web services from many independent players, much as IBM emerged as the leading enterprise backer of Linux.

Continue reading

Tellme what you want

The future of social computing is in the integration of various services and technologies – but the fun is already available now. Here’s a nifty demo of the integration of cloud computing’s services with increasingly powerful mobile computers (smartphones or netbooks). Developers can take advantage of far more computational power both locally on the device – faster, cheaper processors thanks to Moore’s Law – and computational power residing on networked data centers.  Think of a business or social activity, and thanks to platforms like the iPhone, Android, and the new Windows Phones, “There’s an app for that.” Or there soon will be.

This quick little demo feels like nothing fancy today – but ten, even five years ago it would have seemed like sci-fi. In fact it’s available now, and uses a new Windows Phone, in this case a Samsung Intrepid, making use of Tellme software from Microsoft integrated with Bing Search web services. The demo intregrates some longtime technologies in their state-of-the-art condition today using cloud-services delivery:

  • Speech-to-text
  • GPS-enabled location-based services
  • Web search
  • Voice-enabled dialing
  • Social media (crowdsourced ratings integrated in search results)
  • Hardware UI (a dedicated TellMe button on the Samsung Intrepid phone)

Share this post on Twitter

Email this post to a friend

AddThis Social Bookmark Button

Follow

Get every new post delivered to your Inbox.

Join 6,249 other followers

%d bloggers like this: