Insider’s Guide to the New Holographic Computing

In my seven happy years at Microsoft before leaving a couple of months ago, I was never happier than when I was involved in a cool “secret project.”

Last year my team and I contributed for many months on a revolutionary secret project – Holographic Computing – which is being revealed today at Microsoft headquarters.  I’ve been blogging for years about a variety of research efforts which additively culminated in today’s announcements: HoloLens, HoloStudio for 3D holographic building, and a series of apps (e.g. HoloSkype, HoloMinecraft) for this new platform on Windows 10.

For my readers in government, or who care about the government they pay for, PAY CLOSE ATTENTION.

It’s real. I’ve worn it, used it, designed 3D models with it, explored the real surface of Mars, played and laughed and marveled with it. This isn’t Einstein’s “spooky action at a distance.” Everything in this video works today:

These new inventions represent a major new step-change in the technology industry. That’s not hyperbole. The approach offers the best benefit of any technology: empowering people simply through complexity, and by extension a way to deliver new & unexpected capabilities to meet government requirements.

Holographic computing, in all the forms it will take, is comparable to the Personal Computing revolution of the 1980s (which democratized computing), the Web revolution of the ’90s (which universalized computing), and the Mobility revolution of the past eight years, which is still uprooting the world from its foundation.

One important point I care deeply about: Government missed each of those three revolutions. By and large, government agencies at all levels were late or slow (or glacial) to recognize and adopt those revolutionary capabilities. That miss was understandable in the developing world and yet indefensible in the United States, particularly at the federal level.

I worked at the Pentagon in the summer of 1985, having left my own state-of-the-art PC at home at Stanford University, but my assigned “analytical tool” was a typewriter. In the early 2000s, I worked at an intelligence agency trying to fight a war against global terror networks when most analysts weren’t allowed to use the World Wide Web at work. Even today, government agencies are lagging well behind in deploying modern smartphones and tablets for their yearning-to-be-mobile workforce.

This laggard behavior must change. Government can’t afford (for the sake of the citizens it serves) to fall behind again, and  understanding how to adapt with the holographic revolution is a great place to start, for local, national, and transnational agencies.

Now some background…

Virtual recipe stirs in Apple iPad, Microsoft Kinect

Who says Apple and Microsoft can’t work together?  They certainly do, at least when it involves the ingenuity of their users, the more inventive of whom use technologies from both companies (and others).

Here’s a neat example, “a just-for-fun experiment from the guys at Laan Labs” where they whip up a neat Augmented Reality recipe: take one iPad, one Kinect, and stir:

Some technical detail from the Brothers Laan, the engineers who did the work:

We used the String Augmented Reality SDK to display real-time 3d video+audio recorded from the Kinect. Libfreenect from http://openkinect.org/ project was used for recording the data coming from the Kinect. A textured mesh was created from the calibrated depth+rgb data for each frame and played back in real-time. A simple depth cutoff allowed us isolate the person in the video from the walls and other objects. Using the String SDK, we projected it back onto a printed image marker in the real world.” – source, Laan Labs blog.

As always, check out http://www.kinecthacks.com/ for the latest and greatest Kinect hacks – or more accurately now, the latest cool uses of the openly released free Kinect SDK, available here.

There are several quiet projects underway around the DC Beltway to make use of the SDK, testing non-commercial but government-relevant deployments – more detail and examples at the appropriate time. We will eventually release a commercial SDK with even more functionality and higher-level programming controls, which will directly benefit government early adopters.

In the meantime, I may report on some of the new advances being made by our research group on Computational User Experiences, who “apply expertise in machine learning, visualization, mobile computing, sensors and devices, and quantitative and qualitative evaluation techniques to improve the state of the art in physiological computing, healthcare, home technologies, computer-assisted creativity, and entertainment.” That’s a rich agenda, and the group is in the very forefront of defining how Natural User Interaction (NUI) will enhance our personal and professional lives….

Share this post on Twitter

Email this post to a friend

Air Everything

Like many people, I was very impressed by a video over the weekend of the Word Lens real-time translation app for iPhone.  It struck with a viral bang, and within a few days racked up over 2 million YouTube views. What particularly made me smile was digging backwards through the twitter stream of a key Word Lens developer whom I follow, John DeWeese, and finding this pearl of a tweet (right) from several months ago, as he was banging out the app out in my old stomping grounds of the San Francisco Bay Area. That’s a hacker mentality for you 🙂

But one thought I had in watching the video was, why do I need to be holding the little device in front of me, to get the benefit of its computational resources and display? I’ve seen the studies and predictions that “everything’s going mobile,” but I believe that’s taking too literally the device itself, the form-factor of a little handheld box of magic.

Pre-release hands-on look at WP7

I try to avoid straight-up promotion for my employer on my blog too often (if you didn’t know, it’s that scrappy West-Coast-based startup Microsoft). I like sharing R&D projects, but for consumer products I leave that stuff to others or third-parties.

But with the Apple iPhone 4 controversy going on, and Google’s Droid platform chugging away, frankly I was surprised to see a long story on übergeek tech blog Engadget today about our Windows Phone 7, with a great video of a hands-on demo:

I’m sharing it because I eagerly await the launch for my own use. The review itself is worth a read – it has in-depth looks at the UI and UX, social-networking aspects, music integration (full-on Zune experience), app marketplace, search, maps, innovative photos, wireless cloud syncing, high-def video, elegant online/offline email innovation, Office integration, Xbox Live, and other facets. Some features are good, some missing, some are awesome. Launch coming this fall…

Share this post on Twitter

Email this post to a friend

Bing vs Google, the quiet semantic war

On Wednesday night I had dinner at a burger joint with four old friends; two work in the intelligence community today on top-secret programs, and two others are technologists in the private sector who have done IC work for years. The five of us share a particular interest besides good burgers: semantic technology.

Oh, we talked about mobile phones (iPhones were whipped out as was my Windows Phone, and apps debated) and cloud storage (they were stunned that Microsoft gives 25 gigabytes of free cloud storage with free Skydrive accounts, compared to the puny 2 gig they’d been using on DropBox).

But we kept returning to semantic web discussions, semantic approaches, semantic software. One of these guys goes back to the DAML days of DARPA fame, the guys on the government side are using semantic software operationally, and we all are firm believers in Our Glorious Semantic Future.

Slate of the Union Day

Today is “Slate of the Union” day, when the two most charismatic individuals in recent American history go on stage and attempt to reclaim mantles as innovators. I’ll leave aside the fellow with lower poll numbers for now (President Obama). More eyes in the tech world will be watching as Steve Jobs makes his newest product announcement, the Apple tablet/Tabloid/iSlate thing iPad (it’s official).

Back in the late 1980s I worked for the legendary “Mayor of Silicon Valley” Tom McEnery (he was actually the mayor of San Jose), and we did many joint projects with Apple, particularly with CEO John Sculley, a great guy.

Para Bellum Web

Tim O'Reilly, Ray Ozzie

Tim O’Reilly created a bit of a stir last night in the tech world by writing a thoughtful essay entitled “The War for the Web.” He’ll be expanding on his thoughts in his keynote address today at the Web 2.0 Expo in New York. From the essay, here’s the core argument:

“[W]e’ve grown used to a world with one dominant search engine, one dominant online encyclopedia, one dominant online retailer, one dominant auction site, one dominant online classified site, and we’ve been readying ourselves for one dominant social network. But what happens when a company with one of these natural monopolies uses it to gain dominance in other, adjacent areas? I’ve been watching with a mixture of admiration and alarm as Google has taken their dominance in search and used it to take control of other, adjacent data-driven applications.

It could be that everyone will figure out how to play nicely with each other, and we’ll see a continuation of the interoperable web model we’ve enjoyed for the past two decades. But I’m betting that things are going to get ugly. We’re heading into a war for control of the web. And in the end, it’s more than that, it’s a war against the web as an interoperable platform. [emphasis added] Instead, we’re facing the prospect of Facebook as the platform, Apple as the platform, Google as the platform, Amazon as the platform, where big companies slug it out until one is king of the hill.

… P.S. One prediction: Microsoft will emerge as a champion of the open web platform, supporting interoperable web services from many independent players, much as IBM emerged as the leading enterprise backer of Linux.

Tellme what you want

The future of social computing is in the integration of various services and technologies – but the fun is already available now. Here’s a nifty demo of the integration of cloud computing’s services with increasingly powerful mobile computers (smartphones or netbooks). Developers can take advantage of far more computational power both locally on the device – faster, cheaper processors thanks to Moore’s Law – and computational power residing on networked data centers.  Think of a business or social activity, and thanks to platforms like the iPhone, Android, and the new Windows Phones, “There’s an app for that.” Or there soon will be.

This quick little demo feels like nothing fancy today – but ten, even five years ago it would have seemed like sci-fi. In fact it’s available now, and uses a new Windows Phone, in this case a Samsung Intrepid, making use of Tellme software from Microsoft integrated with Bing Search web services. The demo intregrates some longtime technologies in their state-of-the-art condition today using cloud-services delivery:

• Speech-to-text
• GPS-enabled location-based services
• Web search
• Voice-enabled dialing
• Social media (crowdsourced ratings integrated in search results)
• Hardware UI (a dedicated TellMe button on the Samsung Intrepid phone)

Share this post on Twitter

Email this post to a friend

The So-Called Secret Courier Video

What is the “user interface of tomorrow”? In the past I have chronicled some cool Microsoft Research prototypes of flexible touchscreen interfaces – and even touchless interfaces!  And now this month one of my friends in MSR, Mary Czerwinski, has written in Venture Beat that “those types of interfaces could be the tip of the iceberg”:

A whole new set of interfaces are in the works at various stages of research and development… I have colleagues working on tongue-based interaction, bionic contacts lenses, a muscle-computer interface, and brain-computer interaction.” – Mary Czerwinski

Not bad! But working devices along those lines are several years away, so for now we’re stuck with the tablet form-factor as the primary basis for natural input. I’ve used a tablet PC on and off for the past five years, happily. My wife now uses an HP tablet.

So I’ve been eagerly following the blogosphere’s hyperventilation about the much-rumored, still-unseen Apple tablet computer, which has been variously described as being close to launch, far from launch, and non-existent.

 

Navigating Indoors Without GPS

Here’s a nifty demo of a very small piece of software, that could find daily use for large numbers of people in any large enterprise, or any shopper in a mall – anywhere someone’s wandering in a large building or complex looking for a specific office, conference room, storefront, or location – especially indoors where GPS is of no use.

It’s called GoMap, and I think it could have great applicability for government complexes, which have lots of rabbit-warren hallways, lots of constantly-reassigned workers, and lots of visitors.

I missed GoMap’s first public unveiling today because I’m on the east coast this week, mostly for the Cybersecurity “Leap Ahead” conference in Arlington Virginia which wrapped up today; I will write about the conference separately.

But that meant I had to miss the bar-camp-style WinMoDevCamp today on the Microsoft campus in Redmond. There was a lot of buzz around this DevCamp, and there’ll be others in 6 more cities soon (Austin, London, New York, San Francisco, Singapore, and Toronto) as developers gear up for the upcoming release of the Windows Mobile 6.5 operating system.  You can get registration information about the future events at the main WinMoDevCamp site (props to Todd Bishop on his TechFlash blog for highlighting the series).

The GoMap prototype makes innovative location-aware use of Microsoft Tag and TagReader (the high-capacity color barcodes developed by Microsoft Research), to solve the problem of having no GPS capability indoors  – check out the short video.

WinMoDevCamp is an indication that there’s a real explosion of app development going on in the Windows Mobile world, to match the equally exciting iPhone app and Android app activity. There’s been a feeling in Microsoft that our best advantages are the large installed base through third-party WinMo phone manufacturers, plus Microsoft’s long experience nurturing app developers on other platforms (.Net as a good example).  But I personally think that superior innovation is going to be the battleground, and we’re well positioned for that as well, with a lot of exciting things emerging from Microsoft Research and different advanced development labs in product groups. GoMap’s one example.

Not sure of the timeline for GoMap, but you can use TagReader right now, without the GoMap piece. It’s a free download on the Tag webpage, or you can get it on any mobile phone (yes, even the exploding iPhone) at http://gettag.mobi.

Email this post to a friend