Who says Apple and Microsoft can’t work together? They certainly do, at least when it involves the ingenuity of their users, the more inventive of whom use technologies from both companies (and others).
Here’s a neat example, “a just-for-fun experiment from the guys at Laan Labs” where they whip up a neat Augmented Reality recipe: take one iPad, one Kinect, and stir:
Some technical detail from the Brothers Laan, the engineers who did the work:
We used the String Augmented Reality SDK to display real-time 3d video+audio recorded from the Kinect. Libfreenect from http://openkinect.org/ project was used for recording the data coming from the Kinect. A textured mesh was created from the calibrated depth+rgb data for each frame and played back in real-time. A simple depth cutoff allowed us isolate the person in the video from the walls and other objects. Using the String SDK, we projected it back onto a printed image marker in the real world.” – source, Laan Labs blog.
There are several quiet projects underway around the DC Beltway to make use of the SDK, testing non-commercial but government-relevant deployments – more detail and examples at the appropriate time. We will eventually release a commercial SDK with even more functionality and higher-level programming controls, which will directly benefit government early adopters.
In the meantime, I may report on some of the new advances being made by our research group on Computational User Experiences, who “apply expertise in machine learning, visualization, mobile computing, sensors and devices, and quantitative and qualitative evaluation techniques to improve the state of the art in physiological computing, healthcare, home technologies, computer-assisted creativity, and entertainment.” That’s a rich agenda, and the group is in the very forefront of defining how Natural User Interaction (NUI) will enhance our personal and professional lives….
On April 16 I will be speaking at the Mobile Citizen Summit in Washington DC (registration still open), which brings together “practitioners across the government, nonprofit, advocacy, and political spaces—the kinds of people who develop the strategy and the tools to reach, engage, educate, and enable citizens across the country and around the world.”
But I’m going to be talking about “mobile” in a different way than others still use the term, i.e. they focus on a handheld device, while I will be focusing on the mobile citizen. As I have said before I don’t believe our future involves experiencing “augmented reality” by always holding up little 3-inch plastic screens in front of our faces. Natural user interfaces and immersive computing offer much more to how we access computational resources – and how technology will help us interact with one another. Here’s an example, in a story from the past week.
For the past few months, when I’ve had visitors to Microsoft Research on the Redmond campus one of the things I’ve enjoyed demonstrating is the technology behind the new system for Xbox 360 – the controller-free gaming and immersive entertainment system that Microsoft is releasing for the holiday market in a month or so. In particular, I’ve enjoyed having Andy Wilson of MSR talk with visitors about some of the future implications in non-gaming scenarios, including general information work, and how immersive augmented-reality (AR) could transform our capabilities for working with information, virtual objects, and how we all share and use knowledge among ourselves.
We’re further along in this area than I thought we’d be five years ago, and I suspect we’ll be similarly surprised by 2015.
In particular, there is great interest (both in and out of the government circles I travel in) in the “device-less” or environmental potential of new AR technologies. Not everyone will have a fancy smartphone on them at all times, or want to stare at a wall-monitor while also wearing glasses or holding a cellphone in front of them in order to access other planes of information. The really exciting premise of these new approaches is the fully immersive aspect of “spatial AR,” and the promise of controlling a live 3D environment of realtime data. Continue reading →
If that title seems a bit LSD-fueled, the subject matter warrants it. Here comes some Chemistry gone wild!
First, have a look at this bizarre video. It stars a soft robot, or chemical robot – “ChemBot.” Even the experienced geeks at IEEE Spectrum are calling it “by far one of the coolest and weirdest robot prototypes we have ever seen.”
This particular prototype by iRobot and University of Chicago researchers was just unveiled, at the IEEE/RSJ International Conference on Intelligent Robots and Systems this past week. (More on the conference here.) It was built in response to DARPA’s interest in chemical robots, a program run by Dr. Mitchell Zakin.
The DARPA “ChemBots” page describes the program as creating “a convergence between materials chemistry and robotics through the application of any one of a number of approaches, including gel-solid phase transitions, electro- and magneto-rheological materials, geometric transitions, and reversible chemical and/or particle association and dissociation.”
What’s the anticipated DoD mission use? In DARPA’s words, “With ChemBots, our warfighters can gain access to denied spaces and perform tasks safely, covertly, and efficiently.” Or, as CNet’s “Crave” gadget blog puts it, “the weird little blob inflates and deflates parts of its body, changing size and shape–and scaring the living daylights out of us. We don’t know exactly when ChemBot will join the Armed Forces, but we can only beg: please, oh please, keep it away from us.” 🙂
Does Mitch Zakin Dream of Electric Sheep?
With that kind of geeky appeal, this video has been gathering some Internet buzz over the weekend, appearing on several tech blogs. But the better story is the scientist behind the science. Several of us have been following Mitch Zakin’s work for a while, primarily because he is also the PM for the Programmable Matter Program — the “novel physics” of “a new functional form of matter, based on mesoscale particles, which can reversibly assemble into complex 3D objects upon external command.”
There is revolutionary promise for such composability in multiple fields, not just defense. Zakin described it several years ago in a speech as “a concept so simple, yet so revolutionary that it pushes even the DARPA envelope. A vision that has profound implications for how we think about chemistry and materials. A vision that could provide our warfighters with meaningful technological surprise.”
Zakin is a demonstrably brilliant scientist, of the sort you expect to find at DARPA. Indeed, in that same speech (“The Next Revolution in Materials“) which he gave at DARPA’s 25th Systems and Technology Symposium a couple of years ago, Dr. Zakin said: “I joined DARPA because it is unfettered by conventional wisdom.”
One area where he has been exploring beyond traditional boundaries is in developing “the infochemistry project,” which combines the powers of chemistry and information technology. In an exotic illustration, Dr. Zakin is directing a research program on “Chemical Communications,” which I’m not sure I fully understand but which sounds like some sort of holographic persistent Twitter:
The Chemical Communications Program is exploring innovative methods to develop self-powered chemical systems that can encode an input string of alphanumeric characters (i.e., a message), convert the message to a modulated optical signal, and transmit it repetitively to a receiver.
The ultimate goal of this program is to develop a small replicator device, with the form factor of a Personal Digital Assistant (PDA) or cell phone that―
Permits the user to input an arbitrary 60-character alphanumeric message.
Translates the message into an appropriate set of modulated chemistries.
Embeds these chemistries into a disposable substrate (the transmitter).
Ejects the substrate for deployment.
The replicator device will enable warfighters to generate disposable optical transmitters in real time, each with a user-specified message. It will be compact, lightweight, and powered by batteries or solar cells. – DARPA website, Chemical Communications Program
With projects like these under his belt, Zakin is credited with reviving the chemistry discipline at DARPA, which had fallen away over the years. But now he’s scheduled to leave the agency in 2010. He is uncertain where he’s heading, but perhaps he can be persuaded to spend some time with like-minded souls in Microsoft Research; I suspect many there would find his infochemistry approach very appealing.
An interesting profile of Dr. Zakin in the journal Analytical Chemistry notes that “Academia is one option. Venture capitalism is another. Zakin has launched so many basic science research projects that have the potential of becoming commercial products that he says, ‘it’s almost a sin not to look at all that from the other side.’ ”
How do intelligence analysts handle the long-discussed problem of information overload? (The same question goes for information workers and government data of any kind.)
Here’s a quick post, about a talk I gave this week – but as an excuse to link to a much more compelling presentation given at the TED Talks recently. Yesterday I had the good fortune to deliver the “Technology Keynote” address at the annual International Field Directors and Technology Conference, in Delray Beach, Florida. The IFD&TC is a well-known group in its field – no pun – of the world’s leading academic and government researchers, conducting large-scale and longitudinal social-scientific research studies.
As an example, think of the U.S. Census – and indeed I had the opportunity to spend some time with Cheryl Landman, Chief of the U.S. Census Bureau’s Demographic Surveys Division. You know those large studies drawn from every decade’s data? She runs them. That division’s work should feature prominently (I hope) in the forthcoming U.S. government’s “Data.gov” set of services.
If I’m giving a private demo of an advanced technology or piece of software that Microsoft is cooking up, I often encounter the response, “Yeah, but we’ll probably never see this released, will we?”
Fact: Last week’s Automatica 2008, the big international robotics and automation trade-show, had “over 30,000 trade visitors from around 90 countries,” visiting 900 exhibitors’ booths, according to the conference wrap-up.
Analysis: When I spoke recently at an IARPA conference in Orlando, and was asked to give a glimpse into Microsoft’s vision of R&D trends, one of the possibly surprising areas I highlighted was robotics. We’re making a major push in that area, for reasons that might not be intuitive based on an old-fashioned impression of what Microsoft offers in the government realm. More on the intelligence community’s potential use below.
Shepherd's Pi 