How I Use Tech and Media during the Pandemic

My friend and longtime colleague (back to ancient days in a leading intelligence agency) Bob Gourley now leads CTOvision and a consulting firm OODA LLC, and is widely known as a leading global voice on tech trends. He recently launched a video/podcast series “OODAcast” to fill our days and nights with commentary on “Hot Topics in Enterprise IT and Business Risk,” and I was flattered to be asked to participate.

Here’s the video of Part I of our conversation (there’s a second half forthcoming). But if you don’t want to suffer through a half-hour of me bloviating, below I have provided a few excerpts and annotations on topics I mention, so you can skim below instead 🙂

 

4:20 – We begin with the role of technology in government and public policy, including today’s COVID-19 crisis and back in the early atomic era (referencing Einstein and Oppenheimer)

From 6:20 – Discussion of how to deal with information overload amid the COVID-19. I discuss maximizing “the positive side” of easy access to enormous data via the Internet: “there continue to be what fully existed before the Internet era, and that is a wealth of trusted, branded, curated sources of edited news. I have a lot of respect for the role of editor… the smartest person on campus was the editor of that paper, and he corrected a lot of mistakes that I made.” That editor of The Cavalier Daily at the University of Virginia whom I refer to was Woody Holton, who predictably went on to become a highly regarded historian and writer.

At 9:00 – I mention being the sole home-delivery subscriber to the print-edition New York Times in my rural Essex County, Virginia, along with contrasts of online news sources and social media sources. (I should mention here that working from home for me has always been easy, in part because my company VMware has been enabling virtual remote-work long before the pandemic.)

10:45 – I discuss the comparison of two versions, online and print, of a NY Times information visualization of the origins and spread of the novel coronavirus in 2019-2020. The online version is here, while below are some clips of the print version, on the front page and across two interior double-page-spreads:

13:40 – I refer to the Stanford Institute for Human-Centered Artificial Intelligence (HAI), and its “COVID-19 and AI, A Virtual Conference,” which is described and video-archived here.  I’ll also recommend from ACM, the world’s largest educational and scientific computing society, its new comprehensive guide “to conference organizers suddenly facing the need to move their conference online in light of the social distancing recommendations and global restrictions on travel.”

15:40 – I describe my use of curated Twitter Lists. At Bob’s urging, I have opened up several of my curated “private” lists (see below for links to follow them, but I’ve kept my best and most exotic Lists locked for now):

• AI People (142 accounts)
• US Politics/Government (245 accounts)
• UK Politics/Government (75 accounts)
• Top R&D Orgs (23 accounts)
• SCOTUS, US Supreme Court news (41 accounts)
• China Topics (87 accounts)
• Russia Topics (52 accounts)

18:35 – Discussion of using LinkedIn for “authentication and validation of who’s posting what you’re looking at… you wind up becoming as nimble as an HR professional at assessing the credibility of people based on their track record, background and online resume… Especially in this period where everybody’s working remotely I notice that the volume of posting on LinkedIn has really grown.”

Your comments on the discussion are welcome below, and stay tuned for Part II….

 

 

 

Coming to DC, One-Day Delivery from Jeff Bezos

If you read this blog you care about government and technology. And whether you’re a technologist or not, you can see the tech forces shaping and sharpening the uses of digital capabilities in accomplishing the ends of government, whether that’s citizen-service delivery and local law enforcement, or global diplomacy and nation-state combat. I’ve worked on and written about them all – from intelligence to space to AI, or the quantification of Supreme Court humor, even “Punk Rock and Moore’s Law.”

Understanding and forecasting that radical pace of external change is difficult for government professionals, and they need help doing that. Let’s say you wanted to tap someone to offer insight. Who’d be on your dream list? At the top of my dream list – my absolute “if-only-I-could-ask” list – would be Jeff Bezos, founder of Amazon and Blue Origin.

So I’m going to sit down with Jeff Bezos on stage later this month, at the annual AFCEA Intelligence Symposium, for a conversation about areas where technology critically intersects with the nation’s response to enduring challenges and opportunities, such as artificial intelligence, digital innovation, the revolution in cloud computing, and commercial space operations. (I serve as national Vice Chairman of the Intelligence Committee at AFCEA, the 35,000-member Armed Forces Communications & Electronics Association.)

The 2017 Symposium features, as usual, a stellar line-up of top leaders in national security, with panels on Advanced Conventional Threats, the Contested Environment of Space, Terrorism, Cyber Threats from Nation-States and Non-State Entities, and Gray-Zone Conflicts/Hybrid Warfare (topic of last year’s Defense Science Board study on which I sat). All sessions feature senior thought-leaders from government and industry.

Jeff Bezos might be new in that particular mix, but you can understand why we invited him. He has been TIME Magazine’s Person of the Year (early in his career in 1999), Fortune Magazine’s Businessperson of the Year, topped the Forbes annual list of “World’s Greatest Leaders,” and our rationale for this conversation is his long track record of revolutionary contributions to international technological/economic advance, as well as to US national security. AWS is now of central importance to the public sector (including intelligence), and the broader contributions of Amazon and Blue Origin to the nation’s economic future and success are incalculable.

 

If you have a Top Secret/SI/TK clearance, you can attend the Symposium – register. [Update: sorry, 2017 Symposium = sold out]

There’s a longstanding meme that government should be “run like a business.” I typically don’t think in precisely those terms, having been on both sides and recognizing the significant differences in intent and stakeholders.

Panel on Defense Innovation and DIUx

I’ve been more interested in helping each sector understand the unique contributions of the other, and the complexities inherent in their relationship. (See for example my recent post on DoD Innovation and DIUx in Silicon Valley.)

But the “run government like a business” impetus is understandable here in the United States as a reflection of dissatisfaction with government performance in meeting its own goals, and the expectations of the citizens it serves. President Trump recently assigned Jared Kushner to lead a new White House Office of American Innovation, and Kushner told the Washington Post “We should have excellence in government. The government should be run like a great American company.” The Washington Post (coincidentally owned by, yes, Jeff Bezos) ran a piece exploring the history of that thinking, dating its surge in popularity to the early 1980s under President Reagan – a timeline borne out by running the phrase through Google’s Ngram Viewer (see chart).

The last time I invited a smart young billionaire to come speak to Intelligence Community leaders, it worked out pretty well for the audience (see “Burning Man and AI: What Elon Musk told me and the role of Art“). So I’m aiming even higher this year…

If you don’t have a Top Secret clearance, you can’t get into the Symposium, and won’t be able to hear Bezos firsthand on April 27. But here’s a substitute, nearly as good: this week Bezos published his annual Letter to Shareholders of Amazon. Most people in the business world know about his legendary 1997 “first annual letter to shareholders” in which he laid out an extraordinary long-term vision for his company. The 2017 version is also extraordinary, and I urge you to read it in full. My friend Jeff Jonas, former IBM Chief Scientist for Context Computing and now founder/Chief Scientist at Senzing, calls it “the most impressive annual letter to shareholders I’ve ever read; this line of thinking leads to greatness.”

– – – – –

For some parting eye-candy, here’s video from last week’s annual Space Symposium in Colorado Springs, where attendees got a first-hand look at the historic Blue Origin New Shepard rocket booster (first to land vertically after spaceflight, first to relaunch again, and now a five-time-reuse trophy), and an inside tour of the crew capsule with “the largest windows in space travel.”

 

 

Bullshit Detector Prototype Goes Live

I like writing about cool applications of technology that are so pregnant with the promise of the future, that they have to be seen to be believed, and here’s another one that’s almost ready for prime time.

The Washington Post today launched an exciting new technology prototype invoking powerful new technologies for journalism and democratic accountability in politics and government. As you can see from the screenshot (left), it runs an automated fact-checking algorithm against the streaming video of politicians or other talking heads and displays in real time a “True” or “False” label as they’re speaking.

Called “Truth Teller,” the system uses technologies from Microsoft Research and Windows Azure cloud-computing services (I have included some of the technical details below).

But first, a digression on motivation. Back in the late 1970s I was living in Europe and was very taken with punk rock. Among my favorite bands were the UK’s anarcho-punk collective Crass, and in 1980 I bought their compilation LP “Bullshit Detector,” whose title certainly appealed to me because of my equally avid interest in politics 🙂

Today, my driving interests are in the use of novel or increasingly powerful technologies for the public good, by government agencies or in the effort to improve the performance of government functions. Because of my Jeffersonian tendencies (I did after all take a degree in Government at Mr. Jefferson’s University of Virginia), I am even more interested in improving government accountability and popular control over the political process itself, and I’ve written or spoken often about the “Government 2.0” movement.

In an interview with GovFresh several years ago, I was asked: “What’s the killer app that will make Gov 2.0 the norm instead of the exception?”

My answer then looked to systems that might “maintain the representative aspect (the elected official, exercising his or her judgment) while incorporating real-time, structured, unfiltered but managed visualizations of popular opinion and advice… I’m also a big proponent of semantic computing – called Web 3.0 by some – and that should lead the worlds of crowdsourcing, prediction markets, and open government data movements to unfold in dramatic, previously unexpected ways. We’re working on cool stuff like that.”

The Truth Teller prototype is an attempt to construct a rudimentary automated Political Bullshit Detector, and addresses each of those factors I mentioned in GovFresh – recognizing the importance of political leadership and its public communication, incorporating iterative aspects of public opinion and crowd wisdom, all while imbuing automated systems with semantic sense-making technology to operate at the speed of today’s real world.

Real-time politics? Real-time truth detection.  Or at least that’s the goal; this is just a budding prototype, built in three months.

Cory Haik, who is the Post’s Executive Producer for Digital News, says it “aims to fact-check speeches in as close to real time as possible” in speeches, TV ads, or interviews. Here’s how it works:

The Truth Teller prototype was built and runs with a combination of several technologies — some new, some very familiar. We’ve combined video and audio extraction with a speech-to-text technology to search a database of facts and fact checks. We are effectively taking in video, converting the audio to text (the rough transcript below the video), matching that text to our database, and then displaying, in real time, what’s true and what’s false.

We are transcribing videos using Microsoft Audio Video indexing service (MAVIS) technology. MAVIS is a Windows Azure application which uses State of the Art of Deep Neural Net (DNN) based speech recognition technology to convert audio signals into words. Using this service, we are extracting audio from videos and saving the information in our Lucene search index as a transcript. We are then looking for the facts in the transcription. Finding distinct phrases to match is difficult. That’s why we are focusing on patterns instead.

We are using approximate string matching or a fuzzy string searching algorithm. We are implementing a modified version Rabin-Karp using Levenshtein distance algorithm as our first implementation. This will be modified to recognize paraphrasing, negative connotations in the future.

What you see in the prototype is actual live fact checking — each time the video is played the fact checking starts anew.

 – Washington Post, “Debuting Truth Teller“

The prototype was built with funding from a Knight Foundation’s Prototype Fund grant, and you can read more about the motivation and future plans over on the Knight Blog, and you can read TechCrunch discussing some of the political ramifications of the prototype based on the fact-checking movement in recent campaigns.

Even better, you can actually give Truth Teller a try here, in its infancy.

What other uses could be made of semantic “truth detection” or fact-checking, in other aspects of the relationship between the government and the governed?

Could the justice system use something like Truth Teller, or will human judges and  juries always have a preeminent role in determining the veracity of testimony? Will police officers and detectives be able to use cloud-based mobile services like Truth Teller in real time during criminal investigations as they’re evaluating witness accounts? Should the Intelligence Community be running intercepts of foreign terrorist suspects’ communications through a massive look-up system like Truth Teller?

Perhaps, and time will tell how valuable – or error-prone – these systems can be. But in the next couple of years we will be developing (and be able to assess the adoption of) increasingly powerful semantic systems against big-data collections, using faster and faster cloud-based computing architectures.

In the meantime, watch for further refinements and innovation from The Washington Post’s prototyping efforts; after all, we just had a big national U.S.  election but congressional elections in 2014 and the presidential race in 2016 are just around the corner. Like my fellow citizens, I will be grateful for any help in keeping candidates accountable to something resembling “the truth.”

An Afghanistan Echo from 1986

In all the hubbub over Gen. Stanley McChrystal’s disastrous Rolling Stone profile which sparked an international furor today, I notice there hasn’t been time yet for most Beltway armchair analysts to focus on the article’s actual depiction of the state of American policy in Afghanistan.

To sum up: grim.  The quotes from McChrystal’s team reinforce the assessment – there’s little confidence on display. (Here’s the full article in pdf, it’s worth the read.)  As the RS article’s last lines put it: “There is a reason that President Obama studiously avoids using the word “victory” when he talks about Afghanistan. Winning, it would seem, is not really possible. Not even with Stanley McChrystal in charge.”

Is that an unfair assessment, too bleak? I’ve been a fairly consistent supporter of the Afghanistan war since the inception, but even I was struck that a “senior military official in Kabul” is quoted in the article saying: “There’s a possibility we could ask for another surge of U.S. forces next summer if we see success here.”  So even hypothesized success of McChrystal’s current surge would result in more troops, not less, heading for the fight – a decade in. 

Slate of the Union Day

Today is “Slate of the Union” day, when the two most charismatic individuals in recent American history go on stage and attempt to reclaim mantles as innovators. I’ll leave aside the fellow with lower poll numbers for now (President Obama). More eyes in the tech world will be watching as Steve Jobs makes his newest product announcement, the Apple tablet/Tabloid/iSlate thing iPad (it’s official).

Back in the late 1980s I worked for the legendary “Mayor of Silicon Valley” Tom McEnery (he was actually the mayor of San Jose), and we did many joint projects with Apple, particularly with CEO John Sculley, a great guy.

How the Crowd Reads Crowd-Sourced News

It turns out that we have lessons to learn from Uganda – more specifically, from web coverage of events in Uganda this week.

I’m constantly trying to improve my own ability to follow real-time world events, whether through social media, advanced search technologies, or aggregation of multiple old/new information technologies. About this time last year, as the Georgian-Russian skirmishes were just kicking off, I wrote about keeping up with information on international events (“Using Web 2.0 to Track a Political Crisis“).

In the intervening year, development of real-time tools and techniques has really blossomed. This past week, the onset of violent political unrest in Uganda has served as yet another crucible in which new techniques and web-based technologies can be tested and tweaked.

Webcast interview from the Government 2.0 Summit

I’ve been attending the Government 2.0 Summit in Washington this week, along with a lot of friends and colleagues from various spots in Silicon Valley, the international tech world, and federal, state, or local government agencies. If you want to follow along on Twitter, there’s a great number of attendees posting real-time notes and comments throughout the sessions.

Over the past couple of months I’ve participated with many colleagues planning the kick-off Gov 2.0 Expo Showcase, which highlighted fantastic new-technology projects from government agencies across the country. One of the great projects showcased is www.NeighborsforNeighbors.org, a collaborative website of rich services run by Joseph Porcelli (on Twitter he’s @josephporcelli). Among the other services on the site is a webcast series of great interviewst all levels, from across the country. , and this afternoon I sat down for a chat.

You can watch it below, on their site, or over on the archived kyte.tv site  – lots of laughs as we talk about my varied experiences in government, and why Microsoft is focusing intently on enabling enterprise Government 2.0 capabilities.  Fun stuff!

[kyte.tv appKey=MarbachViewerEmbedded&uri=channels/202174/553690&tbid=k_168&p=p/s&height=436&width=416]

Email this post to a friend

Social Media goes hyper local for emergencies

For the past year, whenever my group has had government visitors to Microsoft labs in Redmond to see advanced technologies, we’ve considered whether or not to show them a demo of a particular “secret project” being developed, now called Microsoft Vine.

If the group was with local or state government, or related to homeland security, or emergency responders and the like, the answer was easier, because that’s the sweet spot it’s designed for.

But I was always tempted to show it even to my federal government friends – and anyone else – just because it’s so impressive!

My bold decision to withdraw from consideration as Obama’s CTO

To: President-Elect Barack Obama

From: Lewis Shepherd

RE: My Imminent Selection as Chief Technology Officer for the United States

Mr. President-Elect, I am hereby reluctantly but insistently withdrawing my name from consideration as your appointment to the newly created position of Chief Technology Officer for our nation.

No, no, please don’t try to persuade me otherwise. My decision is final.

Analysis: My earlier post about John Brennan being President-elect Obama’s “imminent” selection as CIA director is now a curio, given Brennan’s decision yesterday to withdraw from consideration. 

Like any good intelligence analyst writing a balanced assessment, I had included the caveat that the only thing standing between Brennan and the appointment was the likelihood of a last-minute political squabble or contretemps.

This being Washington we’re talking about, that is precisely what happened. 

Hot Election Results Here, and Here, and Here

Political junkies are drumming their fingers mid-day this Tuesday.  They’ve likely already voted, but have no access to exit-poll results until early evening.  Mashup maps of results from sites like Twitter, essentially self-selected and self-reported exit polls like this one at SetFive, or this one mapping general Twitter election buzz, are fun but wildly inaccurate as election tracks.