Skip to Content
Artificial intelligence

Tech companies must anticipate the looming risks as AI gets creative

Governments will need to enact stricter regulations as well, says one Microsoft AI expert.
March 25, 2019
Jeremy Portje

The technology industry must take preemptive steps to avoid emerging dangers as artificial intelligence becomes increasingly capable of being creative and otherwise acting more like human beings, Microsoft’s Harry Shum warned at MIT Technology Review’s EmTech Digital conference on Monday.

“This is the point in the cycle …  where we need to engineer responsibility into the very fabric of the technology,” said Shum, executive vice president of the software giant’s artificial intelligence and research group, onstage at the San Francisco event.

Shum noted that the industry has already failed to anticipate flaws in the technology, as well as some of the troublesome ways that it’s been used in the real world.

Face recognition software, for example, has proved to be bad at accurately identifying faces with dark skin tones. China has been pairing these tools with surveillance cameras to monitor members of its Uighur Muslim minority and to shame alleged debtors and jaywalkers by posting their faces on billboards. An Uber self-driving car struck and killed a pedestrian last year. And IBM’s Watson has reportedly prescribed “unsafe and incorrect” cancer treatments.

These challenges will only become more complicated as AI gets better at discerning human emotions, conducting sophisticated conversations, and producing stories, poetry, songs, and paintings that seem increasingly indistinguishable from those created by humans, Shum said. These emerging capabilities could make it easier to produce and spread fake audio, images, and video, adding to the challenges of dealing with propaganda and misinformation online.

Microsoft is addressing these rising risks in a handful of ways. Shum said the company has improved its face recognition tools by adding altered versions of photos with a wider variety of skin colors, eyebrows, and lighting conditions to its databases.

The company has also established an AI ethics committee and joined collaborative industry groups like the Partnership on AI. Microsoft will “one day very soon” add an AI ethics review step to its standard checklist of privacy, security, and accessibility audits that must occur before new products are released, Shum said.

But he acknowledged that self-regulation won’t be enough.

Indeed, a growing chorus of voices in and out of the technology industry are calling for tighter regulations surrounding artificial intelligence. In December, the AI Now Institute at New York University, a group that includes Microsoft and Google employees, argued that government agencies need greater power to “oversee, audit, and monitor” these technologies, and called for “stringent regulation” of face recognition tools in particular.

“We are working hard to get ahead of the challenges posed by AI creation,” Shum said. “But these are hard problems that can’t be solved with technology alone, so we really need the cooperation across academia and industry. We also need to educate consumers about where the content comes from that they are seeing and using.”

Deep Dive

Artificial intelligence

Large language models can do jaw-dropping things. But nobody knows exactly why.

And that's a problem. Figuring it out is one of the biggest scientific puzzles of our time and a crucial step towards controlling more powerful future models.

OpenAI teases an amazing new generative video model called Sora

The firm is sharing Sora with a small group of safety testers but the rest of us will have to wait to learn more.

Google’s Gemini is now in everything. Here’s how you can try it out.

Gmail, Docs, and more will now come with Gemini baked in. But Europeans will have to wait before they can download the app.

Google DeepMind’s new generative model makes Super Mario–like games from scratch

Genie learns how to control games by watching hours and hours of video. It could help train next-gen robots too.

Stay connected

Illustration by Rose Wong

Get the latest updates from
MIT Technology Review

Discover special offers, top stories, upcoming events, and more.

Thank you for submitting your email!

Explore more newsletters

It looks like something went wrong.

We’re having trouble saving your preferences. Try refreshing this page and updating them one more time. If you continue to get this message, reach out to us at customer-service@technologyreview.com with a list of newsletters you’d like to receive.