Skip to Content

Yibiao Zhao Is Giving Machines a Sense of Imagination

A new approach to AI will help make autonomous vehicles safer and let robots learn how to use tools as a human might.
November 7, 2017
Justin Saglio

Self-driving cars have come a long way, but they still struggle to deal with unexpected situations. Yibiao Zhao wants to change that.

At MIT Technology Review’s EmTech conference on Tuesday, Zhao, the cofounder of iSee, an MIT spin-off, highlighted the limitations of existing machine-learning approaches for self-driving cars—which are based on pattern recognition—and outlined his work on a new set of algorithms that seek to mimic humans’ instinctive understanding of the physical world. (See also our previous coverage of Zhao’s work: “Finally, a Driverless Car with Some Common Sense.”)

“When we see something for just a few seconds as we’re driving, we can quickly deduce the intention of the driver in front of us,” said Zhao. “We want cars to have this same predictive capability.” 

To give it to them, Zhao and his colleagues have drawn on some of their earlier research inspired by cognitive science. That included teaching a robot how to crack a nut using a hammer, and then taking the hammer away and getting the robot to select the next most appropriate tool from a random assortment.

“The aim was to give the robot the same deep understanding of the properties of tools as a human,” said Zhao.

His work could lead to advances in fields beyond autonomous cars. Zhao has also been involved in a government project (sponsored by the Defense Advanced Research Projects Agency) to develop robots that can intuitively understand the intentions of soldiers they’re paired with on the battlefield.

Keep Reading

Most Popular

Large language models can do jaw-dropping things. But nobody knows exactly why.

And that's a problem. Figuring it out is one of the biggest scientific puzzles of our time and a crucial step towards controlling more powerful future models.

OpenAI teases an amazing new generative video model called Sora

The firm is sharing Sora with a small group of safety testers but the rest of us will have to wait to learn more.

Google’s Gemini is now in everything. Here’s how you can try it out.

Gmail, Docs, and more will now come with Gemini baked in. But Europeans will have to wait before they can download the app.

This baby with a head camera helped teach an AI how kids learn language

A neural network trained on the experiences of a single young child managed to learn one of the core components of language: how to match words to the objects they represent.

Stay connected

Illustration by Rose Wong

Get the latest updates from
MIT Technology Review

Discover special offers, top stories, upcoming events, and more.

Thank you for submitting your email!

Explore more newsletters

It looks like something went wrong.

We’re having trouble saving your preferences. Try refreshing this page and updating them one more time. If you continue to get this message, reach out to us at customer-service@technologyreview.com with a list of newsletters you’d like to receive.