Hello,

We noticed you're browsing in private or incognito mode.

To continue reading this article, please exit incognito mode or log in.

Not an Insider? Subscribe now for unlimited access to online articles.

Rana el Kaliouby

A View from Rana el Kaliouby

We Need Computers with Empathy

An emerging trend in artificial intelligence is to get computers to detect how we’re feeling and respond accordingly. They might even help us develop more compassion for one another.

  • October 20, 2017

I was rehearsing a speech for an AI conference recently when I happened to mention Amazon Alexa. At which point Alexa woke up and announced: “Playing Selena Gomez.” I had to yell “Alexa, stop!” a few times before she even heard me.

But Alexa was oblivious to my annoyance. Like the majority of virtual assistants and other technology out there, she’s clueless about what we’re feeling.

We’re now surrounded by hyper-connected smart devices that are autonomous, conversational, and relational, but they’re completely devoid of any ability to tell how annoyed or happy or depressed we are. And that’s a problem.

This story is part of our November/December 2017 Issue
See the rest of the issue
Subscribe

What if, instead, these technologies—smart speakers, autonomous vehicles, television sets, connected refrigerators, mobile phones—were aware of your emotions? What if they sensed nonverbal behavior in real time? Your car might notice that you look tired and offer to take the wheel. Your fridge might work with you on a healthier diet. Your wearable fitness tracker and TV might team up to get you off the couch. Your bathroom mirror could sense that you’re stressed and adjust the lighting while turning on the right mood-enhancing music. Mood-aware technologies would make personalized recommendations and encourage people to do things differently, better, or faster.

Today, an emerging category of AI—artificial emotional intelligence, or emotion AI—is focused on developing algorithms that can identify not only basic human emotions such as happiness, sadness, and anger but also more complex cognitive states such as fatigue, attention, interest, confusion, distraction, and more.

My company, Affectiva, is among those working to build such systems. We’ve compiled a vast corpus of data consisting of six million face videos collected in 87 countries, allowing an AI engine to be tuned for real expressions of emotion in the wild and to account for cultural differences in emotional expression.

Using computer vision, speech analysis, and deep learning, we classify facial and vocal expressions of emotion. Quite a few open challenges remain—how do you train such multi-modal systems? And how do you collect data for less frequent emotions, like pride or inspiration?

David Biskup

Nonetheless, the field is progressing so fast that I expect the technologies that surround us to become emotion-aware in the next five years. They will read and respond to human cognitive and emotional states, just the way humans do. Emotion AI will be ingrained in the technologies we use every day, running in the background, making our tech interactions more personalized, relevant, authentic, and interactive. It’s hard to remember now what it was like before we had touch interfaces and speech recognition. Eventually we’ll feel the same way about our emotion-aware devices.

Here are a few of the applications I’m most excited about.

Automotive: An occupant-aware vehicle could monitor the driver for fatigue, distraction, and frustration. Beyond safety, your car might personalize the in-cab experience, changing the music or ergonomic settings according to who’s in the car.

Education: In online learning environments, it is often hard to tell whether a student is struggling. By the time test scores are lagging, it’s often too late—the student has already quit. But what if intelligent learning systems could provide a personalized learning experience? These systems would offer a different explanation when the student is frustrated, slow down in times of confusion, or just tell a joke when it’s time to have some fun.

Health care: Just as we can track our fitness and physical health, we could track our mental state, sending alerts to a doctor if we chose to share this data. Researchers are looking into emotion AI for the early diagnosis of disorders such as Parkinson’s and coronary artery disease, as well as suicide prevention and autism support.

Communication: There’s a lot of evidence that we already treat our devices, especially conversational interfaces, the way we treat each other. People name their social robots, they confide in Siri that they were physically abused, and they ask a chatbot for moral support as they head out for chemotherapy. And that’s before we’ve even added empathy. On the other hand, we know that younger generations are losing some ability to empathize because they grow up with digital interfaces in which emotion, the main dimension of what makes us human, is missing. So emotion AI just might bring us closer together. 

Sign up for The Download
What's important in technology and innovation, delivered to you every day.
Manage your newsletter preferences

As with any novel technology, there is potential for both good and abuse. It’s hard to get more personal than data about your emotions. People should have to opt in for any kind of data sharing, and they should know what the data is being used for. We’ll also need to figure out if certain applications cross moral lines. We’ll have to figure out the rules around privacy and ethics. We’ll have to work to avoid building bias into these applications. But I’m a strong believer that the potential for good far outweighs the bad.

Rana el Kaliouby is the CEO and cofounder of Affectiva. In 2012 she was named one of MIT Technology Review’s 35 Innovators Under 35.

Hear more about AI from the experts at the EmTech Digital Conference, March 26-27, 2018 in San Francisco.

Learn more and register

Uh oh–you've read all of your free articles for this month.

Insider Premium
$179.95/yr US PRICE

More from Intelligent Machines

Artificial intelligence and robots are transforming how we work and live.

Want more award-winning journalism? Subscribe and become an Insider.
  • Insider Plus {! insider.prices.plus !}* Best Value

    {! insider.display.menuOptionsLabel !}

    Everything included in Insider Basic, plus the digital magazine, extensive archive, ad-free web experience, and discounts to partner offerings and MIT Technology Review events.

    See details+

    What's Included

    Unlimited 24/7 access to MIT Technology Review’s website

    The Download: our daily newsletter of what's important in technology and innovation

    Bimonthly print magazine (6 issues per year)

    Bimonthly digital/PDF edition

    Access to the magazine PDF archive—thousands of articles going back to 1899 at your fingertips

    Special interest publications

    Discount to MIT Technology Review events

    Special discounts to select partner offerings

    Ad-free web experience

  • Insider Basic {! insider.prices.basic !}*

    {! insider.display.menuOptionsLabel !}

    Six issues of our award winning print magazine, unlimited online access plus The Download with the top tech stories delivered daily to your inbox.

    See details+

    What's Included

    Unlimited 24/7 access to MIT Technology Review’s website

    The Download: our daily newsletter of what's important in technology and innovation

    Bimonthly print magazine (6 issues per year)

  • Insider Online Only {! insider.prices.online !}*

    {! insider.display.menuOptionsLabel !}

    Unlimited online access including articles and video, plus The Download with the top tech stories delivered daily to your inbox.

    See details+

    What's Included

    Unlimited 24/7 access to MIT Technology Review’s website

    The Download: our daily newsletter of what's important in technology and innovation

/
You've read all of your free articles this month. This is your last free article this month. You've read of free articles this month. or  for unlimited online access.