Skip to Content

The Cost of Trolling

December 18, 2014

In “The Troll Hunters,” Adrian Chen writes, “Old-school hate is having a sort of renaissance online, and in the countries thought to be furthest beyond it. The anonymity provided by the Internet fosters communities where people can feed on each other’s hate.”

Jason Pontin
Jason Pontin

Chen reveals the scale of näthat (“Net hate”) in Sweden, a country known for its tolerance, where anonymous posters to websites nonetheless rage against immigrants who (racists believe) are destroying “Swedish culture.” As in the United States and elsewhere in the world, Internet trolls in Sweden also persecute women, often just for the strange satisfaction of frightening them.

Trolls must be moved by bitter resentments they cannot otherwise express and liberated by the heady unaccountability of anonymity. Harassing comments found on websites are sincere expressions of how a portion of humanity really feels. Some people hate other people, and technology amplifies the expression of views that (at least since the end of World War II) were mostly whispered in private or shouted at rallies of ineffectual political movements (see “Free Speech in the Era of Its Technological Amplification”). But what can be done about trolling in open societies like Sweden and the United States is a vexed question about which citizens ardently disagree.

Both the United States and Sweden have set high bars for criminalizing speech: speech is presumptively free unless it violates the “harm principle.” In America, speech can be banned if it is a “real threat,” either because it constitutes an incitement to hurt someone or (as Justice Sandra Day O’Connor wrote in 2003) to protect people “from the fear of violence” and “from the disruption that fear engenders.” Citizens who value free speech and believe it necessary for democracy, individual expression, and a marketplace of ideas are mostly comfortable with such a limited constraint.

But others are not so comfortable (see “Q&A: Shanley Kane”). Threats are seldom prosecuted, because words are slippery things and anonymous trolls cannot be found easily. More, the harm principle is not simply extended to harassing speech that seeks to oppress or silence minorities and women. Activists would like to see a wider legal definition of harm, or broader intolerance for harassment.

Chen’s feature describes one controversial approach in Sweden, where “a group of volunteer researchers called Researchgruppen, or Research Group, has pioneered a form of activist journalism based on following the crumbs of data anonymous Internet trolls leave behind and unmasking them.” Research Group scraped the comments of a right-wing publication named Avpixlat, and matched the encrypted e-mail addresses of commenters against a database of publicly available addresses. The researchers gave the names of many of Avpixlat’s most prolific commenters to Expressen, a Swedish tabloid, which then reported that dozens of prominent Swedes, including politicians from the far-right Sweden Democrats, had posted racist and sexist comments. Some politicians and officials resigned.

Research Group’s public shaming of trolls was controversial in Sweden. MIT Technology Review readers may also feel troubled: they might want to distinguish between real threats to individuals and the expression of views that, however reprehensible, have a tenuous connection to immediate harm. But the data journalists of Research Group were responsible for an innovation: they put a cost to trolling. By stripping away the cloak of anonymity, they demonstrated that while speech is free, it is not always without consequences.

Keep Reading

Most Popular

Large language models can do jaw-dropping things. But nobody knows exactly why.

And that's a problem. Figuring it out is one of the biggest scientific puzzles of our time and a crucial step towards controlling more powerful future models.

OpenAI teases an amazing new generative video model called Sora

The firm is sharing Sora with a small group of safety testers but the rest of us will have to wait to learn more.

Google’s Gemini is now in everything. Here’s how you can try it out.

Gmail, Docs, and more will now come with Gemini baked in. But Europeans will have to wait before they can download the app.

This baby with a head camera helped teach an AI how kids learn language

A neural network trained on the experiences of a single young child managed to learn one of the core components of language: how to match words to the objects they represent.

Stay connected

Illustration by Rose Wong

Get the latest updates from
MIT Technology Review

Discover special offers, top stories, upcoming events, and more.

Thank you for submitting your email!

Explore more newsletters

It looks like something went wrong.

We’re having trouble saving your preferences. Try refreshing this page and updating them one more time. If you continue to get this message, reach out to us at customer-service@technologyreview.com with a list of newsletters you’d like to receive.