Skip to content Skip to search

Republish This Story

* Please read before republishing *

We’re happy to make this story available to republish for free under an Attribution-NonCommercial-NoDerivatives Creative Commons license as long as you follow our republishing guidelines, which require that you credit The 19th and retain our pixel. See our full guidelines for more information.

To republish, simply copy the HTML at right, which includes our tracking pixel, all paragraph styles and hyperlinks, the author byline and credit to The 19th. Have questions? Please email [email protected].

— The Editors

Loading...

Modal Gallery

/
Sign up for our newsletter

Menu

Topics

  • Abortion
  • Politics
  • Education
  • LGBTQ+
  • Caregiving
  • Environment & Climate
  • Business & Economy
View all topics

The 19th News(letter)

News that represents you, in your inbox every weekday.

You have been subscribed!

Please complete the following CAPTCHA to be confirmed. If you have any difficulty, contact [email protected] for help.

Submitting...

Uh-oh! Something went wrong. Please email [email protected] to subscribe.

This email address might not be capable of receiving emails (according to Bouncer). You should try again with a different email address. If you have any questions, contact us at [email protected].

  • Latest Stories
  • Our Mission
  • Our Team
  • Ways to Give
  • Search
  • Contact
Donate
Home

We’re an independent, nonprofit newsroom reporting on gender, politics and policy. Read our story.

Topics

  • Abortion
  • Politics
  • Education
  • LGBTQ+
  • Caregiving
  • Environment & Climate
  • Business & Economy
View all topics

The 19th News(letter)

News that represents you, in your inbox every weekday.

You have been subscribed!

Please complete the following CAPTCHA to be confirmed. If you have any difficulty, contact [email protected] for help.

Submitting...

Uh-oh! Something went wrong. Please email [email protected] to subscribe.

This email address might not be capable of receiving emails (according to Bouncer). You should try again with a different email address. If you have any questions, contact us at [email protected].

  • Latest Stories
  • Our Mission
  • Our Team
  • Ways to Give
  • Search
  • Contact

We’re an independent, nonprofit newsroom reporting on gender, politics and policy. Read our story.

The 19th News(letter)

News that represents you, in your inbox every weekday.

You have been subscribed!

Please complete the following CAPTCHA to be confirmed. If you have any difficulty, contact [email protected] for help.

Submitting...

Uh-oh! Something went wrong. Please email [email protected] to subscribe.

This email address might not be capable of receiving emails (according to Bouncer). You should try again with a different email address. If you have any questions, contact us at [email protected].

Become a member

The 19th thanks our sponsors. Become one.

Technology

On TikTok, misogyny and white supremacy slip through ‘enforcement gap’

A new report shows how extremists use profiles, hashtags and other effects that violate the platform’s community guidelines.

A photo of a mobile phone with the TikTok app.
(Photo Ilustration by Jakub Porzycki/NurPhoto via Getty Images)

Amanda Becker

Washington Correspondent

Published

2021-08-24 11:00
11:00
August 24, 2021
am

Updated

2021-08-24 09:36:45.000000
America/Los_Angeles

Republish this story

Share

  • Bluesky
  • Facebook
  • Email

Republish this story

This article has been updated.

Violent extremists, neo-Nazis and other white supremacist groups are able to easily spread racist, misogynistic and anti-LGBTQ+ content on TikTok that runs afoul of the social media platform’s own terms of service, according to new research by the Institute for Strategic Dialogue (ISD).

The ISD report examines how extremists use profiles, hashtags, music and other effects on TikTok. Researchers identified a sample of 1,030 videos from 491 accounts, or about eight hours of content, that seemingly violated TikTok’s community guidelines. At least 312 of those videos promoted white supremacy and 246 expressed support for organizations or individuals known to be extremists or terrorists. At least 58 videos included misogynist content and 90 had anti-LGBTQ+ sentiments, ISD found. 

The 19th thanks our sponsors. Become one.

The TikTok content shows how white supremacist movements are often layered with elements of misogyny and anti-LGBTQ+ attitudes. Multiple videos in the sample were linked to the “Men Going Their Own Way” movement, which the Southern Poverty Law Center has categorized as a male supremacist group. Other videos used a white supremacist term to criticize women in mixed-race relationships. Some praised the mass shooter Elliot Rodger, who in 2014 killed six people near a California college campus and circulated a video and written manifesto saying that the attack was related to his hatred of women. 

Videos with anti-LGBTQ+ content celebrated the persecution of gay people by authoritarian regimes and the suicides of transgender people.

The 19th was given a preview of the study’s misogyny-related components ahead of the report’s release on Tuesday by ISD, a nonprofit organization of researchers and policy experts that tracks extremism online and makes recommendations to governments and businesses in the United States and overseas.

ISD researcher Ciaran O’Connor called the report a first-of-its-kind examination of how TikTok is used to spread white supremacy, neo-Nazism or other forms of hate speech. The study concludes there is an “enforcement gap” at TikTok and O’Connor hopes the findings will “start a conversation about the access or lack of access that researchers have when it comes to evaluating and examining hate at scale” on the platform.

O’Connor said that it is difficult for researchers to do large-scale searches of TikTok content so he used a “snowball methodology” — manually searching 157 keywords that led to accounts sharing far-right views, then looking at the accounts to which they were linked — to settle on the sample of 1,030 videos that seemingly violated TikTok’s community guidelines.   

Sign up for more news and context delivered to your inbox, daily

You have been subscribed!

Please complete the following CAPTCHA to be confirmed. If you have any difficulty, contact [email protected] for help.

Submitting…

Uh-oh! Something went wrong. Please email [email protected] to subscribe.

This email address might not be capable of receiving emails (according to Bouncer). You should try again with a different email address. If you have any questions, contact us at [email protected].

Preview of the daily newsletter from The 19th

TikTok’s guidelines state that the platform will remove content from terrorist or criminal organizations and individuals who “attack people based on protected characteristics” such as race, gender, gender identity or sexual orientation, and that: “We consider attacks to include actions that incite violence or hatred, dehumanize individuals or groups, or embrace a hateful ideology.” 

News investigations have nevertheless revealed that TikTok is used by Islamic State militants and to promote neo-Nazism. While the platform has started releasing transparency reports with details about the content it has removed for violating its guidelines, it is not yet part of a consortium of tech giants such as Facebook, Twitter and YouTube involved in an industry anti-terrorism effort to collaboratively track and review content from white supremacists and far-right militia groups.

A TikTok spokesperson said the platform “categorically prohibits violent extremism and hateful behavior, and our dedicated team will remove any such content as it violates our policies and undermines the creative and joyful experience people expect on our platform. We greatly value our collaboration with ISD and others whose critical research on industry-wide challenges helps strengthen how we enforce our policies.”

ISD is recommending that TikTok improve its understanding of how creators spread extremist content and develop more nuanced policies that go beyond straight hashtag bans. The report also notes that TikTok’s interface is “severely limited in the data it provides to researchers or the public,” and suggests improvements to search functionality and greater transparency on how its algorithm works. 

Republish this story

Share

  • Bluesky
  • Facebook
  • Email

Recommended for you

Photo collage of Representatives Ilhan Omar and Rashida Tlaib on their phones looking solemn.
How Instagram and TikTok hashtags highlight gendered hate toward women candidates
Image of Kamala Harris smiling, digitally altered with glitch effects that distort her features and add streaks of colorful static across the image.
Racist, misogynist online disinformation is already being used against Kamala Harris’ campaign
A demonstrator holds a pro-TikTok sign in front of the Supreme Court ahead of arguments on social media app TikTok.
Over a third of Americans are on TikTok. That could change Sunday.
Young Americans who identify with gun culture are more likely to believe in male supremacy, research shows

The 19th News(letter)

News that represents you, in your inbox every weekday.

You have been subscribed!

Please complete the following CAPTCHA to be confirmed. If you have any difficulty, contact [email protected] for help.

Submitting...

Uh-oh! Something went wrong. Please email [email protected] to subscribe.

This email address might not be capable of receiving emails (according to Bouncer). You should try again with a different email address. If you have any questions, contact us at [email protected].

Become a member

Explore more coverage from The 19th
Abortion Politics Education LGBTQ+ Caregiving
View all topics

Support representative journalism today.

Learn more about membership.

  • Transparency
    • About
    • Team
    • Contact
    • Privacy Policy
    • Community Guidelines
  • Newsroom
    • Latest Stories
    • 19th News Network
    • Podcast
    • Events
    • Careers
    • Fellowships
  • Newsletters
    • Daily
    • Weekly
    • The Amendment
    • Event Invites
  • Support
    • Ways to Give
    • Sponsorship
    • Republishing
    • Volunteer

The 19th is a reader-supported nonprofit news organization. Our stories are free to republish with these guidelines.