News

Facebook trains AI on hateful memes

May 13, 2020 02:32 AM


Facebook unveiled an initiative Tuesday to take on "hateful memes" by using artificial intelligence, backed by crowd sourcing, to identify maliciously motivated posts.

The leading social network said it had already created a database of 10,000 memes -- images often blended with text to deliver a specific message -- as part of a ramped-up effort against hate speech.

Facebook said it was releasing the database to researchers as part of a "hateful memes challenge" to develop improved algorithms to detect hate-driven visual messages, with a prize pool of $100,000.

"These efforts will spur the broader AI research community to test new methods, compare their work, and benchmark their results in order to accelerate work on detecting multimodal hate speech," Facebook said in a blog post. 

Facebook's effort comes as it leans more heavily on AI to filter out objectionable content during the coronavirus pandemic that has sidelined most of its human moderators.

Its quarterly transparency report said Facebook removed some 9.6 million posts for violating "hate speech" policies in the first three months of this year, including 4.7 million pieces of content "connected to organized hate."

Facebook said AI has become better tuned at filtering as the social network turns more to machines as a result of the lockdowns.

Guy Rosen, Facebook vice president for integrity, said that with AI, "we are able to find more content and can now detect almost 90 percent of the content we remove before anyone reports it to us."

Facebook said it made a commitment to "disrupt" organized hateful conduct a year ago following the deadly mosque attacks in New Zealand which prompted a "call to action" by governments to curb the spread of online extremism.

Automated systems and artificial intelligence can be useful, Facebook said, for detecting extremist content in various languages and analyzing text embedded in images and videos to understand its full context.

Mike Schroepfer, Facebook's chief technology officer, told journalists on a conference call that one of the techniques helping this effort was a system to identify "near identical" images, to address the reposting of malicious images and videos with minor changes to evade detection.

"This technology can detect near perfect matches," Schroepfer said.

Heather Woods, a Kansas State University professor who studies memes and extremist content, welcomed Facebook's initiative and inclusion of outside researchers.

"Memes are notoriously complex, not only because they are multimodal, incorporating both image and text, as Facebook notes, but because they are contextual," Woods said.

"I imagine memes' nuance and contextual specificity will remain a challenge for Facebook and other platforms looking to weed out hate speech."

https://www.youtube.com/watch?v=pOavNaBX4NU


Most Read

  1. Yet another burden on people: Govt hikes oil prices Yet another burden on people: Govt hikes oil prices
  2. Adil Raja loses pleas to dismiss Naseer’s defamation suits Adil Raja loses pleas to dismiss Naseer’s defamation suits
  3. Nadeem Mahboob named federal health secretary Nadeem Mahboob named federal health secretary
  4. Amir Tanba, linked to Indian spy Sarabjit Singh's jail killing, killed in Lahore Amir Tanba, linked to Indian spy Sarabjit Singh's jail killing, killed in Lahore
  5. Team formed to probe woman’s death after tortured by cop on train Team formed to probe woman’s death after tortured by cop on train
  6. Public reacts to Bohemia's music video ‘Salsa’ starring Sistrology Public reacts to Bohemia's music video ‘Salsa’ starring Sistrology

Opinion

  1. Insights into the Pakistan Stock Exchange's Recent Record High Triumph
    Insights into the Pakistan Stock Exchange's Recent Record High Triumph

    By Zulfiqar Ali Mir

  2. IMEC to sabotage CPEC
    IMEC to sabotage CPEC

    By Dr Asif Channer

  3. 1947 TO FORM 47
    1947 TO FORM 47

    By Dr Asif Channer

  4. Beijing wants to further highlight industrial sector in its country and take scientific innovation to new heights....
    Beijing wants to further highlight industrial sector in its country and take scientific innovation to new heights....

    By Ali Ramay

  5. Global race: China will reduce its unnecessary expenses
    Global race: China will reduce its unnecessary expenses

    By Ali Ramay

  6. Channer Pir: The Great Saint of Cholistan
    Channer Pir: The Great Saint of Cholistan

    By Dr Asif Channer