Meta Admits to Flagging Images as Deepfakes Based on 'Media Reports'

Meta Admits to Flagging Images as Deepfakes Based on 'Media Reports'

MENLO PARK, Calif. — Meta has told its Oversight Board that the company relies on “media reports” when designating images as nonconsensual sexual content or deepfakes and adding them to its permanent database of banned content.

The disclosure came in a statement issued this week by Meta’s Oversight Board criticizing Meta for its inconsistent handling of deepfakes, which constitute one of several categories of images — some legal and some illegal — that Meta flags as violating its platforms’ terms of service.

Responding to questions about two specific cases of deepfakes, one involving an Indian public figure and another an American public figure, Meta acknowledged the practice of testing explicit images using a Media Matching Service (MMS) bank.

MMS banks “automatically find and remove images that have already been identified by human reviewers as breaking Meta’s rules,” the board explained.

When the board noted that the image resembling an Indian public figure “was not added to an MMS bank by Meta until the Board asked why,” Meta responded by saying that it “relied on media reports to add the image resembling the American public figure to the bank, but there were no such media signals in the first case.”

According to the board, this is worrying because “many victims of deepfake intimate images are not in the public eye and are forced to either accept the spread of their non-consensual depictions or search for and report every instance. One of the existing signals of lack of consent under the Adult Sexual Exploitation policy is media reports of leaks of non-consensual intimate images. This can be useful when posts involve public figures but is not helpful for private individuals. Therefore, Meta should not be over-reliant on this signal.”

The board also suggested that “context” should be considered as a potential signal that nude or sexualized content may be AI-generated or manipulated and therefore nonconsensual, citing hashtags and where content is posted as examples of such context.

Meta has been repeatedly challenged by sex workers, adult performers and many others to shed light on its widespread shadow-banning policies and practices, but access to the specifics of those processes has been scant. Meta’s answer to its own Oversight Board is a rare instance of lifting the veil of secrecy about its arbitrary and often-confusing moderation practices.

As XBIZ reported, the Oversight Board has previously criticized Meta for its policies regarding content it considers sexual, although its recommendations do not appear to have had a meaningful impact on the company's still-opaque moderation practices.

The Oversight Board made nonbinding recommendations that Meta should clarify its Adult Sexual Exploitation Community Standard policy by using clearer language in its prohibition on nonconsensual manipulated media, and generally “harmonize its policies on non-consensual content by adding a new signal for lack of consent in the Adult Sexual Exploitation policy: context that content is AI-generated or manipulated.”

The board also recommended that AI-generated or -manipulated nonconsensual sexual content should not need to be “non-commercial or produced in a private setting” to be in violation of Meta’s terms of service.

Copyright © 2025 Adnet Media. All Rights Reserved. XBIZ is a trademark of Adnet Media.
Reproduction in whole or in part in any form or medium without express written permission is prohibited.

More News

Canadian Senator Revives Push for National AV Law

Sen. Julie Miville-Dechêne, whose previous multiple attempts to legislate national age verification requirements all failed, has introduced a new bill that would impose fines of up to $500,000 on adult sites that do not implement age verification for Canadian viewers.

FSC Submits Statement to House Committee in Support of FIRM Act

Free Speech Coalition has announced that it submitted a statement to the House Financial Services Committee in support of the Financial Integrity and Regulation Management (FIRM) Act.The announcement follows:

Plaiir Joins Pineapple Support as Supporter-Level Sponsor

Plaiir has joined the ranks of over 70 adult businesses and organizations committing funds and resources to Pineapple Support.

Trump Tariffs Remain in Effect Pending Appeal of Trade Court Ruling

The U.S. Court of Appeals for the Federal Circuit on Thursday stayed an injunction by the U.S. Court of International Trade, delaying the trade court’s order blocking the Trump administration’s sweeping tariffs, which have significantly impacted the pleasure industry.

FSC Issues Guidance on Kansas Age Verification Suits

The Free Speech Coalition (FSC) has published an advisory article for adult websites operating in Kansas, following several private lawsuits filed under the state's age verification law.

Reese Rideout Relaunches Site Through YourPaysitePartner

Newly crowned XMA Creator Awards Male Clip Artist of the Year Reese Rideout has relaunched his website DrRideout.com through YourPaysitePartner (YPP).

Pineapple Support, SextPanther to Host 'Holistic PTSD' Support Group

Pineapple Support and SextPanther are hosting a free online support group for performers suffering from PTSD.

Fanblast Taps Nicholas H. for VP of Sales

Nicholas H. has joined Fanblast as its new vice president of sales.

Aylo, Old Pros Launch 'Sex Work and Human Trafficking' Online Panel Series

Aylo has teamed up with sex worker support organization Old Pros to launch “Sex Work and Human Trafficking,” an online community panel series aimed at educating performers and creators on preventing trafficking and exploitation, which takes place at 6 p.m. (EDT) on Thursday, May 29.

EU Investigating 4 Adult Sites for 'Suspected Breaches' of DSA

The European Commission has initiated formal proceedings against Pornhub, Stripchat, XNXX and XVideos for “suspected breaches” of the Digital Services Act (DSA), the Commission announced in a statement Monday.

Show More