X's Porn-Recognition AI Survives Illinois' Biometric Privacy Law Challenge

X's Porn-Recognition AI Survives Illinois' Biometric Privacy Law Challenge

CHICAGO — A lawsuit filed under Illinois’ unusual state law regulating biometric data collection has taken aim at an AI program used by X since 2015 to identify nudity and NSFW images.

The proposed class action suit, filed by lawyers on behalf of Chicago resident Mark Martell in 2023, alleged that X — the platform formerly known as Twitter — was in violation of the Illinois Biometric Information Privacy Act, commonly known as BIPA.

As XBIZ reported, plaintiff lawyers filing BIPA suits in Illinois have been known to target big tech companies such as Google, OnlyFans, Shutterfly and others. During one such action, Facebook agreed to pay a $650 million settlement over BIPA issues.

Martell’s complaint states that “since approximately 2015, Twitter has implemented software to police pornographic and other not-safe-for-work (‘NSFW’) images uploaded to the site. NSFW images are then ‘tagged’ by Twitter as such, preventing them from being viewed by people who do not wish to view them.”

The complaint then alleges that, in analyzing each uploaded image to determine whether “it contains nudity (or any other qualities that Twitter deems objectionable),” the platform “actively collects, captures and/or otherwise obtains; stores; and/or makes use of the biometric identifiers and biometric information of any individual included in each photo.”

On Thursday, U.S. District Court Judge Sunil R. Harjani threw out Martell’s lawsuit, but left the door open for the plaintiff to file an amended complaint by June 27.

At the core of Martell’s lawsuit is X’s usage of the third-party software PhotoDNA, developed by Microsoft. The lawsuit also mentions a 2015 article by Wired magazine that refers to an in-house AI technology developed by Twitter in 2014 after it acquired Madbits, a pioneering AI startup founded by NYU researcher Clément Farabet.

“When Farabet and his MadBits crew joined Twitter last summer, Alex Roetter — the company’s head of engineering — told them to build a system that could automatically identify NSFW images on its popular social network,” Wired reported at the time. “A year later, that AI is in place.”

Martell alleges that X’s AI scans images “without first making certain disclosures and securing written, informed permission from Illinois users posting photos” as required under Illinois’ BIPA, Law 360 reported.

Harjani ruled, however, that PhotoDNA’s creation of a “hash,” or unique digital signature, of one of Martell’s images does not amount to “a scan of his facial geometry in violation of BIPA,” the report added.

The judge defined “biometric identifier” for BIPA purposes as “a retina or iris scan, fingerprint, voiceprint, or scan of hand or face geometry,” thus excluding photos.

“While plaintiff alleged that PhotoDNA scanned the photo to create a unique hash, plaintiff did not allege facts indicating that the hash is a scan of face geometry, as opposed to merely a record of the photo,” Harjani wrote. “Plaintiff’s allegations leave open the question of whether the hash is a unique representation of the entire photo or specific to the faces of the people in the picture.”

Industry attorney Corey Silverstein of Silverstein Legal told XBIZ, “I absolutely love this decision. Judge Harjani did an incredible job analyzing a very tricky issue. BIPA has turned into a goldmine for class action plaintiffs and their attorneys, and in my opinion the abuse of these types of claims has gotten completely out of hand. I hope that this will lead prospective plaintiffs and their counsel to pause before filing baseless lawsuits.

“The plaintiff’s main contention is that making hash values of photos violates BIPA,” Silverstein explained. “The plaintiff’s argument seems to be that services using PhotoDNA must hash all photos, including images showing people’s faces in their database, to check if those photos match a hash value in the PhotoDNA database. The plaintiff seemingly argues that hashing the photo necessarily calculates the photo subjects’ face geometries. The court wasn’t buying what the plaintiff was selling, although the judge did grant leave to amend, meaning the plaintiff could amend its allegations and take another crack at its claim.”

Copyright © 2025 Adnet Media. All Rights Reserved. XBIZ is a trademark of Adnet Media.
Reproduction in whole or in part in any form or medium without express written permission is prohibited.

More News

Arcom to Expand AV Enforcement to Smaller Adult Sites

The president of French media regulator Arcom revealed on Thursday that the agency plans to escalate its enforcement of age verification rules to include smaller adult sites, starting in late 2025 or early 2026.

AEBN Publishes Report on MILF, Cougar Trends

AEBN has published a report on MILF and Cougar categories from its straight theaters.

Pornhub to Shut Down Access in Arizona Over Age Verification

Aylo will geoblock Pornhub across Arizona starting Sept. 26, when the state’s age verification law, HB 2112, goes into effect.

Flirtback Embraces Crypto With Zcash Payments

Creator platform Flirtback has launched its Zcash (ZEC) crypto payment solution.

Vixen Media Group Appoints Samuel Spencer as President, COO

Vixen Media Group (VMG) has named industry veteran Samuel Spencer as its new president and chief operating officer.

French Telecoms Mogul Ignites AV Firestorm With Free VPN, Sarcastic Tweet

French billionaire Xavier Niel, founder of telecommunications giant Iliad, sparked a heated debate this week when he appeared to admit that the company's Free Mobile wireless carrier integrated no-cost VPN into its service specifically to circumvent age verification restrictions on adult content.

UPDATED: Michigan Legislators Propose Online Porn Ban

Michigan lawmakers have introduced a bill that would make it illegal to distribute pornography via the internet in the state.

Taliban Restricts Access to Adult Content by Shutting Down Internet

The Taliban has shut down internet access across a large portion of Afghanistan in a move to prevent what it deems "immoral activities."

Go.cam Adds Video Spoofing Protection for AV

Go.cam has announced that its age verification solution now features security against video spoofing.

SexLikeReal Releases 'VR Self-Care' Guide

SexLikeReal (SLR) has published a blog post spotlighting “VR Self-Care.”

Show More