Apple Unveils Plan to Scan All iPhones to Determine if Adult Content is Illegal

Apple Unveils Plan to Scan All iPhones to Determine if Adult Content is Illegal

CUPERTINO, Calif. — Apple briefed academics this week about their plans to install software in iPhones sold in the U.S. to "scan for child abuse imagery."

The initiative was reported today by The Financial Times, which reported that Apple’s plans are “raising alarm among security researchers who warn that it could open the door to surveillance of millions of people’s personal devices.”

Apple’s proposed system, neuralMatch, would “proactively alert a team of human reviewers if it believes illegal imagery is detected, who would then contact law enforcement if the material can be verified.”

The Financial Times confirmed that “the scheme will initially roll out only in the U.S.”

Security researchers told the publication that while they may be “supportive of efforts to combat child abuse,” they are nevertheless “concerned that Apple risks enabling governments around the world to seek access to their citizens’ personal data, potentially far beyond its original intent.”

'An Absolutely Appalling Idea'

Ross Anderson, professor of security engineering at the University of Cambridge, called neuralMatch “an absolutely appalling idea, because it is going to lead to distributed bulk surveillance of  […] our phones and laptops.”

Researchers point out that “although the system is currently trained to spot child sex abuse, it could be adapted to scan for any other targeted imagery and text, for instance, terror beheadings or anti-government signs at protests, say researchers. Apple’s precedent could also increase pressure on other tech companies to use similar techniques.”

Matthew Green, a security professor at Johns Hopkins University, warned about the expansive implications of such a technology.

“This will break the dam — governments will demand it from everyone,” Green noted.

The Financial Times described the intrusive nature of the new technology: “Apple’s neuralMatch algorithm will continuously scan photos that are stored on a U.S. user’s iPhone and have also been uploaded to its iCloud back-up system. Users’ photos, converted into a string of numbers through a process known as ‘hashing,’ will be compared with those on a database of known images of child sexual abuse.”

How the Algorithm Was Trained

Whether this private system assesses an image on a user’s computer to be legal or illegal will be based on how Apple has set up the algorithm. In this case, as reported, the system “has been trained on 200,000 sex abuse images collected by the U.S. non-profit National Center for Missing and Exploited Children.”

“According to people briefed on the plans, every photo uploaded to iCloud in the U.S. will be given a ‘safety voucher’ saying whether it is suspect or not,” the report added. “Once a certain number of photos are marked as suspect, Apple will enable all the suspect photos to be decrypted and, if apparently illegal, passed on to the relevant authorities.”

The report does not specify what safeguards would be in place in case of a mistake or "false positive," when the algorithm identifies a piece of legal content as CSAM and law enforcement is compelled to act — or who would be liable for a life-and-reputation-destroying misidentification.

Related:  

Copyright © 2024 Adnet Media. All Rights Reserved. XBIZ is a trademark of Adnet Media.
Reproduction in whole or in part in any form or medium without express written permission is prohibited.

More News

Aylo Asks Judge to Trim Sweeping GDP-Related Lawsuit

Aylo asked a California federal judge during a hearing on Monday to drop trafficking claims in a sweeping lawsuit brought by a former GirlsDoPorn model.

California Republicans, Democrats Team Up to Advance Age Verification for Porn

Both Republicans and Democrats in the California Assembly’s Privacy and Consumer Protection Committee voted last week to move forward a version of the age verification bills being sponsored around the country by anti-porn religious conservative activists.

Cosplayground Releases 'Furiosa XXX: A Porn Parody'

Cosplayground has released its seventh original production, “Furiosa XXX: A Porn Parody.”

Washington Post Spotlights ECP VP Solomon Friedman's Appearance at XBIZ LA

The Washington Post published this weekend a lengthy feature about Pornhub and Aylo, focusing on Ethical Capital Partners’ VP of Compliance Solomon Friedman’s keynote address and other appearances at XBIZ Los Angeles in January.

'Sex Workers Deserve Protections': Congressional Candidate Joe Cohn Reaches Out to Adult Community

Veteran civil rights attorney Joe Cohn, who is currently running in a New Jersey Democratic primary for a seat in the U.S. House of Representatives, says he is reaching out to the adult community to champion an inclusive approach to civil liberties that encompasses all sex workers and adult businesses.

Mile High Unveils New Unscripted Studio 'Sex on Sight'

Mile High Media has launched a new unscripted-content studio, Sex on Sight.

Belgian Producer Dennis Black Magic Sentenced to 7 Years for Rape, CSAM

Belgian adult producer and director Dennis Black Magic has been sentenced to seven years in prison and a $4,000 fine for the rape of eight models and distribution of CSAM.

Seoul Authorities Force Cancellation of Adult Expo for 'Distorting Perceptions of Sex'

After Seoul authorities repeatedly prevented 2024 KXF The Fashion from finding a suitable venue, event organizers have canceled the popular Korean adult industry expo, which was scheduled for this week.

FSC to Hold Discussion on Adult Industry Rights With Congressional Candidate Joe Cohn

Free Speech Coalition will hold a virtual discussion with congressional candidate Joe Cohn, whom the organization calls a strong advocate for adult industry rights.

Sophie Dee, Ricky Johnson to Deliver 'XBIZ Talks' at Miami Conference

XBIZ is pleased to announce that Sophie Dee and Ricky Johnson will each deliver an “XBIZ Talk” at next month’s XBIZ Miami conference

Show More