Internet Archive Sued for Copyright Infringement

SAN FRANCISCO — The Internet Archive, a nonprofit that acts as a library with snapshots of old versions of websites, is being sued by a company that says the Archive has no right to store and make available pages that have been removed by their rightful owners.

Started in 1996, the Archive uses web-crawling bot programs to make copies of publicly accessible sites. The copies are then available for research purposes via a search tool called the Wayback Machine.

The site has so far accumulated 40 billion pages, about 1 petabyte, or 1 million gigabytes, of data and is growing at a rate of 20 terabytes per month. The Archive includes millions of pages from adult websites.

At the center of the current dispute is Philadelphia-based Healthcare Advocates, a company that recently lost a trade secrets lawsuit when attorneys for the defendant produced archived copies that showed the information in question had been made publicly available on a 1999 version of the company’s site.

The pages, Healthcare Advocates claims, were protected against unauthorized indexing and viewing by use of a robots.txt file, which are supposed to tell web crawlers when certain pages are not to be stored. The company says the Archive infringed its copyrights by not doing enough to block access to the pages.

In its suit, filed in U.S. District Court in Philadelphia, Healthcare Advocates said a representative of the Archive brushed off charges of wrongdoing and said the problem was probably caused by a glitch related to the robots.txt files and, therefore, was not the Archives concern.

Danny Sullivan of Search Engine Watch said he believes the Archive representative was right, adding that, while any outcome in the case is possible, he would be surprised if a judge doesn’t dismiss it summarily.

“Robots.txt is a voluntary opt-out option. It has no legal bearing,” Sullivan said.

If the court sides with the Archive, as Sullivan predicts, the decision could have far-reaching implications for adult webmasters who rely on nonbinding opt-out provisions of robots.txt to prevent search engines from copying and distributing their intellectual property.

Apparently, doing so is not as reliable as many might think. Attorneys for the defendant in the initial Healthcare Advocates case were able to access at least 92 pages that had supposedly been protected by robots.txt files.

And once a technology such as the Archive stores a page, webmasters may not have the right to make them disappear at a later date, for example, if they are lacking 2257 records for the models on the page.

Copyright © 2025 Adnet Media. All Rights Reserved. XBIZ is a trademark of Adnet Media.
Reproduction in whole or in part in any form or medium without express written permission is prohibited.

More News

Federal Appeals Court Vacates FTC 'Click to Cancel' Rule Pending Review

The U.S. Court of Appeals for the 8th Circuit on Tuesday vacated the Federal Trade Commission’s “click-to-cancel” rule aimed at making it easier for consumers to cancel online subscriptions, pending further review.

NYC Adult Stores Lose Challenge to Zoning Law, May Face Relocation

The U.S. Court of Appeals for the 2nd Circuit on Tuesday upheld a lower court’s decision to allow enforcement of a 2001 zoning law aimed at forcing adult retail stores out of most parts of New York City.

FSC Drops Florida AV Lawsuit in Wake of SCOTUS Decision

A U.S. district court judge granted on Tuesday a motion by Free Speech Coalition to dismiss the trade association’s lawsuit over Florida’s age verification law, a case that had been on hold pending the Supreme Court’s recent ruling on the constitutionality of state AV laws.

Ukrainian President Responds to Porn Legalization Petition

President Volodymyr Zelensky responded Tuesday to an OnlyFans model’s petition to decriminalize pornography in Ukraine, stating that he would wait for the legislative process to play out “in accordance with established procedure.”

Only Tax Deductions Joins Pineapple Support as Sponsor

Adult industry accounting firm Only Tax Deductions has joined the ranks of over 70 adult businesses and organizations committing funds and resources to Pineapple Support.

Adult Empire Launches 'Conversations' Podcast Series

Adult Empire has launched a new official podcast series hosted by Nicole Chappelle and Charlie.

Sex Work CEO Launches 'Teams Plan' for AI Assistant

Sex Work CEO has introduced the new Teams Plan for its AI-powered, NSFW text generator, GPTease.

2025 XBIZ Amsterdam Website Launches With Call for Speakers

XBIZ is pleased to announce that the website for its annual European conference, XBIZ Amsterdam, is now live.

NC Governor Vetoes Bill Targeting Adult Industry, Override Possible

North Carolina Governor Josh Stein today vetoed a bill imposing new regulations that adult industry observers have warned could push adult websites and platforms to ban most adult creators and content.

25,000 Sign Petition to Legalize Pornography in Ukraine

An OnlyFans model’s petition to decriminalize pornography in Ukraine has amassed the 25,000 signatures required for official consideration by President Volodymyr Zelensky.

Show More