Microsoft to Support Cross-Domain Sitemaps

LOS ANGELES — Microsoft, in collaboration with search competitors Google and Yahoo!, has announced an update to the Sitemaps Protocol, designed to increase usage through enhanced flexibility over where the sitemaps are hosted.

The update allows webmasters to host sitemap files on any domain, using a robots.txt file to indicate the location of the sitemap file and the domain it represents.

For example, MSN.com offers content across subdomains such as health.msn.com, travel.msn.com and moneycentral.msn.com, but is unable to host all of its sitemaps in one location, such as sitemaps.msn.com.

Until now the protocol did not support this scenario, each sitemap would have needed to be hosted directly under the domain it described," Fabrice Canel, program manager for Microsoft's Live Search Crawler, said. "This update now introduces support for this scenario, with the requirement that you simply include a reference to the sitemap in your robots.txt file."

Canel offered moneycentral.msn.com/robots.txt as an example, which could now include the following line; Sitemap: https://sitemaps.msn.com/index_moneycentral.msn.com.xml, adding that all URLs in the sitemap file must be within the same domain as the robots.txt file (e.g. moneycentral.msn.com/ in this example).

Multiple "Sitemap:" references are supported, although Microsoft recommends keeping robots.txt files under 1 MB in size and limiting individual sitemap files to under 10 MB, whether they are in XML, RSS or Text formats.

One feature that comes as a direct result of webmaster feedback is the ability to ping Live Search to notify it of updates to sitemaps.

In support of the changes to the Sitemap Protocol, Microsoft offers a Sitemap Forum for webmasters.

Related:  

Copyright © 2026 Adnet Media. All Rights Reserved. XBIZ is a trademark of Adnet Media.
Reproduction in whole or in part in any form or medium without express written permission is prohibited.

More News

SWR Data Publishes 'Clip Trend' Report

Adult industry market research outfit SWR Data has published a report on the performance of clip platforms and sales.

Another German Court Rejects Blocking Orders Against Pornhub, YouPorn

A German court has blocked the Rhineland-Palatinate Media Authority (MA RLP) from forcing telecom providers based within the court’s jurisdiction to cut off access to Aylo-owned adult sites Pornhub and YouPorn.

Ofcom Fines Kick Online Entertainment $1 Million for AV Noncompliance

U.K. media regulator Ofcom on Thursday fined Kick Online Entertainment 800,000 pounds (more than $1 million) for failing to implement age checks as required for compliance with the Online Safety Act.

FSC Details Legislative Outlook for 2026

The Free Speech Coalition (FSC) has laid out the legislative outlook for the industry in 2026.

AEBN Publishes Popular Searches by Country for December, January

AEBN has released the list of popular searches from its straight and gay theaters, by country, for December and January.

Jim Austin Joins CrakRevenue Team

Online industry veteran and business strategist Jim Austin has been hired by CrakRevenue.

Judge Dismisses NCOSE-Backed Suits Against Adult Sites Over Kansas AV Law

A federal judge on Tuesday dismissed lawsuits brought against two adult websites in Kansas for alleged violations of the state’s age verification law.

Aylo/SWOP Panel Spotlights Creators' Struggle for Digital, Financial Rights

Aylo and Sex Workers Outreach Project (SWOP) Behind Bars presented, on Tuesday, an online panel on creators’ rights, debanking and deplatforming.

AV Bulletin: Canada, Italy, Australia Updates

Since the Supreme Court’s decision in Free Speech Coalition v. Paxton, more state age verification laws have been enacted around the United States, as well as proposed at the federal level and in other countries. This roundup provides an update on the latest news and developments on the age verification front as it impacts the adult industry.

Holly Randall Soft Launches 'Wet Ink' Magazine

Holly Randall has officially soft-launched the creator-focused publication Wet Ink Magazine.

Show More