Microsoft to Support Cross-Domain Sitemaps

LOS ANGELES — Microsoft, in collaboration with search competitors Google and Yahoo!, has announced an update to the Sitemaps Protocol, designed to increase usage through enhanced flexibility over where the sitemaps are hosted.

The update allows webmasters to host sitemap files on any domain, using a robots.txt file to indicate the location of the sitemap file and the domain it represents.

For example, MSN.com offers content across subdomains such as health.msn.com, travel.msn.com and moneycentral.msn.com, but is unable to host all of its sitemaps in one location, such as sitemaps.msn.com.

Until now the protocol did not support this scenario, each sitemap would have needed to be hosted directly under the domain it described," Fabrice Canel, program manager for Microsoft's Live Search Crawler, said. "This update now introduces support for this scenario, with the requirement that you simply include a reference to the sitemap in your robots.txt file."

Canel offered moneycentral.msn.com/robots.txt as an example, which could now include the following line; Sitemap: https://sitemaps.msn.com/index_moneycentral.msn.com.xml, adding that all URLs in the sitemap file must be within the same domain as the robots.txt file (e.g. moneycentral.msn.com/ in this example).

Multiple "Sitemap:" references are supported, although Microsoft recommends keeping robots.txt files under 1 MB in size and limiting individual sitemap files to under 10 MB, whether they are in XML, RSS or Text formats.

One feature that comes as a direct result of webmaster feedback is the ability to ping Live Search to notify it of updates to sitemaps.

In support of the changes to the Sitemap Protocol, Microsoft offers a Sitemap Forum for webmasters.

Related:  

Copyright © 2026 Adnet Media. All Rights Reserved. XBIZ is a trademark of Adnet Media.
Reproduction in whole or in part in any form or medium without express written permission is prohibited.

More News

New Kickstarter Rules Ban Fundraising for Adult Content, Products

Crowdfunding platform Kickstarter has posted new “Mature Content” rules banning projects that involve adult content and sextech.

WebGroup Czech Republic Settles Florida AV Suit, Will Pay $1.2 Million

WebGroup Czech Republic (WGCZ), the parent company of XVideos, XNXX, BangBros and GirlsGoneWild, has settled a lawsuit filed by the state of Florida over those sites’ alleged failure to age-verify Florida users before allowing access to adult content.

AEBN Publishes Popular Searches for March, April

AEBN has published the top search terms for March and April from its straight and gay theaters in all 50 states and the District of Columbia.

Ofcom Investigates Two Sites Over Possible AV Violations

U.K. media regulator Ofcom on Wednesday launched investigations into two adult sites as part of its age assurance enforcement program under the Online Safety Act (OSA).

Brazzers Launches Model Management Division 'Brazzers Creator'

Brazzers has launched its new full-service model management division, Brazzers Creator, offering content management services across multiple platforms.

FTC Promises 'Vigorous' TAKE IT DOWN Act Enforcement

The Federal Trade Commission is warning platforms that the agency will strongly enforce the notice-and-removal requirements of the TAKE IT DOWN Act, which go into effect next week on May 19.

STD Hero Joins Pineapple Support as Sponsor

Better Life Science brand STD Hero has joined the ranks of over 70 adult businesses and organizations committing funds and resources to Pineapple Support.

2026 XBIZ Miami Speaker, Open-Floor Conversation Guide Lineup Announced

XBIZ is pleased to announce the release of the full speaker lineup for XBIZ Miami, the latest edition of the adult industry’s premier summer conference, set to take place May 11-14 at the Goodtime Hotel in Miami Beach.

2026 XBIZ Miami Conference Schedule Announced

XBIZ is pleased to announce the release of the full show schedule for XBIZ Miami, set to take place May 11-14 at the Goodtime Hotel in South Beach.

UPDATED: Utah VPN Rule Enforcement Paused in Aylo Lawsuit

Provisions of a new Utah law making adult websites liable if minors in the state circumvent geolocation efforts to bypass age verification, which were set to come into force on Wednesday, have been put on hold until Sept. 3 in the case of Aylo, which filed suit in the matter.

Show More