Microsoft to Support Cross-Domain Sitemaps

LOS ANGELES — Microsoft, in collaboration with search competitors Google and Yahoo!, has announced an update to the Sitemaps Protocol, designed to increase usage through enhanced flexibility over where the sitemaps are hosted.

The update allows webmasters to host sitemap files on any domain, using a robots.txt file to indicate the location of the sitemap file and the domain it represents.

For example, MSN.com offers content across subdomains such as health.msn.com, travel.msn.com and moneycentral.msn.com, but is unable to host all of its sitemaps in one location, such as sitemaps.msn.com.

Until now the protocol did not support this scenario, each sitemap would have needed to be hosted directly under the domain it described," Fabrice Canel, program manager for Microsoft's Live Search Crawler, said. "This update now introduces support for this scenario, with the requirement that you simply include a reference to the sitemap in your robots.txt file."

Canel offered moneycentral.msn.com/robots.txt as an example, which could now include the following line; Sitemap: https://sitemaps.msn.com/index_moneycentral.msn.com.xml, adding that all URLs in the sitemap file must be within the same domain as the robots.txt file (e.g. moneycentral.msn.com/ in this example).

Multiple "Sitemap:" references are supported, although Microsoft recommends keeping robots.txt files under 1 MB in size and limiting individual sitemap files to under 10 MB, whether they are in XML, RSS or Text formats.

One feature that comes as a direct result of webmaster feedback is the ability to ping Live Search to notify it of updates to sitemaps.

In support of the changes to the Sitemap Protocol, Microsoft offers a Sitemap Forum for webmasters.

Related:  

Copyright © 2026 Adnet Media. All Rights Reserved. XBIZ is a trademark of Adnet Media.
Reproduction in whole or in part in any form or medium without express written permission is prohibited.

More News

AV Bulletin: Loopholes and Lawsuits

This roundup provides an update on the latest news and developments on the age verification front as it impacts the adult industry.

Utah 'Porn Tax' Bill Will Head to Governor's Desk

A bill that would tax adult websites and make them liable if minors circumvent geolocation has passed the Utah state legislature and will soon head to the office of Gov. Spencer Cox for signature or veto.

Flirt4Free Co-Founder Gregory Clayman Passes Away

Gregory Clayman, a pioneering figure in the live cam sector and cofounder of the long-running webcam platform Flirt4Free, has passed away.

Pornhub to Restrict Access in Australia as AV Rules Take Effect

Pornhub parent company Aylo will restrict access to its free video-sharing platforms in Australia in response to new age verification regulations, the company confirmed Thursday.

ASACP Announces F2F as 1st Gold Sponsor

The Association of Sites Advocating Child Protection (ASACP) has announced Friends2Follow (F2F) has upgraded its sponsorship and become the organization’s first Gold Sponsor.

House Committee Approves Online Safety Bill With Federal AV Requirement

The U.S. House of Representatives Committee on Energy and Commerce on Thursday passed the Kids Internet and Digital Safety (KIDS) Act, which includes provisions to make age verification by adult websites federal law.

Segpay Adds 'Pay by Bank (UK)' Payment Solution

Segpay has added the Pay by Bank (UK) option to its direct payments solutions.

Creator Verification Platform 'VerifiedCollab' Launches

Performer Eli Thomas has launched VerifiedCollab, a verification platform for creators and producers.

House Committee to Weigh Online Safety Bill With Federal AV Requirement

The U.S. House of Representatives Committee on Energy and Commerce will meet Thursday to consider and potentially amend the Kids Internet and Digital Safety (KIDS) Act, which includes provisions to make age verification by adult websites federal law.

Show More