Microsoft to Support Cross-Domain Sitemaps

LOS ANGELES — Microsoft, in collaboration with search competitors Google and Yahoo!, has announced an update to the Sitemaps Protocol, designed to increase usage through enhanced flexibility over where the sitemaps are hosted.

The update allows webmasters to host sitemap files on any domain, using a robots.txt file to indicate the location of the sitemap file and the domain it represents.

For example, MSN.com offers content across subdomains such as health.msn.com, travel.msn.com and moneycentral.msn.com, but is unable to host all of its sitemaps in one location, such as sitemaps.msn.com.

Until now the protocol did not support this scenario, each sitemap would have needed to be hosted directly under the domain it described," Fabrice Canel, program manager for Microsoft's Live Search Crawler, said. "This update now introduces support for this scenario, with the requirement that you simply include a reference to the sitemap in your robots.txt file."

Canel offered moneycentral.msn.com/robots.txt as an example, which could now include the following line; Sitemap: https://sitemaps.msn.com/index_moneycentral.msn.com.xml, adding that all URLs in the sitemap file must be within the same domain as the robots.txt file (e.g. moneycentral.msn.com/ in this example).

Multiple "Sitemap:" references are supported, although Microsoft recommends keeping robots.txt files under 1 MB in size and limiting individual sitemap files to under 10 MB, whether they are in XML, RSS or Text formats.

One feature that comes as a direct result of webmaster feedback is the ability to ping Live Search to notify it of updates to sitemaps.

In support of the changes to the Sitemap Protocol, Microsoft offers a Sitemap Forum for webmasters.

Related:  

Copyright © 2025 Adnet Media. All Rights Reserved. XBIZ is a trademark of Adnet Media.
Reproduction in whole or in part in any form or medium without express written permission is prohibited.

More News

Taylor Nicole Launches New Site Through YourPaysitePartner

Creator Taylor Nicole has launched her new official website through YourPaysitePartner (YPP).

Adult Networking Platform SpicyGigs.com Launches

SpicyGigs, a new adult industry networking platform, has officially launched.

Pineapple Support to Host 'Cream Pie Challenge' Fundraiser

Pineapple Support is hosting its Cream Pie Challenge through August to raise funds for mental health services for industry performers.

Kyrgyzstan President Signs Measure Outlawing Internet Porn

President Sadyr Japarov of Kyrgyzstan on Tuesday signed into law legislation outlawing online adult content in the country.

NC Legislature Overrides Veto of Extreme Anti-Adult Industry Bill

The North Carolina state legislature on Tuesday voted to override Gov. Josh Stein’s veto of a bill imposing regulations that industry observers have warned could push adult websites and platforms to ban most creators and content.

Report: VPN Downloads Soar in UK Following Age Verification Deadline

Virtual private network apps, which can be used to circumvent geo-specific age verification requirements, are topping Apple App Store downloads in the U.K. in the wake of new Online Safety Act rules, the BBC is reporting.

Strike 3 Holdings Sues Meta for Pirating Vixen Media Group Content to Train AI

Vixen Media Group owner Strike 3 Holdings filed suit in federal court this week, accusing Facebook parent company Meta of copyright infringement and alleging that Meta has extensively pirated VMG content to train its artificial intelligence models.

Pineapple Support, Streamate to Host 'Navigating Grief and Loss' Support Group

Pineapple Support and Streamate are hosting a free online support group to help performers cope with grief and loss.

Friday is Final AV Compliance Deadline in UK

Friday, July 25 marks U.K. media regulator Ofcom’s deadline for user-to-user services such as tube, cam and fan sites to implement its requisite “highly effective age assurance” measures for preventing minors from viewing adult content.

AEBN Publishes Popular Searches for May, June

AEBN has released the top search terms for the months of May and June from its straight and gay theaters in all 50 states and the District of Columbia.

Show More