August 26, 2005
So, what URLs from your site should you put in your Sitemap?
Put in everything! List the URLs that contain your content, images, media, and anything else in
your site.
If you want to include only a subset of items, you can, but we’d like as much information about
your site as you can give us.
Remember that we respect robots.txt, so if you include any URLs in your Sitemap that are
restricted in robots.txt, we won’t crawl those.
Alien Road
How we apply this
We archive Search Central announcements because client questions often trace back to a change that was announced years ago. Reading the original is faster than reconstructing it from second-hand summaries.
Related services