January 13, 2006<\/p>\n
Today, we wanted to review a few things that we get a lot of questions about.<\/p>\n
\n If we can’t process the verification request right away, we’ll add it to a queue and process it as \n Any time we access your site, we first check to see if you have a robots.txt file that restricts \n Some stats we can only show if you \n We show you stats about what we know about your site. If we haven’t yet crawled and indexed much
\n soon as possible. While your request is in this queue, the status will show as pending. Once we
\n successfully process your request, your site will show as verified. If the request is
\n unsuccessful, you’ll see a status of “not verified”. You can read more about
\n reasons the request might not be successful<\/a>
\n or take a look at our
\n documentation<\/a>.\n<\/p>\n\n I submitted my Sitemap and it now as a status of “Timed out downloading robots.txt”. I don’t have
\n a robots.txt file on my site. What happened
\n<\/h2>\n
\n our access. If we get a timeout from your server when we do this check, you’ll see this message.
\n This is probably a temporary problem. Once your server is accessible again, we will be able to see
\n that you don’t have a robots.txt file, and will then access your Sitemap. If you continue to see
\n this error, make sure that your webserver is up and responding to requests.\n<\/p>\n\n I submitted my sitemap at https:\/\/www.example.com\/mysite\/ and verified it. But now you are asking
\n me to verify at https:\/\/www.example.com\/. I can’t verify at that location because I don’t have
\n access. Why are you asking me to do this
\n<\/h2>\n
\n verify at the root level<\/a>.
\n If you don’t have access to this location, we will
\n show you all the information we are able to<\/a>
\n (such as errors we had crawling your site). Verification doesn’t impact Sitemap submission or
\n indexing in any way, and there is no penalty if you can’t verify at the root level.\n<\/p>\n\n I’ve submitted my Sitemap, verified my site, and you’ve downloaded my Sitemap, but many of my
\n stats show “Data is not available at the time time”. Why?
\n<\/h2>\n
\n of your site, we may not have many stats to show you. As we crawl more of your site and learn
\n more about it,
\n you’ll start to see more stats<\/a>.\n<\/p>\n