{"id":24080,"date":"2008-12-04T00:00:00","date_gmt":"2008-12-04T00:00:00","guid":{"rendered":"https:\/\/alienroad.com\/google-bilgi-bankasi\/more-control-of-googlebots-crawl-rate\/"},"modified":"2008-12-04T00:00:00","modified_gmt":"2008-12-04T00:00:00","slug":"more-control-of-googlebots-crawl-rate","status":"publish","type":"ar_kb","link":"https:\/\/alienroad.com\/google-bilgi-bankasi\/more-control-of-googlebots-crawl-rate\/","title":{"rendered":"More control of Googlebot&#8217;s crawl rate"},"content":{"rendered":"<aside class=\"key-point\">It&#8217;s been a while since we published this blog post. Some of the information may be outdated (for example, some images may be missing, and some links may not work anymore). Read the up-to-date documentation on <a href=\"https:\/\/alienroad.com\/google-bilgi-bankasi\/reduce-the-google-crawl-rate\/\">reducing the Googlebot crawl rate<\/a>.<\/aside>\n<p class=\"gargardate\">Thursday, December 04, 2008<\/p>\n<p>\n  We&#8217;ve upgraded the crawl rate setting in<br \/>\n  <a href=\"https:\/\/search.google.com\/search-console\" class=\"external-link\">Webmaster Tools<\/a><br \/>\n  so that webmasters experiencing problems with Googlebot can now provide us more specific<br \/>\n  information. Crawl rate for your site determines the time used by Googlebot to crawl your site on<br \/>\n  each visit. Our goal is to thoroughly crawl your site (so your pages can be indexed and returned<br \/>\n  in search results!) without creating a noticeable impact on your server&#8217;s bandwidth. While most<br \/>\n  webmasters are fine using the default crawl setting (that is, no changes needed, more on that<br \/>\n  below), some webmasters may have more specific needs.\n<\/p>\n<p>\n  <a href=\"https:\/\/alienroad.com\/google-bilgi-bankasi\/googlebot\/\">Googlebot<\/a> employs sophisticated<br \/>\n  algorithms that determine how much to crawl each site it visits. For a vast majority of sites,<br \/>\n  it&#8217;s probably best to choose the &#8220;Let Google determine my crawl rate&#8221; option, which is the<br \/>\n  default. However, if you&#8217;re an advanced user or if you&#8217;re facing bandwidth issues with your<br \/>\n  server, you can customize your crawl rate to the speed most optimal for your web server(s). The<br \/>\n  custom crawl rate option allows you to provide Googlebot insight to the maximum number of<br \/>\n  requests per second and the number of seconds between requests that you feel are best for your<br \/>\n  environment.\n<\/p>\n<p><img decoding=\"async\" alt=\"crawl rate feature in webmaster tools\" src=\"https:\/\/alienroad.com\/wp-content\/uploads\/kb-gorsel\/g-e4ae25570e4b.png\" loading=\"lazy\"><\/p>\n<p>\n  Googlebot determines the range of crawl rate values you&#8217;ll have available in Webmaster Tools. This<br \/>\n  is based on our understanding of your server&#8217;s capabilities. This range may vary from one site to<br \/>\n  another and across time based on several factors. Setting the crawl rate to a lower-than-default<br \/>\n  value may affect the coverage and freshness of your site in Google&#8217;s search results. However,<br \/>\n  setting it to higher value than the default won&#8217;t improve your coverage or ranking. If you do set<br \/>\n  a custom crawl rate, the new rate will be in effect for 90 days after which it resets to Google&#8217;s<br \/>\n  recommended value.\n<\/p>\n<p>\n  You may use this setting only for root level sites and sites not hosted on a large domain like<br \/>\n  blogspot.com (we have special settings assigned for them). To check the crawl rate setting, sign<br \/>\n  in to<br \/>\n  <a href=\"https:\/\/search.google.com\/search-console\" class=\"external-link\">Webmaster Tools<\/a><br \/>\n  and visit the Settings tab. If you have additional questions, visit the<br \/>\n  <a href=\"https:\/\/support.google.com\/webmasters\" class=\"external-link\">Webmaster Help Center<\/a><br \/>\n  to learn more about how Google crawls your site or post your questions in the<br \/>\n  <a href=\"https:\/\/support.google.com\/webmasters\/community\" class=\"external-link\">Webmaster Help Forum<\/a>.\n<\/p>\n<p class=\"byline-author\">Written By Pooja Shah, Software Engineer, Webmaster Tools Team<\/p>\n","protected":false},"excerpt":{"rendered":"<p>It&#8217;s been a while since we published this blog post. Some of the information may be outdated (for example, some images may be missing, and some links may not work anymore). Read the up-to-date documentation on reducing the Googlebot crawl rate. Thursday, December 04, 2008 We&#8217;ve upgraded the crawl rate setting in Webmaster Tools so [&hellip;]<\/p>\n","protected":false},"menu_order":85783,"template":"","meta":{"footnotes":""},"ar_kb_kategori":[665],"ar_kb_etiket":[],"class_list":["post-24080","ar_kb","type-ar_kb","status-publish","has-post-thumbnail","hentry","ar_kb_kategori-blog"],"_links":{"self":[{"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_kb\/24080","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_kb"}],"about":[{"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/types\/ar_kb"}],"version-history":[{"count":0,"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_kb\/24080\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/media\/26660"}],"wp:attachment":[{"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/media?parent=24080"}],"wp:term":[{"taxonomy":"ar_kb_kategori","embeddable":true,"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_kb_kategori?post=24080"},{"taxonomy":"ar_kb_etiket","embeddable":true,"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_kb_etiket?post=24080"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}