{"id":23785,"date":"2006-02-13T00:00:00","date_gmt":"2006-02-13T00:00:00","guid":{"rendered":"https:\/\/alienroad.com\/google-bilgi-bankasi\/weve-fixed-a-few-things\/"},"modified":"2006-02-13T00:00:00","modified_gmt":"2006-02-13T00:00:00","slug":"weve-fixed-a-few-things","status":"publish","type":"ar_kb","link":"https:\/\/alienroad.com\/google-bilgi-bankasi\/weve-fixed-a-few-things\/","title":{"rendered":"We&#8217;ve fixed a few things"},"content":{"rendered":"<aside class=\"key-point\">It&#8217;s been a while since we published this blog post. Some of the information may be outdated (for example, some images may be missing, and some links may not work anymore).<\/aside>\n<p class=\"gargardate\">February 13, 2006<\/p>\n<p>\n  We&#8217;ve just fixed a few issues that our<br \/>\n  <a href=\"https:\/\/support.google.com\/webmasters\/community\" class=\"external-link\">Google Group<\/a><br \/>\n  members brought to our attention.\n<\/p>\n<h2 id=\"capitalization-in-robots.txt-lines\" tabindex=\"-1\">Capitalization in robots.txt lines<\/h2>\n<p>\n  Our robots.txt analysis tool didn&#8217;t correctly interpret lines that include capitalized letters.<br \/>\n  This has been fixed. All results with URLs that include capital letters are being processed<br \/>\n  correctly. Note that in a robots.txt file, the capitalization of the rules don&#8217;t matter. For<br \/>\n  instance, <code>Disallow:<\/code> and <code>disallow:<\/code> are interpreted in the same way.<br \/>\n  However, capitalization of URLs <em>does<\/em> matter. So, for the following robots.txt file:\n<\/p>\n<div><\/div>\n<p>\n  <code>https:\/\/www.example.com\/Myfile.html<\/code> is blocked. But<br \/>\n  <code>https:\/\/www.example.com\/myfile.html<\/code> is not blocked.\n<\/p>\n<h2 id=\"google-user-agents-other-than-googlebot\" tabindex=\"-1\">Google User-agents other than Googlebot<\/h2>\n<p>\n  Our robots.txt analysis tool didn&#8217;t correctly process robots.txt files for Google user-agents<br \/>\n  other than Googlebot. This has been fixed. The Google user-agents we provide analysis for are:\n<\/p>\n<ul>\n<li>\n    <code>Googlebot-Mobile:<\/code> crawls pages for our<br \/>\n    <a href=\"https:\/\/mobile.google.com\/mobile_search.html\" class=\"external-link\">mobile index<\/a>\n  <\/li>\n<li>\n    <code>Googlebot-Image:<\/code> crawls pages for our<br \/>\n    <a href=\"https:\/\/www.google.com\/imghp?tab=wi&#038;q=\" class=\"external-link\">image index<\/a>\n  <\/li>\n<li>\n    <code>Googlebot-MediaPartners:<\/code> crawls pages to determine<br \/>\n    <a href=\"https:\/\/www.google.com\/adsense\/\" class=\"external-link\">AdSense content<\/a> (used only<br \/>\n    if you show AdSense ads on your site)\n  <\/li>\n<\/ul>\n<h2 id=\"robots.txt-files-with-extra-initial-characters\" tabindex=\"-1\">robots.txt files with extra initial characters<\/h2>\n<p>\n  Some robots.txt files have extra characters before the start of the first rule. Some text editors<br \/>\n  place these characters in the file, but you can&#8217;t see them with the editor. When the tool<br \/>\n  processed these characters, it reported a syntax error. The tool now mimics Googlebot&#8217;s behavior<br \/>\n  and ignores these extra characters.\n<\/p>\n<h2 id=\"capitalization-in-site-urls\" tabindex=\"-1\">Capitalization in site URLs<\/h2>\n<p>\n  When you add a site, we now convert all the letters in the domain portion of the URL to lowercase,<br \/>\n  regardless of how you entered the letters. For instance, if you enter<br \/>\n  <code>https:\/\/www.Example.com\/<\/code>, we convert that to<br \/>\n  <code>https:\/\/www.example.com\/<\/code> in your account. This applies only to the domain, so for<br \/>\n  instance, if you add <code>https:\/\/www.Example.com\/MySite\/<\/code>, we will convert it to<br \/>\n  <code>https:\/\/www.example.com\/MySite\/<\/code>. If you added sites to your account using<br \/>\n  capitalized letters, you&#8217;ll notice the domain portions have been converted to lowercase. We<br \/>\n  made this minor change as part of our efforts to ensure you see all available stats for your site.\n<\/p>\n<p class=\"byline-author\">Posted by <a href=\"https:\/\/www.vanessafox.com\/\" class=\"external-link\">Vanessa Fox<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>It&#8217;s been a while since we published this blog post. Some of the information may be outdated (for example, some images may be missing, and some links may not work anymore). February 13, 2006 We&#8217;ve just fixed a few issues that our Google Group members brought to our attention. Capitalization in robots.txt lines Our robots.txt [&hellip;]<\/p>\n","protected":false},"menu_order":86808,"template":"","meta":{"footnotes":""},"ar_kb_kategori":[665],"ar_kb_etiket":[],"class_list":["post-23785","ar_kb","type-ar_kb","status-publish","has-post-thumbnail","hentry","ar_kb_kategori-blog"],"_links":{"self":[{"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_kb\/23785","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_kb"}],"about":[{"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/types\/ar_kb"}],"version-history":[{"count":0,"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_kb\/23785\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/media\/26417"}],"wp:attachment":[{"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/media?parent=23785"}],"wp:term":[{"taxonomy":"ar_kb_kategori","embeddable":true,"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_kb_kategori?post=23785"},{"taxonomy":"ar_kb_etiket","embeddable":true,"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_kb_etiket?post=23785"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}