Thursday, January 23, 2014<\/p>\n
\n Over the years, Google has used different crawlers to crawl and index content for feature phones
\n and smartphones. These mobile-specific crawlers have all been referred to as Googlebot-Mobile.
\n However, feature phones and smartphones have considerably different device capabilities, and we’ve
\n seen cases where a webmaster inadvertently blocked smartphone crawling or indexing when they
\n really meant to block just feature phone crawling or indexing. This ambiguity made it impossible
\n for Google to index smartphone content of some sites, or for Google to recognize that these sites
\n are smartphone-optimized.\n<\/p>\n
\n To clarify the situation and to give webmasters greater control, we’ll be retiring The new Googlebot for smartphones :<\/p>\n (updated August 2015)<\/i><\/p>\n The Googlebot-Mobile for smartphones \n This change affects only Googlebot-Mobile for smartphones. The user agent of the regular Googlebot Regular Googlebot The two Googlebot-Mobile user-agents for feature phones:<\/p>\n \n You can test your site using the \n Please note this important implication of the This robots.txt rule will block crawling by Google’s feature phone crawlers:<\/p>\n \n Based on our internal analyses, this update affects less than 0.001% of URLs while giving Thursday, January 23, 2014 Over the years, Google has used different crawlers to crawl and index content for feature phones and smartphones. These mobile-specific crawlers have all been referred to as Googlebot-Mobile. However, feature phones and smartphones have considerably different device capabilities, and we’ve seen cases where a webmaster inadvertently blocked smartphone crawling or indexing […]<\/p>\n","protected":false},"menu_order":83907,"template":"","meta":{"footnotes":""},"ar_kb_kategori":[665],"ar_kb_etiket":[],"class_list":["post-24799","ar_kb","type-ar_kb","status-publish","has-post-thumbnail","hentry","ar_kb_kategori-blog"],"_links":{"self":[{"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_kb\/24799","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_kb"}],"about":[{"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/types\/ar_kb"}],"version-history":[{"count":0,"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_kb\/24799\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/media\/27006"}],"wp:attachment":[{"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/media?parent=24799"}],"wp:term":[{"taxonomy":"ar_kb_kategori","embeddable":true,"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_kb_kategori?post=24799"},{"taxonomy":"ar_kb_etiket","embeddable":true,"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_kb_etiket?post=24799"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}
\n “Googlebot-Mobile” for smartphones as a user agent starting in 3-4 weeks’ time. From then on, the
\n user agent for smartphones will identify itself simply as “Googlebot” but will still list
\n mobile<\/span> elsewhere in the user-agent<\/code> string. Here are the
\n new and old user-agent<\/code>s:\n<\/p>\nuser-agent<\/code><\/p>\nuser-agent<\/code> we will be retiring soon:<\/p>\n
\n does not change, and the remaining two Googlebot-Mobile crawlers will continue to refer to feature
\n phone devices in their user-agent<\/code> strings; for reference, these are:\n<\/p>\nuser-agent<\/code>:<\/p>\n\n
\n Fetch as Google feature in Webmaster Tools<\/a>,
\n and you can see a full list of our
\n existing crawlers in the Help Center<\/a>.\n<\/p>\nCrawling and indexing<\/h2>\n
user-agent<\/code> update: The new
\n Googlebot for smartphones crawler will follow robots.txt, robots<\/span> meta<\/code> tag, and HTTP header
\n rules for Googlebot<\/code> instead of Googlebot-Mobile<\/code><\/strong>. For
\n example, when the new crawler is deployed, this robots.txt rule will block all crawling by
\n the new Googlebot<\/code> for smartphones user-agent<\/code>, and also the regular
\n Googlebot<\/code>:\n<\/p>\n
\n webmasters greater control over the crawling and indexing of their content. As always, if you have
\n any questions, you can:\n<\/p>\n\n
\n recommendations for building smartphone-optimized sites<\/a>\n <\/li>\n
\n controlling Googlebot crawling and indexing<\/a>\n <\/li>\n
\n Webmaster help forums<\/a>
\n or visit one of our
\n Webmaster Central office hours hangouts<\/a>.\n <\/li>\n<\/ul>\n