{"id":24572,"date":"2011-08-25T00:00:00","date_gmt":"2011-08-25T00:00:00","guid":{"rendered":"https:\/\/alienroad.com\/google-bilgi-bankasi\/google-news-now-crawling-with-googlebot\/"},"modified":"2011-08-25T00:00:00","modified_gmt":"2011-08-25T00:00:00","slug":"google-news-now-crawling-with-googlebot","status":"publish","type":"ar_kb","link":"https:\/\/alienroad.com\/google-bilgi-bankasi\/google-news-now-crawling-with-googlebot\/","title":{"rendered":"Google News now crawling with Googlebot"},"content":{"rendered":"<p class=\"gargardate\">Thursday, August 25, 2011<\/p>\n<p>\n  <i><br \/>\n    Cross-posted on the<br \/>\n    <a href=\"https:\/\/googlenewsblog.blogspot.com\/2011\/08\/google-news-now-crawling-with-googlebot.html\" class=\"external-link\">Google News Blog<\/a><br \/>\n  <\/i>\n<\/p>\n<p>\n  Google News recently updated our infrastructure to crawl with Google&#8217;s primary user-agent,<br \/>\n  <a href=\"https:\/\/alienroad.com\/google-bilgi-bankasi\/googlebot\/\">Googlebot<\/a>.<br \/>\n  What does this mean? Very little to most publishers. Any news organizations that wish to opt out<br \/>\n  of Google News can continue to do so: Google News will still respect the robots.txt entry for<br \/>\n  <a href=\"https:\/\/alienroad.com\/google-bilgi-bankasi\/new-user-agent-for-news\/\">Googlebot-News<\/a>, our former user-agent,<br \/>\n  if it is more restrictive than the robots.txt entry for Googlebot.\n<\/p>\n<p>\n  Our Help Center provides detailed<br \/>\n  <a href=\"https:\/\/www.google.com\/support\/news_pub\/bin\/answer.py?answer=93977\" class=\"external-link\">guidance<\/a><br \/>\n  on using the robots exclusion protocol for Google News, and publishers can contact the<br \/>\n  <a href=\"https:\/\/www.google.com\/support\/news_pub\/bin\/static.py?page=contact_policy.cs\" class=\"external-link\">Google News Support Team<\/a><br \/>\n  if they have any questions, but we wanted to first clarify the following:\n<\/p>\n<ul>\n<li>\n    Although you&#8217;ll now only see the Googlebot user-agent in your site&#8217;s logs, no need to worry:<br \/>\n    the appearance of Googlebot instead of Googlebot-News is independent of our inclusion policies.<br \/>\n    (You can always check whether your site is included in Google News by searching with the &#8220;site:&#8221;<br \/>\n    operator.  For instance, enter &#8220;site:yournewssite.com&#8221; in the search field for Google News, and<br \/>\n    if you see results then we are currently indexing your news site.)\n  <\/li>\n<li>\n    Your analytics tool will still be able to differentiate user traffic coming to your website from<br \/>\n    Google Search and traffic coming from Google News, so you should see no changes there.<br \/>\n    The main difference is that you will no longer see occasional automated visits to your site<br \/>\n    from the Googlebot-news crawler.\n  <\/li>\n<li>\n    If you&#8217;re currently respecting our<br \/>\n    <a href=\"https:\/\/alienroad.com\/google-bilgi-bankasi\/googlebot\/\">guidelines for Googlebot<\/a>,<br \/>\n    you will not need to make any code changes to your site.  Sites that have implemented<br \/>\n    subscriptions using a metered model or who have implemented<br \/>\n    <a href=\"https:\/\/www.google.com\/support\/webmasters\/bin\/answer.py?answer=74536\" class=\"external-link\"><span>First Click Free<\/span><\/a><br \/>\n    will not experience any changes. For sites which require registration, payment or login prior to<br \/>\n    reading any full article, Google News will only be able to crawl and index the title and snippet<br \/>\n    that you show all users who visit your page. Our<br \/>\n    <a href=\"https:\/\/alienroad.com\/google-bilgi-bankasi\/search-essentials-overview\/\">Webmaster Guidelines<\/a><br \/>\n    provide additional information about<br \/>\n    &#8220;<a href=\"https:\/\/alienroad.com\/google-bilgi-bankasi\/spam-policies\/#cloaking\">cloaking<\/a>&#8221;<br \/>\n    (that is, showing a bot a different version than what users experience). Learn more about Google<br \/>\n    News and subscription publishers in this<br \/>\n    <a href=\"https:\/\/www.google.com\/support\/news_pub\/bin\/answer.py?answer=40543\" class=\"external-link\">Help Center article<\/a>.\n  <\/li>\n<li>\n    Rest assured, your Sitemap will still be crawled. This change does not affect how we crawl News<br \/>\n    Sitemaps. If you are a News publisher who hasn&#8217;t yet set up a News Sitemap and are interested in<br \/>\n    getting started, please follow our<br \/>\n    <a href=\"https:\/\/alienroad.com\/google-bilgi-bankasi\/news-sitemaps\/\">documentation about Google News<\/a>.\n  <\/li>\n<li>\n    For any publishers that wish to opt out of Google News and stay in Google Search, you can simply<br \/>\n    disallow Googlebot-news and allow Googlebot. For more information on how to do this, consult our<br \/>\n    <a href=\"https:\/\/alienroad.com\/google-bilgi-bankasi\/robots-txt-intro\/\">documentation about robots.txt<\/a>.\n  <\/li>\n<\/ul>\n<p>\n  As with any website, from time to time we need to make updates to our infrastructure. At the same<br \/>\n  time, we want to continue to provide as much control as possible to news web sites. We hope we<br \/>\n  have answered any questions you might have about this update. If you have additional questions,<br \/>\n  please check out our<br \/>\n  <a href=\"https:\/\/www.google.com\/support\/news_pub\/\" class=\"external-link\">Help Center<\/a>.\n<\/p>\n<p class=\"byline-author\">Posted by David Smydra, Google News Product Specialist<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Thursday, August 25, 2011 Cross-posted on the Google News Blog Google News recently updated our infrastructure to crawl with Google&#8217;s primary user-agent, Googlebot. What does this mean? Very little to most publishers. Any news organizations that wish to opt out of Google News can continue to do so: Google News will still respect the robots.txt [&hellip;]<\/p>\n","protected":false},"menu_order":84789,"template":"","meta":{"footnotes":""},"ar_kb_kategori":[665],"ar_kb_etiket":[],"class_list":["post-24572","ar_kb","type-ar_kb","status-publish","has-post-thumbnail","hentry","ar_kb_kategori-blog"],"_links":{"self":[{"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_kb\/24572","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_kb"}],"about":[{"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/types\/ar_kb"}],"version-history":[{"count":0,"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_kb\/24572\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/media\/26885"}],"wp:attachment":[{"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/media?parent=24572"}],"wp:term":[{"taxonomy":"ar_kb_kategori","embeddable":true,"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_kb_kategori?post=24572"},{"taxonomy":"ar_kb_etiket","embeddable":true,"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_kb_etiket?post=24572"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}