{"id":23871,"date":"2007-03-06T00:00:00","date_gmt":"2007-03-06T00:00:00","guid":{"rendered":"https:\/\/alienroad.com\/google-bilgi-bankasi\/using-the-robots-meta-tag\/"},"modified":"2007-03-06T00:00:00","modified_gmt":"2007-03-06T00:00:00","slug":"using-the-robots-meta-tag","status":"publish","type":"ar_kb","link":"https:\/\/alienroad.com\/google-bilgi-bankasi\/using-the-robots-meta-tag\/","title":{"rendered":"Using the robots meta tag"},"content":{"rendered":"<aside class=\"key-point\">It&#8217;s been a while since we published this blog post. Some of the information may be outdated (for example, some images may be missing, and some links may not work anymore).<\/aside>\n<p class=\"gargardate\">Tuesday, March 06, 2007<\/p>\n<p>\n  Recently, Danny Sullivan brought up good questions about how<br \/>\n  <a href=\"https:\/\/searchengineland.com\/070228-140603.php\" class=\"external-link\">search engines handle <code>meta<\/code> tags<\/a>.<br \/>\n  Here are some answers about how we handle these tags at Google.\n<\/p>\n<h2 id=\"multiple-content-values\" tabindex=\"-1\">Multiple content values<\/h2>\n<p>\n  We recommend that you place all content values in one <code>meta<\/code> tag. This keeps the <code>meta<\/code> tags easy to<br \/>\n  read and reduces the chance for conflicts. For instance:\n<\/p>\n<div><\/div>\n<p>\n  If the page contains multiple <code>meta<\/code> tags of the same type, we will aggregate the content values.<br \/>\n  For instance, we will interpret\n<\/p>\n<div><\/div>\n<p>the same way as:<\/p>\n<div><\/div>\n<p>\n  If content values conflict, we will use the most restrictive. So, if the page has these <code>meta<\/code> tags:\n<\/p>\n<div><\/div>\n<p> We will obey the <code>noindex<\/code> value.<\/p>\n<h2 id=\"unnecessary-content-values\" tabindex=\"-1\">Unnecessary content values<\/h2>\n<p>\n  By default, Googlebot will index a page and follow links to it. So there&#8217;s no need to tag pages<br \/>\n  with content values of <code>index<\/code> \u0438\u043b\u0438 <code>follow<\/code>.\n<\/p>\n<h2 id=\"directing-a-robots-meta-tag-specifically-at-googlebot\" tabindex=\"-1\">Directing a <span>robots<\/span> <code>meta<\/code> tag specifically at Googlebot<\/h2>\n<p>\n  To provide instruction for all search engines, set the meta name to <code>robots<\/code>. To<br \/>\n  provide instruction for only Googlebot, set the meta name to <code>Googlebot<\/code>. If you want<br \/>\n  to provide different instructions for different search engines (for instance, if you want one<br \/>\n  search engine to index a page, but not another), it&#8217;s best to use a specific <code>meta<\/code> tag for each<br \/>\n  search engine rather than use a generic <span>robots<\/span> <code>meta<\/code> tag combined with a specific one. You can find<br \/>\n  a <a href=\"https:\/\/www.robotstxt.org\/db\" class=\"external-link\">list of bots<\/a> at robotstxt.org.\n<\/p>\n<h2 id=\"casing-and-spacing\" tabindex=\"-1\">Casing and spacing<\/h2>\n<p>\n  Googlebot understands any combination of lowercase and uppercase. So each of these <code>meta<\/code> tags is<br \/>\n  interpreted in exactly the same way:\n<\/p>\n<div><\/div>\n<p>\n  If you have multiple content values, you must place a comma between them, but it doesn&#8217;t matter if<br \/>\n  you also include spaces. So the following <code>meta<\/code> tags are interpreted the same way:\n<\/p>\n<div><\/div>\n<h2 id=\"if-you-use-both-a-robots.txt-file-and-robots-meta-tags\" tabindex=\"-1\">If you use both a robots.txt file and <span>robots<\/span> <code>meta<\/code> tags<\/h2>\n<p>\n  If the robots.txt and <code>meta<\/code> tag instructions for a page conflict, Googlebot follows the most<br \/>\n  restrictive. More specifically:\n<\/p>\n<ul>\n<li>\n    If you block a page with robots.txt, Googlebot will never crawl the page and will never read any<br \/>\n    <code>meta<\/code> tags on the page.\n  <\/li>\n<li>\n    If you allow a page with robots.txt but block it from being indexed using a <code>meta<\/code> tag, Googlebot<br \/>\n    will access the page, read the <code>meta<\/code> tag, and subsequently not index it.\n  <\/li>\n<\/ul>\n<h2 id=\"valid-meta-robots-content-values\" tabindex=\"-1\">Valid meta robots content values<\/h2>\n<p>Googlebot interprets the following <span>robots<\/span> <code>meta<\/code> tag values:<\/p>\n<ul>\n<li><code>noindex<\/code>: prevents the page from being included in the index.<\/li>\n<li>\n    <code>nofollow<\/code>: prevents Googlebot from following any links on the page. (Note that this<br \/>\n    is different from the link-level <code>nofollow<\/code> attribute, which prevents Googlebot from<br \/>\n    following an individual link.)\n  <\/li>\n<li>\n    <code>noarchive<\/code>: prevents a cached copy of this page from being available in the search<br \/>\n    results.\n  <\/li>\n<li>\n    <code>nosnippet<\/code>: prevents a description from appearing below the page in the search<br \/>\n    results, as well as prevents caching of the page.\n  <\/li>\n<li>\n    <code>noodp<\/code>: blocks the<br \/>\n    <a href=\"https:\/\/www.dmoz.org\/\" class=\"external-link\">Open Directory Project<\/a> description of<br \/>\n    the page from being used in the description that appears below the page in the search results.\n  <\/li>\n<li><code>none<\/code>: equivalent to <code>noindex, nofollow<\/code>.<\/li>\n<\/ul>\n<h2 id=\"a-word-about-content-value-none\" tabindex=\"-1\">A word about content value <code>none<\/code><\/h2>\n<p>\n  As defined by<br \/>\n  <a href=\"https:\/\/www.robotstxt.org\/wc\/meta-user\" class=\"external-link\">robotstxt.org<\/a>, the<br \/>\n  following direction means <code>noindex, nofollow<\/code>.\n<\/p>\n<div><\/div>\n<p>\n  However, some webmasters use this tag to indicate no robots restrictions and inadvertently block<br \/>\n  all search engines from their content.\n<\/p>\n<aside class=\"note\"><b>Update:<\/b> For more information, please see our<br \/>\n  <a href=\"https:\/\/alienroad.com\/google-bilgi-bankasi\/robots-meta-tag\/\"><span>robots<\/span> <code>meta<\/code> tag documentation<\/a>.<br \/>\n<\/aside>\n","protected":false},"excerpt":{"rendered":"<p>It&#8217;s been a while since we published this blog post. Some of the information may be outdated (for example, some images may be missing, and some links may not work anymore). Tuesday, March 06, 2007 Recently, Danny Sullivan brought up good questions about how search engines handle meta tags. Here are some answers about how [&hellip;]<\/p>\n","protected":false},"menu_order":86422,"template":"","meta":{"footnotes":""},"ar_kb_kategori":[665],"ar_kb_etiket":[],"class_list":["post-23871","ar_kb","type-ar_kb","status-publish","has-post-thumbnail","hentry","ar_kb_kategori-blog"],"_links":{"self":[{"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_kb\/23871","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_kb"}],"about":[{"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/types\/ar_kb"}],"version-history":[{"count":0,"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_kb\/23871\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/media\/26502"}],"wp:attachment":[{"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/media?parent=23871"}],"wp:term":[{"taxonomy":"ar_kb_kategori","embeddable":true,"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_kb_kategori?post=23871"},{"taxonomy":"ar_kb_etiket","embeddable":true,"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_kb_etiket?post=23871"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}