{"id":16573,"date":"2026-09-02T11:36:55","date_gmt":"2026-09-02T08:36:55","guid":{"rendered":"http:\/\/localhost:8080\/google-bilgi-bankasi\/robots-meta-tag\/"},"modified":"2026-09-05T02:45:46","modified_gmt":"2026-09-04T23:45:46","slug":"robots-meta-tag","status":"publish","type":"ar_kb","link":"https:\/\/alienroad.com\/google-bilgi-bankasi\/robots-meta-tag\/","title":{"rendered":"Robots meta tag, data-nosnippet, and X-Robots-Tag specifications"},"content":{"rendered":"

\n This document details how the page- and text-level settings can be used to adjust how Google
\n presents your content in search results. You can specify page-level settings by including a
\n meta<\/code> tag on HTML pages or in an HTTP header. You can specify text-level settings with
\n the data-nosnippet<\/code> attribute on HTML elements within a page.\n<\/p>\n

\n Keep in mind that these settings can be read and followed only if crawlers are allowed to access
\n the pages that include these settings.\n<\/p>\n

\n The <meta name=\"robots\" content=\"noindex\"><\/code> rule applies to search engine
\n crawlers. To block non-search crawlers, such as AdsBot-Google<\/code>, you might need to add
\n rules targeted to the specific crawler (for example,
\n <meta name=\"AdsBot-Google\" content=\"noindex\"><\/code>).\n<\/p>\n

Using the robots<\/span> meta<\/code> tag<\/h2>\n

\n The robots<\/span> meta<\/code> tag lets you use a granular,
\n page-specific approach to controlling how an individual HTML page should be indexed and served to
\n users in Google Search results. Place the robots<\/span> meta<\/code> tag
\n in the <head><\/code> section of a given page, like this:\n<\/p>\n

<\/div>\n