{"id":28514,"date":"2026-09-08T21:56:08","date_gmt":"2026-09-08T18:56:08","guid":{"rendered":"https:\/\/alienroad.com\/yandex-bilgi-bankasi\/how-to-check-that-a-robot-belongs-to-yandex\/"},"modified":"2026-09-09T00:47:43","modified_gmt":"2026-09-08T21:47:43","slug":"how-to-check-that-a-robot-belongs-to-yandex","status":"publish","type":"ar_ykb","link":"https:\/\/alienroad.com\/yandex-bilgi-bankasi\/how-to-check-that-a-robot-belongs-to-yandex\/","title":{"rendered":"How to check that a robot belongs to Yandex"},"content":{"rendered":"<p>Robots can claim to be Yandex by setting the user agent. Verification is done by <strong>reverse DNS lookup<\/strong>, and the procedure is worth automating in log analysis.<\/p>\n<h2>The four steps<\/h2>\n<ol>\n<li>Get the IP address from server logs.<\/li>\n<li>Reverse-lookup the IP to a host name.<\/li>\n<li>Confirm the host ends in <code>yandex.ru<\/code>, <code>yandex.net<\/code> veya <code>yandex.com<\/code>. Any other ending means it is not Yandex.<\/li>\n<li><strong>Forward-lookup the host name<\/strong> and confirm it resolves back to the same IP. A mismatch means the host name is fake.<\/li>\n<\/ol>\n<p>The fourth step is the one people skip, and without it the check proves nothing. The console&#8217;s IP address check tool does the same job for a single address.<\/p>\n<h2>Why IP ranges are not published<\/h2>\n<p>The robots use autonomous systems <strong>AS13238, AS208722 and AS212066<\/strong> with frequently changing addresses, so no list is disclosed. Allowlisting by IP is therefore not a viable strategy; reverse DNS is the supported method.<\/p>\n<h2>The important detail about the robot fleet<\/h2>\n<p>Many Yandex robots fetch documents for purposes other than indexing, and <strong>a number of them ignore <code>robots.txt<\/code> rules written for <code>User-agent: *<\/code><\/strong>. Some ignore the file entirely \u2014 <code>YaDirectFetcher<\/code>, several <code>YandexMetrika<\/code> versions. To constrain those, name them explicitly:<\/p>\n<pre><code>User-agent: YandexCalendar\nDisallow: \/\n\nUser-agent: YandexMobileBot\nDisallow: \/private\/*.txt$<\/code><\/pre>\n<h2>The rule that resolves a common confusion<\/h2>\n<p>If one of these robots downloads a document the <strong>main<\/strong> indexing robot cannot access, <strong>that document is never indexed and never appears in search<\/strong>. Traffic in the logs from a Yandex agent is not evidence that a page is being indexed \u2014 the fleet is large and most of it is not the indexer.<\/p>\n<h2>Reading logs<\/h2>\n<p>User-agent strings include a browser version that changes over time \u2014 <code>YandexBot\/3.0<\/code> appears with a Chrome version attached. Match on the robot name, never on the full string, or log filters break silently after an update.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Robots can claim to be Yandex by setting the user agent. Verification is done by reverse DNS lookup, and the procedure is worth automating in log analysis. The four steps Get the IP address from server logs. Reverse-lookup the IP to a host name. Confirm the host ends in yandex.ru, yandex.net veya yandex.com. Any other [&hellip;]<\/p>\n","protected":false},"menu_order":90,"template":"","meta":{"footnotes":""},"ar_ykb_kategori":[765],"ar_ykb_etiket":[],"class_list":["post-28514","ar_ykb","type-ar_ykb","status-publish","has-post-thumbnail","hentry","ar_ykb_kategori-robots-txt"],"_links":{"self":[{"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_ykb\/28514","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_ykb"}],"about":[{"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/types\/ar_ykb"}],"version-history":[{"count":2,"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_ykb\/28514\/revisions"}],"predecessor-version":[{"id":29120,"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_ykb\/28514\/revisions\/29120"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/media\/28896"}],"wp:attachment":[{"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/media?parent=28514"}],"wp:term":[{"taxonomy":"ar_ykb_kategori","embeddable":true,"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_ykb_kategori?post=28514"},{"taxonomy":"ar_ykb_etiket","embeddable":true,"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_ykb_etiket?post=28514"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}