Site indexingHow does Yandex search work?
Yandex describes its own pipeline in four stages, and knowing which stage a problem belongs to is what turns a…
Site indexing
Site indexingHow can I add a site to search?
Pages appear in search after Yandex robots visit them. The question of how to get a site into search reduces…
What files can be included in search results?
Yandex indexes HTML plus a defined list of file formats, each up to 10 MB: PDF; Microsoft Office DOC, DOCX,…
Site indexingWie viele Website-Seiten sind in der Suche enthalten?
“Wie viele unserer Seiten sind bei Yandex?” hat zwei Antworten, und sie messen unterschiedliche Dinge. Der schnelle externe Check Öffnen…
Site indexingWie prüfe ich, ob eine Website für Nutzer und Suchmaschinen-Bots zugänglich ist?
Verfügbarkeit ist die Grundvoraussetzung für alles Weitere. Yandex macht die Konsequenz deutlich: Wenn der Bot die Website aufgrund eines Serverfehlers…
Site indexingHow do I check if all important pages are included in search?
Two tools answer whether the pages that matter are actually in search, and the difference between them is scope: one…
Site indexingHow do I inform Yandex about changes on the site?
Yandex’s recommendation for notifying it about new and updated pages is not to choose one method but to combine several:…
How to monitor and manage indexing?
Monitoring indexing means answering five questions, and the console has a report for each: when the robot came and what…
Site indexingWie werden meine Website-Seiten von Indexing-Bots und Nutzern wahrgenommen?
Diese Seite beantwortet eine berechtigte Frage: Wie sieht eine Seite für einen Indexierungs-Bot aus und was lässt sich dagegen tun?…
Site indexingHow do I prevent from indexing the pages that aren’t needed in…
Most sites contain pages nobody should find in search: service and administration pages, content useful only to logged-in users such…
Site indexingWhy should I avoid duplicate pages?
Duplicates are pages with nearly or completely identical text on the same site at different URLs. Yandex’s example of one…
Site indexingMoving the site
A site move means changing the address Yandex ranks. Four situations count as one: A new domain name — example.com…
Robots.txtUsing robots.txt
robots.txt sets crawling parameters for search robots. Restricting sections reduces server load and speeds the site up. Yandex supports the…
Robots.txtThe User-agent directive
The robot looks for records beginning with User-agent: and matches either the substring Yandex (case-insensitively) or *. The precedence rules…
Disallow and Allow directives
Disallow prevents crawling of sections or pages; Allow permits them. Yandex lists what belongs behind Disallow: pages with confidential data,…
Robots.txtThe Sitemap directive
The Sitemap directive declares where the sitemap lives. Several may be listed, one per line: User-agent: Yandex Allow: / sitemap:…
The Crawl-delay directive
Crawl-delay has been ignored by Yandex since 22 February 2018. Any site still carrying the directive is carrying a line…
Robots.txtThe Clean-param directive
Clean-param is a Yandex extension with no equivalent elsewhere: it tells the robot which URL parameters do not change the…
Robots.txtHow to check that a robot belongs to Yandex
Robots can claim to be Yandex by setting the user agent. Verification is done by reverse DNS lookup, and the…
Robots.txtHow do I lower a load on the site or server?
The robot plans its own visits and adjusts load automatically. Requests can spike when it discovers a new section, a…
Meta tags
Meta tags tell the robot how to load, index and display a page. Yandex takes account of a specific set,…
About the IndexNow protocol
IndexNow lets a site notify Yandex directly about pages that were created, updated or deleted, instead of waiting for the…
IndexNowVerification key
The IndexNow key proves you control the site. You generate it, place a file containing it on the site, and…
IndexNow API request reference
The API is deliberately small: one endpoint, two methods. One URL — GET GET https://yandex.com/indexnow?url=<String>&key=<String>[&keyLocation=<String>] url and key are required;…
IndexNowCMS plug-ins
IndexNow can be automated with plugins written by third parties. Yandex lists them for popular systems and attaches a disclaimer…
Sitemap
Eine Sitemap teilt Suchmaschinen die aktuelle Struktur der Website mit. Yandex unterstützt XML (empfohlen, da es zusätzliche Informationen enthält) und…
How do I prohibit indexing of the site or pages?
Three instruments hide content from indexing, and they operate at different levels: the whole site or a section, an individual…
How do I remove pages from the search?
Removing a page from search is a two-step operation, and skipping the first makes the second fail. Prohibit indexing first,…
Site indexingSaved copy
The saved copy shows the page version Yandex last indexed — full page or text only — along with the…
Site indexingDuplicate pages
Duplicates are pages within one site serving the same content at different addresses. Yandex is precise about the boundary: pages…
Site indexingCanonical URLs
When several URLs carry the same or similar content, Yandex groups them and picks one to show — the canonical…
Site indexingProcessing redirects
Yandex recognises the standard 3xx codes: 301 and 308 as permanent, 302, 303 and 307 as temporary, and a refresh…
Site indexingSubdomain indexing
Yandex treats every subdomain as a separate site. That single fact governs everything else: each one is added to the…
Site indexingIndexing pages with JavaScript β
Yandex can execute JavaScript when crawling, and the console lets you decide whether it should. The setting lives under Indexing…
Site indexingIndexing localized pages
Yandex reads hreflang alternate links — and it opens with a deprecation worth acting on: the sitemap file is no…
Site indexingIndexing AJAX sites
Yandex now crawls AJAX sites by fetching the original URLs and executing JavaScript on them. Two older mechanisms are formally…
How do I improve the site’s ranking in the search?
Yandex answers “how do I rank better?” with five indicators to work on and, more usefully, a list of reasons…
How do I improve the site's ranking in the search?Additional ranking signals
This page describes something unusual: Yandex ranks corporate sites partly on signals about how the business behaves toward its customers.…