Site indexingHow does Yandex search work?
Yandex describes its own pipeline in four stages, and knowing which stage a problem belongs to is what turns a…
Site indexing
Site indexingHow can I add a site to search?
Pages appear in search after Yandex robots visit them. The question of how to get a site into search reduces…
What files can be included in search results?
Yandex indexes HTML plus a defined list of file formats, each up to 10 MB: PDF; Microsoft Office DOC, DOCX,…
Site indexingHow many site pages are included in search?
“How many of our pages are in Yandex?” has two answers, and they measure different things. The quick external check…
Site indexingHow do I check if a site is accessible to users and…
Availability is the precondition for everything else. Yandex makes the consequence explicit: if the robot cannot reach the site because…
Site indexingHow do I check if all important pages are included in search?
Two tools answer whether the pages that matter are actually in search, and the difference between them is scope: one…
Site indexing¿Cómo informo a Yandex sobre los cambios realizados en el sitio?
La recomendación de Yandex para notificar sobre páginas nuevas y actualizadas no es elegir un solo método, sino combinar varios:…
How to monitor and manage indexing?
Monitoring indexing means answering five questions, and the console has a report for each: when the robot came and what…
Site indexingHow do my site pages appear to indexing bots and users?
This page answers a question worth asking directly: how does a page look to an indexing bot, and what can…
Site indexingHow do I prevent from indexing the pages that aren’t needed in…
Most sites contain pages nobody should find in search: service and administration pages, content useful only to logged-in users such…
Site indexingWhy should I avoid duplicate pages?
Duplicates are pages with nearly or completely identical text on the same site at different URLs. Yandex’s example of one…
Site indexingMoving the site
A site move means changing the address Yandex ranks. Four situations count as one: A new domain name — example.com…
Robots.txtUsing robots.txt
robots.txt sets crawling parameters for search robots. Restricting sections reduces server load and speeds the site up. Yandex supports the…
Robots.txtThe User-agent directive
The robot looks for records beginning with User-agent: and matches either the substring Yandex (case-insensitively) or *. The precedence rules…
Directivas Disallow y Allow
Disallow impide el rastreo de secciones o páginas; Allow lo permite. Yandex enumera lo que debe ir detrás de Disallow:…
Robots.txtThe Sitemap directive
The Sitemap directive declares where the sitemap lives. Several may be listed, one per line: User-agent: Yandex Allow: / sitemap:…
La directiva Crawl-delay
Crawl-delay ha sido ignorado por Yandex desde el 22 de febrero de 2018. Cualquier sitio que aún mantenga esta directiva…
Robots.txtThe Clean-param directive
Clean-param is a Yandex extension with no equivalent elsewhere: it tells the robot which URL parameters do not change the…
Robots.txtHow to check that a robot belongs to Yandex
Robots can claim to be Yandex by setting the user agent. Verification is done by reverse DNS lookup, and the…
Robots.txtHow do I lower a load on the site or server?
The robot plans its own visits and adjusts load automatically. Requests can spike when it discovers a new section, a…
Meta tags
Meta tags tell the robot how to load, index and display a page. Yandex takes account of a specific set,…
About the IndexNow protocol
IndexNow lets a site notify Yandex directly about pages that were created, updated or deleted, instead of waiting for the…
IndexNowVerification key
The IndexNow key proves you control the site. You generate it, place a file containing it on the site, and…
Referencia de solicitud de la API de IndexNow
La API es deliberadamente pequeña: un endpoint, dos métodos. Una URL — GET GET https://yandex.com/indexnow?url=<String>&key=<String>[&keyLocation=<String>] url y key son obligatorios;…
IndexNowCMS plug-ins
IndexNow can be automated with plugins written by third parties. Yandex lists them for popular systems and attaches a disclaimer…
Sitemap
A sitemap tells search engines the site’s current structure. Yandex supports XML (recommended, because it carries extra information) and TXT…
How do I prohibit indexing of the site or pages?
Three instruments hide content from indexing, and they operate at different levels: the whole site or a section, an individual…
How do I remove pages from the search?
Removing a page from search is a two-step operation, and skipping the first makes the second fail. Prohibit indexing first,…
Site indexingSaved copy
The saved copy shows the page version Yandex last indexed — full page or text only — along with the…
Site indexingDuplicate pages
Duplicates are pages within one site serving the same content at different addresses. Yandex is precise about the boundary: pages…
Site indexingCanonical URLs
When several URLs carry the same or similar content, Yandex groups them and picks one to show — the canonical…
Site indexingProcessing redirects
Yandex recognises the standard 3xx codes: 301 and 308 as permanent, 302, 303 and 307 as temporary, and a refresh…
Site indexingSubdomain indexing
Yandex treats every subdomain as a separate site. That single fact governs everything else: each one is added to the…
Site indexingIndexing pages with JavaScript β
Yandex can execute JavaScript when crawling, and the console lets you decide whether it should. The setting lives under Indexing…
Site indexingIndexing localized pages
Yandex reads hreflang alternate links — and it opens with a deprecation worth acting on: the sitemap file is no…
Site indexingIndexing AJAX sites
Yandex now crawls AJAX sites by fetching the original URLs and executing JavaScript on them. Two older mechanisms are formally…
How do I improve the site’s ranking in the search?
Yandex answers “how do I rank better?” with five indicators to work on and, more usefully, a list of reasons…
How do I improve the site's ranking in the search?Additional ranking signals
This page describes something unusual: Yandex ranks corporate sites partly on signals about how the business behaves toward its customers.…