{"id":28515,"date":"2026-09-08T21:56:08","date_gmt":"2026-09-08T18:56:08","guid":{"rendered":"https:\/\/alienroad.com\/yandex-bilgi-bankasi\/how-do-i-lower-a-load-on-the-site-or-server\/"},"modified":"2026-09-09T00:47:43","modified_gmt":"2026-09-08T21:47:43","slug":"how-do-i-lower-a-load-on-the-site-or-server","status":"publish","type":"ar_ykb","link":"https:\/\/alienroad.com\/yandex-bilgi-bankasi\/how-do-i-lower-a-load-on-the-site-or-server\/","title":{"rendered":"How do I lower a load on the site or server?"},"content":{"rendered":"

The robot plans its own visits and adjusts load automatically. Requests can spike when it discovers a new section, a structural change, or a batch of new URLs. Yandex’s guidance is to diagnose before throttling<\/strong>.<\/p>\n

The diagnosis<\/h2>\n
    \n
  1. Compare pages loaded<\/strong> with pages in search<\/strong> on the My sites page. A large gap means the robot is finding many similar or duplicate pages that should not be indexed.<\/li>\n
  2. Open Crawl statistics, or the server logs, and look at what it actually fetched. Pay attention to URLs with GET parameters<\/strong> \u2014 filter combinations such as ?price=1,000&max_price=1,000,000<\/code>, or internal search URLs such as ?search=\u2026<\/code>. Yandex notes the waste plainly: the robot crawls these distinct URLs, and their identical content cannot participate in search anyway.<\/li>\n<\/ol>\n

    The two remedies, in order<\/h2>\n
      \n
    • Clean-param<\/code><\/strong> \u2014 directs the robot to the canonical URL among the duplicates, transfers accumulated metrics to it, and lets the load fall gradually.<\/li>\n
    • Disallow<\/code><\/strong> \u2014 the fast option: the robot stops accessing the specified pages within 24 hours of the file changing<\/strong>. Use it when the load is a live problem.<\/li>\n<\/ul>\n

      If the load is genuinely not about extra pages<\/h2>\n

      Two options: configure the server to answer 429 Too Many Requests<\/code><\/strong>, which tells Yandex the server is struggling and it will reduce requests; or set the crawl rate manually in the console. The 429<\/code> route is preferable because it is dynamic \u2014 it applies while the server is under pressure and lifts when it is not.<\/p>\n

      Subdomains<\/h2>\n

      Yandex treats each subdomain as a separate site<\/strong> and crawls each one, so the aggregate load can spike without any single site behaving unusually. If server logs show most requests going to subdomains, Yandex suggests something more radical than throttling: reconsider whether the subdomains are needed at all, and whether regional sections of the main site would serve visitors just as well.<\/p>\n","protected":false},"excerpt":{"rendered":"

      The robot plans its own visits and adjusts load automatically. Requests can spike when it discovers a new section, a structural change, or a batch of new URLs. Yandex’s guidance is to diagnose before throttling. The diagnosis Compare pages loaded with pages in search on the My sites page. A large gap means the robot […]<\/p>\n","protected":false},"menu_order":91,"template":"","meta":{"footnotes":""},"ar_ykb_kategori":[765],"ar_ykb_etiket":[],"class_list":["post-28515","ar_ykb","type-ar_ykb","status-publish","has-post-thumbnail","hentry","ar_ykb_kategori-robots-txt"],"_links":{"self":[{"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_ykb\/28515","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_ykb"}],"about":[{"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/types\/ar_ykb"}],"version-history":[{"count":2,"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_ykb\/28515\/revisions"}],"predecessor-version":[{"id":29139,"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_ykb\/28515\/revisions\/29139"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/media\/28897"}],"wp:attachment":[{"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/media?parent=28515"}],"wp:term":[{"taxonomy":"ar_ykb_kategori","embeddable":true,"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_ykb_kategori?post=28515"},{"taxonomy":"ar_ykb_etiket","embeddable":true,"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_ykb_etiket?post=28515"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}