{"id":28505,"date":"2026-09-08T21:56:08","date_gmt":"2026-09-08T18:56:08","guid":{"rendered":"https:\/\/alienroad.com\/yandex-bilgi-bankasi\/how-do-i-prevent-from-indexing-the-pages-that-arent-needed-in-search-results\/"},"modified":"2026-09-09T00:47:43","modified_gmt":"2026-09-08T21:47:43","slug":"how-do-i-prevent-from-indexing-the-pages-that-arent-needed-in-search-results","status":"publish","type":"ar_ykb","link":"https:\/\/alienroad.com\/yandex-bilgi-bankasi\/how-do-i-prevent-from-indexing-the-pages-that-arent-needed-in-search-results\/","title":{"rendered":"How do I prevent from indexing the pages that aren&#8217;t needed in search results?"},"content":{"rendered":"<p>Most sites contain pages nobody should find in search: service and administration pages, content useful only to logged-in users such as checkout screens and profiles, drafts and placeholders. Yandex explains why hiding them is not housekeeping but a ranking concern.<\/p>\n<h2>The three costs of leaving them crawlable<\/h2>\n<ul>\n<li>Unnecessary load on the site from crawling them.<\/li>\n<li><strong>The robot takes longer to reach your landing pages<\/strong> \u2014 crawl capacity spent on pages that will never rank.<\/li>\n<li>If they are indexed, they <strong>compete with your important pages<\/strong> and confuse users.<\/li>\n<\/ul>\n<p>Yandex adds the observation that makes this urgent on large sites: the number of such pages is comparable to, and often exceeds, the number of pages worth attracting visitors to.<\/p>\n<h2>Finding out which ones are actually being crawled<\/h2>\n<p>Searchable pages \u2192 Excluded pages, filtered to <strong>low-value or low-demand<\/strong>. Yandex points out that this list contains two different things:<\/p>\n<ul>\n<li>Pages you <em>do<\/em> want in search, which need improving.<\/li>\n<li>Pages never intended for users, which the robot found anyway \u2014 and those should be hidden.<\/li>\n<\/ul>\n<p>Reading the list with that split in mind turns an anxiety-inducing report into two concrete work items.<\/p>\n<h2>How to hide them<\/h2>\n<p>The instrument depends on the goal. <code>Disallow<\/code> in <code>robots.txt<\/code> stops crawling and saves capacity. <code>noindex<\/code> keeps the page out of results while allowing the robot to read it. Authorisation removes the question entirely for pages that should never be public. The two must not be combined on the same URL \u2014 a blocked page cannot be read, so its <code>noindex<\/code> is never seen.<\/p>\n<h2>The practical priority<\/h2>\n<p>On a catalogue site, the highest-value exclusions are filter and sort combinations, internal search results, and cart and comparison pages. That set is usually where the crawl budget is going, and blocking it is a single afternoon&#8217;s work with a measurable effect on how quickly new products appear.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Most sites contain pages nobody should find in search: service and administration pages, content useful only to logged-in users such as checkout screens and profiles, drafts and placeholders. Yandex explains why hiding them is not housekeeping but a ranking concern. The three costs of leaving them crawlable Unnecessary load on the site from crawling them. [&hellip;]<\/p>\n","protected":false},"menu_order":81,"template":"","meta":{"footnotes":""},"ar_ykb_kategori":[764],"ar_ykb_etiket":[],"class_list":["post-28505","ar_ykb","type-ar_ykb","status-publish","has-post-thumbnail","hentry","ar_ykb_kategori-site-indexing"],"_links":{"self":[{"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_ykb\/28505","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_ykb"}],"about":[{"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/types\/ar_ykb"}],"version-history":[{"count":2,"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_ykb\/28505\/revisions"}],"predecessor-version":[{"id":29138,"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_ykb\/28505\/revisions\/29138"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/media\/28887"}],"wp:attachment":[{"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/media?parent=28505"}],"wp:term":[{"taxonomy":"ar_ykb_kategori","embeddable":true,"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_ykb_kategori?post=28505"},{"taxonomy":"ar_ykb_etiket","embeddable":true,"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_ykb_etiket?post=28505"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}